cross to bear

(idiomatic) A problem, or unpleasant or painful situation or person that you have to accept and deal with, although you find it very difficult, or it causes trouble or worry for you over a long period of time.