Sabr is not silence, and it is not staying

Sabr in the Qur'an is endurance in obedience, in hardship that has come upon you, and in restraint from wrong. It is a quality of a person standing firm.

It is not a duty to absorb another person's wrongdoing indefinitely so that he is never inconvenienced by consequences. Nothing in the word carries that. A person who leaves a harmful house and rebuilds a life is exercising sabr the entire time. Sabr describes how you carry what you carry. It does not tell you to pick up more.

And notice what the instruction is usually attached to. It is almost always given to the person with less power, by somebody with more, about a situation that would cost the speaker something to look at properly.