If you want us to stay and others want to leave, they can leave.
"If you want the others to leave, they will leave, and we will stay."
"We will leave with them if you want them to leave too. We will stick by their side."