Pacifism falls down because it assumes everyone wants to live peacefully. But some people are sadistic, malicious or predatory. You can't reason with that because they do want conflict. So if their attention turns to you, you need to make it very very inconvenient for them to continue with their bullshit.