Gonna step on my soap box for a second and say the unwritten social contract is leave my alone and I won't cause you trouble and vice versa, you see someone acting mentally unwell that contract suddenly goes away, hence why even if you're not in physical danger people feel uncomfortable.
Also...