I just moved from a street in Parkdale that had old mansions made into apartments, old mansions made into group homes, old mansions made into rooming houses and a couple of apartment buildings. The rooming house had at least 40-50 people in it, all stuffed in single rooms. One lady who read tarot cards got knifed to death there, I guess because the person didn't like their reading. People would scream up and down the block at least once a week during the summer months.
The cops came a couple of times a year.
But none of that ever made me feel unsafe. Feeling safe is as much a state of being as it is an environment. I could understand the neighbours' concerns if they actually were in danger. But it's not like these kids have guns in this group home.