Yeah, the sidewalks are way too small. I regularly have to jump onto the road to get past groups of people or slower walkers. The recent roadwork and sidewalk reconstruction has definitely made it worse too.
Oh and re. street walls, I appreciate a good one myself but honestly I don't see what's wrong with Charles. The buildings all blend into one another nicely here and besides, the kink in the road at Yonge means that any street canyon would be disrupted. I think this is perfectly fine and Charles feels insanely urban to me.