I have some ideas as to why skyscrapers are more common west of Yonge Street, but I will have to put it in a nutshell.
The southeastern part of downtown contains some of Toronto's oldest areas, and heritage preservation is quite substantial there, leading to a lower concentration of skyscrapers...