ALTO needs to be able to pass through Downtown Toronto to get to the yard, which happens to be where the GO/VIA yards are.
This is the most defined, clearest rail right of way on the map, so to me this makes me assume the decision to have a yard here is final, and the ALTO route has to work...