I dislike John Tory for a lot of reasons. He's an opportunist, he panders. He's out of touch with the real world (being born into a rich family and succeeding mostly thanks to your friendships and connections can do that to you). His transit plan is garbage. He's been at best, lukewarm to the needs of cyclists and pedestrians, caring more about traffic congestion. He probably won't take on the police, he probably won't make the necessary investments in the TTC (particuarly the surface system). He will be able to continue a Ford agenda, but with a more urbane face to it.
But I wouldn't call him a racist even though he financially assisted Rob Ford's 2010 campaign. That's taking it too far. The vast majority supported Ford for his platforms, not because of his racism. I would never equate the support of Ford in 2010 with support of racism/bigotry.
Give it a rest.