Thank you all for the wealth of great suggestions so far. They definitely help a lot for our planning (in fact, our current list will suffice for a second visit).
Also, this thread turns out to be of value to other Toronto 'newbies', too. I already recommended it to some friends of mine who...