I don't think the data supports the idea that more families are living downtown. Sorry for the formatting below. I suggest checking out the source document:
http://www1.toronto.ca/City Of Toronto/City Planning/Wards/Files/pdf/W/Ward 28 Profile 2011.pdf
Children decreased from 2006 to 2011. 20-somethings and retirement-age folks increased.
Population by Age Group
Ward 28
2006 2011 06-11
Age Group No. % No. % % Chg
Less than 5 3,095 5.1 3,030 4.6 -2.1
5-9 2,890 4.8 2,295 3.4 -20.6
10-14 2,615 4.3 2,290 3.4 -12.4
15-19 2,645 4.4 2,565 3.9 -3.0
20-24 4,195 7.0 5,065 7.6 20.7
25-29 5,745 9.5 8,095 12.2 40.9
30-34 6,170 10.2 7,475 11.2 21.2
35-39 6,115 10.1 5,945 8.9 -2.8
40-44 5,870 9.7 5,480 8.2 -6.6
45-49 4,850 8.0 5,400 8.1 11.3
50-54 4,090 6.8 4,775 7.2 16.7
55-59 3,685 6.1 3,945 5.9 7.1
60-64 2,700 4.5 3,450 5.2 27.8
65-69 1,890 3.1 2,440 3.7 29.1
70-74 1,350 2.2 1,620 2.4 20.0
75-79 1,135 1.9 1,220 1.8 7.5
80-84 760 1.3 840 1.3 10.5
85+ 530 0.9 655 1.0 23.6
Total 60,330 100.0 66,585 100.0 10.4