That's a good way of looking at it.
Both, to the west and to the east, are just to the side of the centre of it all. Distillery just east of St. Lawrence Market and Liberty just east of the main King West strip.
And in both cases, future development will eventually create a seamless mix of neighbourhoods spreading both east and west of downtown.