The results of elections in Scarborough during the last ~ 10 years, at all levels, pretty clearly show that the subway is more popular. Everyone who got elected, either positioned themselves as a subway proponent, or didn't strongly associate themselves with either transit choice. Literally noone got elected by running an anti-subway campaign.
Sure, the elections aren't just about transit, and aren't about a particular transit project. But when you see the same pattern over and over again: noone wants to associate themselves with one of the solutions to a prominent public need, then you can be pretty sure that the said solution is not popular with the voters.
SSE detractors surely could field a few candidates and try their luck, but where are those candidates? crickets ..