I agree about the sports...the sports fields on the western half are really just a defacto staging area for dog-pooping contests.
I dunno about the image problem regarding the old-school zoo...personally, I secretly (no make that publicly) yearn for some good ole political incorrectness. Baboons are a bunch of assholes anyway.
I prefer the more intimate and neighbourhood intigrated western side of the park. In fact, the nature's taking it back situation with the "farm" is what I like most about it...especially down at the bottom, where old rements of the zoo can still be glimpsed here and there.
Overgrown walkways where the benches that once were full, now line the lonely path, rotting, overlooking nothing. An old stone animal cage, with the rusted bars is still there...what was once probably a lovely pond, is now an overgrown, algea covered swamp. The little stone arched bridge...that old caretakers house with the funky brick work.
Throw in the wonderfully creepy "city of the dead" next to it, and you have a unique little pocket in the heart of the city.
Riverdale Park East has a completely different vibe, and not nearly as intigrated with the Riverdale neighbourhood....Withrow Park is much better at that (although I hear the dogs have been nervous lately). It does have a great open feeling, which lends itself better towards playing fields....and the view while walking along the Broadview "ridge" is fantastic.