Dustin - Don't give up on it yet. The class size is usually around 6, and a good chunk are off the street. Of the class that just started, I believe 2 or 3 are off the street (ab initio), the two before that both had 5 ab initio. The last IFR generic course for YYZ was all ab initio. No telling what might happen for the upcoming courses, but that's how things have looked recently.
They do take a lot of people off the street, and it sounds like they're going to be loading another VFR course next spring. As with all other industries right now, people are retiring or getting close. Good Luck!