I just graduated from Computer Engineering at Uvic in September 2010.
Victoria is much more chill and relaxed because the population there is a lot less dense, but they have better weather (less rain and snow), and it's awesome in the summer. Very outdoorsy, and the people there are generally pretty nice. Only downside is that places close a lot earlier, and there isn't as many stores and night clubs etc there. Their downtown is only like a few blocks?
In terms of living costs, I'm not too sure, but depends if how large you want to live. I'd say expect to pay anywhere between 500 to 750ish if you want to live with room mates. Food is probably the same, but probably a lot less choices, and less convenient.
Hot to ugly ratio, I'm not sure, because I'm in shitty engineering, but the ratio of the number of girls to boys is pretty big! But definitely a lot less CBC girls
If I were you, I'd try to register at Uvic as a distant student so that you can maybe take two years of full load there and see if you like it, and if you don't you can move back and get credit for your courses. But imo, it's always good to have more variety in your life.
I went to BCIT, Camosun College, Uvic, and SFU.