Exactly, people didn't respect us because we weren't ranked, plain and simple. If we were ranked #12-15 and got beat by 20, like VTech does almost every year, nobody would have minded us being there. If you're going to tell me you wouldn't complain about an unranked team from any other BCS conference playing in a BCS bowl than you're probably lying.
The good news is that FSU wouldn't be complaining about us going to the ACC if they didn't think it would happen.
VTech does have 32 wins from 2009-2011, and although VTech is down in 2012, they do manage to bring in 65,000 fans at home for an off game against Austin Peay. Maybe that's why the folks don't mind them being in the big bowl games.