I've been on my Realm for quite a few months now - Azjol-Nerub (EU) - and it's only on medium population. Never had to queue to get in...

Krakk, Troll Priest, if anyone else happens to be on that server