http://dictionary.reference.com/search?q=jack
http://dictionary.reference.com/search?q=knave

The "card-that-isn't-queen-king-or-ace" is supposed to be of a Prince, a scoundrel fits in more with that than a labourer.

That said, I was brought up on Jack, Queen, King; that's where I stand.