Depends. First I'll sigh a couple of times, but if I keep losing, I'll growl, then after that I'll scream and/or hit things. I usually refuse to give up.
It's worst with RTS games. When I've put 45 minutes into building an army and creating a MASTER PLAN and then I get Zerged, yeah, that annoys me lots.