I have the same trouble while on foot. I don't mind stopping and waiting, but the car stops just afterwards, so I think "oh maybe I can go" and because they only just noticed me stopping they think "oh he's waiting" so then we both try to go and invariably I almost get hit by a car.
I keep losing trout out of my pockets, I have no idea how.