Only very large pants would drop down without a belt, it's never been a problem for me anyway.

I only use the slit when I'm in a suit and don't want to untuck and re-tuck my shirt. Many of my boxers don't even have a slit.