ALSA has given me bad problems in the past much like yours - randomly killing audio - and the only thing I've been able to do to fix it is to switch everything to ESD and reboot (under System -> Preferences -> Sound).

Hopefully this helps you; I haven't had any audio problems since.