I think the issue with this would be similar to the issue with a streaming radio: lots of bandwidth. It is an interesting idea, but the requirements to do a dedicated server through the site might not make it worth it. Unless we get someone who wouldn't mind donating a dedicated box and their pipe for it.
Alternatively, I recommend Skype or YM.
