So long as you have gone back to the main ePSXe menu by pressing Esc, you can close the window anyway you want.