Once you have the two items, you can leave at will. The only reason you have to stay in the first place is so you don't lose all your BP when you leave. Try leaving, and re-entering.

Otherwise, is the Ultima Weapon equipped?