While Persona 4 has better gameplay (more polished and evolved combat etc), Persona 3 has better...almost everything else and is definitely more memorable to me.

Gameplay is a big part of Persona games for me so that makes it not quite as one-sided as it sounds, but in the end it's Persona 3 that comes out ahead for me.