It was annoying the first time I played too. After a couple hours I got used to it, and now I have no trouble at all. Just remember that the camera revolvess around the party leader. That helped me greatly.