Honestly, I didn't hate him till my brother kept raving about him so much like he was the next best thing since sliced bread.
And even then, there was also the fact that he turned out to be exactly what Vanille said about him in her narration: He's all talk. That's it.