I've only read up to Storm of Swords but he's nowhere near that scummy XD

In the end, he's pretty much the moral compass. Character arcs!