I always felt this way about Will Ferrell's character as well. I hated the episodes he was a part of. They were weird and uncomfortable and totally not funny. I did like how they met, though.
Can I say in an Office tangent that I loved Ricky Gervais' cameo as well? Loved loved loved loved loved it.