I think that a lot of people think Kanye is great. Most of his albums so far have had rave reviews (only 808s and Heartbreak tended to divide people somewhat), he's hardly like a figure where people solely pay attention to him to see what faux pas he'll get up to next.
And yes, he's an idiot who does daft things, nobody really denies that. But (to make this clear for the umpteenth time) I. Don't. Care. That has nothing to do with his musical ability.