I mostly just dislike him for how he humiliated Stannis, but mostly I just feel sorry for him.

heh, true, and I have absolutely no problem with that. I mean, I love Roose and Tywin and they're far from good guys. The only thing that bothers me is when people pretend that their favourite characters doing shitty things is somehow morally superior. Like, I understand loving Jaime, but I'd be a bit irritated by someone saying that Jaime throwing Bran out of the window is totally badass and cool. ;)