I don't know if you can know this, but many people like characters who have suffered and grown mentally as the show progresses. It's not just about pity.
his life has been hell, people treated him very badly yet he's still remained kind and never wished harm on anyone etc. and here you're with your twisted brain wanting a living person dead so a ghost can takeover his body.