The way I see it, office fans genuinely like talking shit about Andy and don't think people like him deserve respect. And they liked Jim's rejection in this scene, because they agree with it.

This isn't about dunking on a fictional character, it's about addressing the audience.