Alright, hot take: This isn't the case, especially on Lemmy/kbin. Since upvotes/downvotes don't influence sorting, and scores aren't totaled into a single number, there's not really any downside to downvoting someone for just being a shitty opinion or something. If anything, it's actively informative that this-many-people thought this guy was dumb, but _this* many people thought it was good.