I'm all for letting servers choose what they want to ban and allow. Its easy enough to just create a new account on a different server if you do not agree with the server admins decisions.
That's the beauty of federation. The user can also setup his own instance to access the content if he wishes. He might have to learn how to do it, but its totally doable.