I think the story of the dumb waiter cinches it.

Jefferson invented the dumb waiter the mini-elevator for meal service between floors) so he could serve guests without the conspicuous presence of his slaves. He was a known abolitionist, but not ready to free his own slaves in solidarity with his values.

These are definitely just guys who were in the right place to make rules that served them, but no more even when they knew they could do better.

It also shows that rich who fear being poor will sooner cling to power than raise the bottom so it's not so terrible. And knowing this should better inform the rules of our future societies.