Asklemmy

John Varley's 8 Worlds books (pre- and post-reboot) have had to colonize the rocks of the Solar system, tho they're not that technical, and he rarely moves past the Moon. Also Gaea (Titan, Wizard, Demon) has an extremely alien habitat; there are other Gaea creatures, just the protagonist one is crazy but also Human-friendly.

Vernor Vinge's A Deepness in the Sky is about life on STL, multi-generation starships.

Bruce Sterling's Schismatrix is mostly set in habitats, asteroid mining, and Martian terraforming, but also a very alien hive.

2. NEVER BORN. “You mean we all came from Earth?” said Nikolai, unbelieving.

“Yes,” the holo said kindly. “The first true settlers in space were born on Earth—produced by sexual means. Of course, hundred of years have passed since then. You are a Shaper. Shapers are never born.”

“Who lives on Earth now?”

“Human beings.”

“Ohhhh,” said Nikolai, his falling tones betraying a rapid loss of interest.

Check out A Memory Called Empire by Arkady Martin and it's sequel.

The Culture series novel, my favorite optimistic and hard sci fi that includes artificial intelligence (minds that have giant ships or habitats for bodies and humanoid avatars to interact with people).

They basically never live on planets because they are inefficient and "inelegant". They live on gigantic ring orbitals that have a fraction of the mass of a planet but multiple times the surface area. No big take-off energy needed either. They also live on gigantic ships that endlessly cruise the milky way. Highly recommend!

Another thought about "colonizing planets" would be that it's basically a form of genocide. Imagine someone had colonized earth half a billion years ago or just a few million years ago. Humanity would never have existed. Just stepping foot on a planet like they do on star trek is basically ecocide - with the introduction of completely foreign and possibly incredibly disruptive micro organisms. Besides the ethical aspect there would also be the loss of information - if you imagine a pristine planet to be a bio computer creating countless unique and new genetic variations and new forms of chemistry. Quite possible not something that can be covered with a computer. Or observing primitive planets as a source of entertainment. There are lots of reasons why outside of a few "home planets" advanced civilizations would never terraform existing biological systems, and would find artificial habitats far more efficient or practical.

Surprised no one has mentioned The Expanse series. A ton of world building in very different kinds of environments. Space stations, small ships, big ships, generation ships, asteroids, moons, planets.

The environments are well thought out in how the residents would need to adapt

Maybe have a look at The Long Winter Trilogy by A.G. Riddle (available at kindle unlimited)

Frank Herberts "WorShip" (aka Pandora Sequence) series should fit the bill. At the very least the first two books, 'Destination: Void' and 'The Jesus Incident'.

The basic premise goes something like:

Humanity shot off into space to find another planet to live on. To survive the journey serious advanced AI needs to be created. AI shenanigans ensue. Humans are dumped on a super hostile planet, highly unfit for human life. As one of humanities last lifelines the AI demands to be worshipped as a god.

ANOTHER series I just remembered and highly recommend is the Unincorporated Man series. I think there are 4-5 books in the series. Pretty good IMHO. Similar to The Expanse, it's the Inners vs the Belters, and explores personal liberty and person hood from the perspective of owning "shares" of yourself like a company.

The conflict is awesome, and two military strategy geniuses duke it out in a Legends of the Galactic Heroes sort of way--one has all the resources and latest tech, the other is scrappy and has to deal with extreme resources shortages. Awesome story.

I've come to believe that once we seriously get into Space, there will come a point where "Planets" are not our primary residence at all.

I feel like O'Neal Cylinders have the advantage of a controlled environment and the lack of a gravity well hindering further exploration.

My suggestion will spoil a bit of the ending so I'm putting it in a spoiler tag.