I think Silly Tavern + Silly Tavern Extras could achieve this, it uses ChromaDB for infinite context.

Games that lets you explore beautiful and fictional worlds in VR. Kinda like Minecraft but not with voxels, not a survival game but have some sort of game loop to keep you going. Or a puzzle game like Myst but with bigger and explorable maps, perhaps a “home” to decorate with trophies you found in other worlds (ACNH style?) I just want a chill game in VR…