I've played it a bit on the Xbox and it's even laggy on that. It may just be too much for the switch to handle ¯\_(ツ)_/¯.
If it's warning about too many buildings you may have too many things for the switch to track and display, so best bet would be to remove some things. It sucks, but that's always an issue with open world games like that.