So, I posted this on a similar thread a few days ago, but plex and/or jellyfin do an amazing job of user/library seperation, music streaming, AND have apps for every relevant platform you'd remotely care about: phones, computers, browsers, widgets plugged into your tv, etc.
It's a little odd nobody has bothered to do a really good multi user/library audio-only app, but plex+plexamp or jellyfin+finamp is a pretty great solution as it is.