this post was submitted on 15 Aug 2023
55 points (96.6% liked)

Selfhosted

40041 readers
764 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

Hi all, looking for my next major project/frustration. I've been forcing myself to learn the new AI tools and I think I'm ready for the next step. I'm familiar with image generation and I dabbled in a bit of chat bot stuff, but I think I'm ready.

I've read a few blogs but I want to find something that could work with my existing setup. My dream setup would be:

A voice assistant that runs locally, preferably dockerized, backup linux, and final option would be Windows, that can run a decent model and preferably let me train a custom voice for it.

I currently have:

  • Home Assistant set up already, I've seen the OpenAI integrations but would like to migrate off of those
  • Google Minis laying around, I'm willing to sacrifice one of them if it means I can use my own stuff
  • Spare 1650GTX GPU, I know not the best but hopefully enough to get it off the ground before deciding to go in on a larger GPU that would be dedicated to this

Needs/wants/nice to haves would be:

  • Basic chat functionality, what's the weather like
  • Play music from my plex or jellyfin server
  • HA integrations so I could say stuff like "Turn off the lights"

Sorry for dumping all of this, like I said I've seen blog posts around, some are doing parts of this, but I wonder if anyone has done something like this. I'm sure people have tried. Guides, jumping off points, even githubs/projects you know of would be helpful.

Thanks all!

you are viewing a single comment's thread
view the rest of the comments
[–] christiannils@sh.itjust.works 2 points 1 year ago

Did you check https://github.com/toverainc/willow-inference-server/ ? I tried it with an ESP-BOX (running https://github.com/toverainc/willow) and the first results are really promising.