this post was submitted on 14 Feb 2024
1298 points (98.4% liked)

Programmer Humor

19544 readers
623 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[โ€“] FractalsInfinite@sh.itjust.works 3 points 9 months ago* (last edited 9 months ago) (1 children)

EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S

Some people are energised by that kind of thing. However if you don't want to reveal things to humans, you can use (if you are more technical) llama.cpp

[โ€“] can@sh.itjust.works 3 points 9 months ago* (last edited 9 months ago)

Thanks for the links. So I don't need to worry about downloading the model from meta eh?

Edit: oh you mean download this one instead?

I tried and the app crashes after submitting a prompt but this is a good starting point. I'll take a look into it further later.