this post was submitted on 18 Oct 2024
250 points (99.2% liked)

Programming Horror

1885 readers
31 users here now

Welcome to Programming Horror!

This is a place to share strange or terrible code you come across.

For more general memes about programming there's also Programmer Humor.

Looking for mods. If youre interested in moderating the community feel free to dm @Ategon@programming.dev

Rules

Credits

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] Zos_Kia@lemmynsfw.com 1 points 3 weeks ago (1 children)

Honestly the use case i'm working on is pretty mind blowing. User records an unstructured voice note like "i am out of item 12, also prices of items 13 & 15 is down to 4 dollars 99, also shipping for all items above 1kg is now 3 dollars 99" and the LLM will search the database for items >1kg (using tool calling) then generate a JSON representing the changes to be made. We use that JSON to make a simple UI where the user can review the changes - then voilà it's sent to the backend which persists the change in database. In the ideal case the user never even pulls up the virtual keyboard on their phone, it's just "talk, check, click, done".

[–] BluesF@lemmy.world 1 points 3 weeks ago

Human in the loop systems with LLMs really nicely deal with a lot of their problems. Very cool! Do you have specific change "types" that the system is able to propose? I guess restricting the response to the right types is covered by your JSON schema?