You can run a 7b model on cpu really fast even on a phone.
This is a most excellent place for technology news and articles.
You can run a 7b model on cpu really fast even on a phone.