Dec '23 in 📚 Recommendations
Run a GPT (LLM) on your local machine
For some individuals, you may want to run a GPT on your local machine for a number of reasons.
1) You can't pay for or acquire a chatGPT membership
2) You may need to sometimes work offline
3) You are working on a super secret business idea and you don't want a corporation on the other end
There are at least a couple of options you can run locally, they in turn allow a choice of open source LLMs from Hugging Face. Just note this requires a fairly recent machine for decent performance, but not a GPU. A good open source LLM is Falcon.
Here are some free options.
LM Studio
GPT4ALL
Hugging Face (for LLMs)
Hope this is useful to someone. 🙂
8
3 comments
Run a GPT (LLM) on your local machine
skool.com/data-alchemy
Your Community to Master the Fundamentals of Working with Data and AI — by Datalumina®
Leaderboard (30-day)
1
+251
2
+182
3
+155
4
+61
5
+58
powered by