No GPU, no problem. Hosting your own LLM is infinately more fun than the censored offerings from the big players and works surprisingly well.

[Redaktion]

Whether you are looking to host a D&D campaign, troubleshoot code, generate ideas, create NSFW content, or bypass the guardrails set out by the big players, hosting your own LLM is easy with KoboldCPP, and works surprisingly well, even without a GPU.

https://www.notebookcheck.net/No-GPU-no-problem-Hosting-your-own-LLM-is-infinately-more-fun-than-the-censored-offerings-from-the-big-players-and-works-surprisingly-well.1260784.0.html