Skip to content

Tag

#llama-cpp

Every story tagged llama-cpp, newest first.

Wooden and black electronic device with lens housing on wooden floor in home office
Tutorial · software

How to run a local LLM on your own machine with Ollama

Install Ollama, pull a model, and chat with it offline in about ten minutes. No cloud account, no API key, and nothing leaves your machine: the model runs entirely on your own hardware.

Ahmad J · Aug 13, 2026 · 4 min read

Two types of computer memory modules with gold connectors arranged on a gray surface, with a smaller chip positioned separately to the right
Tutorial · aiDeep read

How to choose the right quantization for a local LLM

Decode the Q4, Q5, and Q8 labels on model files, understand what bits-per-weight actually costs you, and pick a quantization that fits your RAM without wrecking quality.

Ahmad J · May 24, 2026 · 4 min read