Roundup Spotlights Six Free Open-Source Tools for Running AI Models Entirely on Local Hardware

Six free, open-source projects that let anyone run modern AI models entirely on their own hardware were highlighted this week as a snapshot of how mature "local AI" tooling has become. The list — llama.cpp, Jan, Ollama, LocalAI, ComfyUI and MLX-LM — spans text generation, image and video synthesis, and Apple Silicon-optimized inference, and none of them require a subscription, an API key, or an internet connection to run.