01
Ollama
A user‑friendly tool to run large language models locally. Supports a wide range of models and provides a simple CLI and API for easy integration.
CLI & APIA curated list of the best tools and frameworks that let you run large language models on your own machine — giving you full control, privacy, and offline capability.
Compare the most popular platforms that enable you to load, run, and interact with large language models directly on your own hardware — no cloud required.
A user‑friendly tool to run large language models locally. Supports a wide range of models and provides a simple CLI and API for easy integration.
CLI & APIA powerful desktop application that allows you to run LLMs offline with a beautiful GUI, model management, and built‑in chat interface.
GUIA high‑performance C++ implementation that enables efficient inference of LLMs on CPU and GPU with minimal memory footprint.
C++ / EfficientA user‑friendly frontend for Llama.cpp with a web interface, supporting many models and offering features like story writing and role‑play.
Web UIAn open‑source AI assistant that runs completely offline, with a sleek desktop interface and support for multiple models and integrations.
Desktop AIA high‑throughput, low‑latency inference engine for LLMs, leveraging advanced memory management and continuous batching for maximum performance.
High‑PerformanceA modern local LLM platform with a focus on ease of use, offering a clean interface, one‑click model downloads, and chat functionality.
User‑Friendly