Llama Cpp Alternatives
11 alternatives to Llama Cpp — comparable AI coding tools for building with AI agents.
Aider
Open-source terminal AI pair programmer that edits files in your Git repo and auto-commits each change, working with Claude, GPT, and other models you bring.
Claude Code
Anthropic’s official agentic coding tool that runs in the terminal, IDE, and web.
Codex CLI
OpenAI's open-source terminal coding agent with sandboxed execution and two-layer approval controls.
Gemini CLI
Google's open-source terminal AI agent powered by Gemini models, with a 1M-token context window and built-in tools.
LM Studio
A desktop app for discovering, downloading, and running open-weight LLMs locally with a GUI and a local OpenAI-compatible server.
Ollama
An open-source tool to run open-weight LLMs locally with a single command, including a local OpenAI-compatible API.
Opencode
The open-source AI coding agent — a terminal TUI from Anomaly with 75+ model providers, LSP-powered context, parallel agents, and shareable sessions.
pgroll
An open-source CLI for zero-downtime, reversible Postgres schema migrations using the expand-contract pattern behind versioned schema views.
Spec Kit
GitHub's open-source toolkit for spec-driven development — a specify CLI and /speckit slash commands that walk any coding agent from spec to implementation.
Unsloth
An open-source library that makes LoRA/QLoRA fine-tuning of LLMs roughly 2x faster and far more memory-efficient, so you can fine-tune on a single GPU.
vLLM
A high-throughput, memory-efficient inference and serving engine for LLMs, with PagedAttention, continuous batching, and an OpenAI-compatible API server.