# Fireworks AI

> Fast production inference for open models — serverless and dedicated GPU deployments, fine-tuning, and an OpenAI-compatible API on the FireAttention engine.

Fireworks AI is a production inference platform for open models. It serves 100+ models (text, vision, audio, image, embeddings) over an OpenAI-compatible API — as pay-per-token serverless or dedicated GPU deployments — and adds fine-tuning. Its proprietary FireAttention engine targets low latency and high throughput for open-source architectures.

Website: https://fireworks.ai

Fireworks AI is a **production inference platform for open models**. It hosts 100+ models — spanning text, vision, audio, image generation, and embeddings — and serves them over an OpenAI-compatible API (with Anthropic compatibility too), so existing application code can often switch by changing the base URL and model name.

The platform's differentiator is speed at production scale. Models run on **FireAttention**, Fireworks' proprietary inference engine built specifically for open-source model architectures, aimed at low first-token latency and high throughput rather than the generic performance of a self-hosted server. You can run inference as **pay-per-token serverless** (no GPU provisioning, good for prototyping and bursty traffic) or as **dedicated GPU deployments** with autoscaling for steady production load.

Beyond inference, Fireworks offers **managed fine-tuning** — supervised and reinforcement approaches — with fine-tuned models served back on the same inference stack. Production features include function calling, structured JSON output, and batch inference, which makes it a common building block for agentic and RAG systems.

Fireworks is a hosted, closed-source service. It is a direct alternative to other open-model inference providers like [Together AI](/tools/together-ai), [Groq](/tools/groq), [Baseten](/tools/baseten), and [Replicate](/tools/replicate); for choosing between hosting your own model and using an API like this, see [self-host vs. API LLM](/guides/self-host-vs-api-llm).

---

_Source: https://agentscamp.com/tools/fireworks-ai — Tool on AgentsCamp._