Millwright
An open-source, self-hosted LLM router in a single Rust binary. It sits between your AI apps and model providers, routing each request to the lowest-cost healthy model your policy allows — with cache-aware affinity and spend control.
✅ Pros / Advantages
- • Self-hosted LLM router in one Rust binary — no hosted control plane
- • Policy-controlled routing across cheap, mid, and frontier roles
- • Cache-aware session affinity to protect prompt-cache reuse
- • Accepts OpenAI Chat Completions and Anthropic Messages; routes to OpenAI-compatible, Anthropic, or Bedrock
- • Spend ledger (SQLite default, PostgreSQL for prod) with routing provenance
❌ Cons / Limitations
- • Early release (v0.1.0) — the API may shift
- • Router only — does not orchestrate agents or inspect prompts
- • Requires Rust 1.97+ to build from source
💰 Pricing Plans
Free (Open Source)
Pricing details are gathered from public sources and are subject to change. Please visit the official website for real-time rates.
Last updated: July 2026 · 9bests editorial review
✅ Who should use Millwright
- • Self-hosted LLM router in one Rust binary — no hosted control plane
- • Policy-controlled routing across cheap, mid, and frontier roles
- • Cache-aware session affinity to protect prompt-cache reuse
- • Accepts OpenAI Chat Completions and Anthropic Messages; routes to OpenAI-compatible, Anthropic, or Bedrock
- • Spend ledger (SQLite default, PostgreSQL for prod) with routing provenance
⚠️ Who should look elsewhere
- • Early release (v0.1.0) — the API may shift
- • Router only — does not orchestrate agents or inspect prompts
- • Requires Rust 1.97+ to build from source
🎯 Common use cases
Autocompleting and refactoring code
Multi-file AI edits
Debugging and test generation
⚖️ Millwright vs Cursor
| Millwright | Cursor | |
|---|---|---|
| Rating | 4/5 | 4.8/5 |
| Pricing | Free (Open Source) | Free / $20/mo |
| Key strength | Self-hosted LLM router in one Rust binary — no hosted control plane | Best AI code editor |
See the full head-to-head in our Millwright vs Cursor comparison.
❓ Frequently asked questions
Is Millwright free?
+
Millwright offers a free tier (Free (Open Source)). Paid plans unlock higher limits and advanced features.
What is Millwright best for?
+
Millwright is best for Self-hosted LLM router in one Rust binary — no hosted control plane and Policy-controlled routing across cheap, mid, and frontier roles. An open-source, self-hosted LLM router in a single Rust binary. It sits between your AI apps and model providers, routing each request to the lowest-cost healthy model your policy allows — with cache-aware affinity and spend control.
How does Millwright compare to Cursor?
+
Millwright (4/5) and Cursor (4.8/5) serve overlapping needs. Millwright stands out for Self-hosted LLM router in one Rust binary — no hosted control plane, while Cursor is stronger at Best AI code editor. Choose based on your priority.
🔄 Top Alternatives to Millwright
Related ToolsCursor
AI-first code editor built on VS Code
GitHub Copilot
AI pair programmer by GitHub/OpenAI
Windsurf (Codeium)
Free AI code completion and chat assistant
Replit Agent
AI-powered cloud IDE that builds full apps