← AI News

Millwright: Rust-based, self-hosted LLM router

LaunchSource: hackernewsAuthor: AndrewLiu96Hotness: 4Published Jul 23, 2026

Millwright is an LLM router written in Rust, self-hosted, that flexibly distributes requests to different model backends with low latency.

  • LLM
  • Rust
  • self-hosted
  • router
View source →

Comments

Log in to comment

No comments yet. Be the first.