Millwright: Rust-based, self-hosted LLM router
LaunchSource: hackernewsAuthor: AndrewLiu96Hotness: 4Published Jul 23, 2026
Millwright is an LLM router written in Rust, self-hosted, that flexibly distributes requests to different model backends with low latency.
- LLM
- Rust
- self-hosted
- router
Comments
Log in to comment
No comments yet. Be the first.