Poolside Unveils Laguna S 2.1: 118B MoE with 1M Context, Runs on a Single DGX Spark

Laguna S 2.1 is a from-scratch 118B MoE model with 8.5B active params per token and 1M context. It fits on a single 128GB DGX Spark by using partial attention (12/48 layers) and FP8 KV cache. Open weights.

• 开源
• Poolside
• DGX Spark
• 百万上下文
• Laguna S 2.1
• 118B MoE