SOTA on the Hardest AI Memory Benchmark (BEAM, 10M Tokens) with a Smaller Model

A new study achieves SOTA on the BEAM benchmark (10M tokens, the hardest AI memory task) using a model smaller than previous SOTA. This shows efficient architecture and training can beat scale.

• benchmark
• memory
• SOTA
• BEAM
• 10M tokens
• smaller model