Laguna XS.2 assigns different numbers of query heads to different layers, giving sliding-window layers more query heads and global/full-attention layers fewer, while keeping the KV heads fixed at 8.

Poolside's Laguna XS.2 introduces per-layer query-head budgeting, spending more query heads on cheap sliding-window layers and fewer on expensive global-attention layers, rather than giving every layer the same attention budget. ✦ AI generated

Sebastian Raschka · Ahead of AI · 2026-05-16 · original ↗

So Laguna XS.2 gives more query heads to sliding-window layers and fewer query heads to global layers, while keeping the KV heads fixed at 8. That is the actual layer-wise head budgeting in the config.

Read full article ↗excerpt · fair-use quotation