ATRIUMsearch → argument graph

DefinitionArticle

Hy3 is a 295B-parameter Mixture-of-Experts model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team.

Tencent describes the technical architecture of its new Hy3 model: a 295B-parameter MoE model with 21B active parameters. ✦ AI generated

Tencent Hy Team · Simon Willison's Weblog · 2026-07-06 · original ↗

Export .md Export .txt

Hy3 is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team.

Read full article ↗excerpt · fair-use quotation

▦ Tencent Hy Team ✳ Hy3

Related moments

FactArticle

Zyphra, which trains its models on AMD GPUs and is seen as an insider tip in the research community for its detailed architecture-focused tech reports, released new flagship MoE models: a 74B-A4B and an 8B-A0.6B.

the author · Interconnects

FactArticle

ARGUS has run stably for over six months on a production cluster of more than 10,000 GPUs, and has been key to detecting and diagnosing performance failures like compute stragglers and communication degradation at that scale.

Tencent researchers · Import AI

ClaimArticle

2026 architecture research has moved beyond simply scaling transformers larger, branching into hybrid architectures, state space layers, MoE capacity allocation, activation behavior, and representation geometry.

Sebastian Raschka · Ahead of AI