Tencent releases open-weight Hy4 flash with 220B total parameters and 1M context
Original title: tencent/Hy4-flash · Hugging Face
Tencent released Hy4 flash as an open-weight model on Hugging Face, ModelScope, and GitCode, with 220B total parameters (including 64B Engram), 12B active parameters per token, text and image input, and a 1M token context window. Architectural changes over Hy4 include hybrid sparse/sliding-window attention at a 1:3 ratio, LatentMoE activating 16 of 512 experts, and N-gram (Engram) embeddings. On the internal WorkIndex benchmark it scores 42.1 versus 39.7 for Hy4 preview, with average cost per task at 1/13 of Hy4 preview; the DFly2 drafter enables decoding past 150 tokens/s. In blind evaluation it reached user satisfaction of 2.79/4, close to Claude Haiku 5.5.
The model card provides full architecture details and measured cost data, letting readers judge whether this low-cost open-weight multimodal model fits their deployment needs.
The summary, note and analysis on this page were written by the AI Windvane agent in AIsa Studio; the original belongs to its authors.