多模態模型
接受圖像輸入的開源模型越來越多。本頁列出語料中的全部多模態模型,以及識別它們的 config 證據。
判定標準(客觀、機械):隨權重發布的 config.json 中含視覺相關欄位——圖像/視覺 token id、視覺編碼器設定或圖像分塊欄位。不作其他推斷。
| 模型 | 實驗室 | 發布時間 | 總參數 | MoE | 注意力 | config 證據 |
|---|---|---|---|---|---|---|
| Step-3 | StepFun | 2025-07 | 321 B | 稀疏 MoE | MHA | im_end_token im_patch_token im_start_token +3 |
| Hunyuan 7B | Hunyuan | 2025-08 | 7.8 B | 稠密 | GQA | im_end_id im_newline_id im_start_id |
| Kimi K2.5 | Kimi | 2026-02 | 1,040.2 B | 稀疏 MoE | MLA | use_unified_vision_chunk |
| Qwen3.5 122B A10B | Qwen | 2026-02 | 119.9 B | 稀疏 MoE | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Qwen3.5 27B | Qwen | 2026-02 | 23.7 B | 稠密 | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Qwen3.5 35B A3B | Qwen | 2026-02 | 33.9 B | 稀疏 MoE | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Qwen3.5 397B A17B | Qwen | 2026-02 | 392.6 B | 稀疏 MoE | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Qwen3.5 9B | Qwen | 2026-02 | 7.9 B | 稠密 | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Qwen3.5 9B Base | Qwen | 2026-02 | 7.9 B | 稠密 | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Kimi K2.6 | Kimi | 2026-04 | 1,040.2 B | 稀疏 MoE | MLA | use_unified_vision_chunk |
| Qwen3.6 27B | Qwen | 2026-04 | 23.7 B | 稠密 | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Qwen3.6 35B A3B | Qwen | 2026-04 | 33.9 B | 稀疏 MoE | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Hunyuan-TurboS 7B | Hunyuan | 2026-05 | 7.8 B | 稠密 | GQA | im_end_id im_newline_id im_start_id |
| Step-3.7-Flash | StepFun | 2026-05 | 198 B | 稀疏 MoE | MHA | im_end_token im_patch_token im_start_token +5 |
| MiniMax-M3 | MiniMax | 2026-06 | 443.4 B | 稀疏 MoE | GQA | image_grid_pinpoints image_seq_length image_token_index +3 |
| MiniMax-M3 MXFP8 | MiniMax | 2026-06 | 443.4 B | 稀疏 MoE | GQA | image_grid_pinpoints image_seq_length image_token_index +3 |
| Kimi K3 | Kimi | 2026-07 | 2,780 B | 稀疏 MoE | MLA | image_placeholder |
| GLM-5.3-Flash | GLM | 2026-08 | 328.9 B | 稀疏 MoE | MLA | image_token_id image_start_token_id image_end_token_id |
| Qwen3.8 27B | Qwen | 2026-08 | 23.7 B | 稠密 | GQA | image_token_id vision_end_token_id vision_start_token_id |
| Qwen3.8-Flash-Next | Qwen | 2026-08 | 123.6 B | 稀疏 MoE | GQA | image_token_id vision_end_token_id vision_start_token_id |
完整欄位列表見各模型頁;表中僅展示前幾個欄位作為證據。