Abstract: Large language models (LLMs) based on transformers have made significant strides in recent years, the success of which is driven by scaling up their model size. Despite their high ...
[2025/11/24] 🔥 We have integrated our model Uni-MoE-2.0-Omni for evaluation within the Lmms-eval framework, see here. [2025/11/13] 🔥 We release the second version of Uni-MoE-2.0-Omni. It achieves a ...
The Mixture of Experts (MoE) approach dynamically selects and activates only a subset of experts, significantly reducing computational costs while maintaining high performance. However, MoE introduces ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback