MobileMoE-S-Base

310 downloads 1 likes on Hugging Face updated

Papers using or citing this model 1

  • MobileMoE: Scaling On-Device Mixture of Experts · 2026 · arXiv

    Mixture-of-Experts (MoE) has become the de facto architecture for hundred-billion-parameter language models, yet its advantages at sub-billion scales for on-device deployment remain largely unexplored. To close this gap, we present...