Tackling Multimodal Learning Challenges with Mixture-of-Expert: A Survey

Tackling Multimodal Learning Challenges with Mixture-of-Expert: A Survey

Liangwei Zheng, Wei Emma Zhang, Olaf Maennel, Lin Yue, Weitong Chen

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence
Survey Track. Pages 8116-8124. https://doi.org/10.24963/ijcai.2026/900

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic evaluation of multimodal MoE remains lacking. Existing surveys tend to address either multimodal learning or MoE independently, overlooking the unique interplay between them. This survey fills that gap by addressing a central question: How does MoE effectively resolve multimodal challenges? We approach this from three key perspectives: (1) MoE as an Efficient Multimodal Framework: enabling scalable multimodal modeling by decoupling computational cost from parameter growth and mitigating modality redundancy through selective expert activation; (2) MoE as a Multimodal Representation Learner: integrating complementary multi-opinion expert knowledge to enrich alignment and interaction representations; and (3)MoE as a Multimodal Adapter: providing a modular and flexible mechanism to model imperfect modality data such as modality imbalance and missing modality. Through an extensive literature review, we identify critical research gaps, including interpretable routing, expert communication, modality integration, and lifelong multimodal learning. We position this survey as a foundation for future research toward interpretable, adaptive, and sustainable multimodal Mixture-of-Experts systems.
Keywords:
Machine Learning: Multi-modal learning
Data Mining: Information retrieval
Data Mining: Mining heterogenous data
AI Ethics, Trust, Fairnes: Trustworthy AI