Cover Image

47B Mixture-of-Experts Beats 671B Dense Models on Chinese Medical Examinations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tseng, Chiung-Yi, Zhang, Danyang, Wang, Tianyang, Luo, Hongying, Chen, Lu, Huang, Junming, Guan, Jibin, Hao, Junfeng, Song, Junhao, Song, Xinyuan, Bi, Ziqian
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Is GPT-OSS Good? A Comprehensive Evaluation of OpenAI's Latest Open Source Models
by: Bi, Ziqian, et al.
Published: (2025)

Mixture of Experts in Large Language Models
by: Zhang, Danyang, et al.
Published: (2025)

Is GPT-OSS All You Need? Benchmarking Large Language Models for Financial Intelligence and the Surprising Efficiency Paradox
by: Bi, Ziqian, et al.
Published: (2025)

Active Learning Methods for Efficient Data Utilization and Model Performance Enhancement
by: Tseng, Chiung-Yi, et al.
Published: (2025)

Multimodal Representation Learning and Fusion
by: Jin, Qihang, et al.
Published: (2025)

Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models
by: Han, Xudong, et al.
Published: (2025)

Exploring Efficiency Frontiers of Thinking Budget in Medical Reasoning: Scaling Laws between Computational Resources and Reasoning Quality
by: Bi, Ziqian, et al.
Published: (2025)

CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimization
by: Bi, Ziqian, et al.
Published: (2025)

Affective Multimodal Agents with Proactive Knowledge Grounding for Emotionally Aligned Marketing Dialogue
by: Yu, Lin, et al.
Published: (2025)

Achieving Trustworthy Real-Time Decision Support Systems with Low-Latency Interpretable AI Models
by: Deng, Zechun, et al.
Published: (2025)

AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveys
by: Wu, Siyi, et al.
Published: (2025)

FMCW Radar Principles and Human Activity Recognition Systems: Foundations, Techniques, and Applications
by: Bi, Ziqian, et al.
Published: (2024)

Interpartner Differences and Governance Mode Dilemma: The Role of Alliance Scope
by: Chiung-Hui Tseng
Published: (2016)

Predicting ICU In-Hospital Mortality Using Adaptive Transformer Layer Fusion
by: Wang, Han, et al.
Published: (2025)

Data Verification is the Future of Quantum Computing Copilots
by: Song, Junhao, et al.
Published: (2026)

StreetMath: Study of LLMs' Approximation Behaviors
by: Tseng, Chiung-Yi, et al.
Published: (2025)

Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models
by: Yang, Junjie, et al.
Published: (2025)

DECO: Sparse Mixture-of-Experts with Dense-Comparable Performance on End-Side Devices
by: Song, Chenyang, et al.
Published: (2026)

Investigating Mixture of Experts in Dense Retrieval
by: Sokli, Effrosyni, et al.
Published: (2024)

LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation
by: Shi, Hengyu, et al.
Published: (2025)

From Noise to Nuance: Advances in Deep Generative Image Models
by: Peng, Benji, et al.
Published: (2024)

Mixture of Experts Approaches in Dense Retrieval Tasks
by: Sokli, Effrosyni, et al.
Published: (2025)

Lazarus: Resilient and Elastic Training of Mixture-of-Experts Models
by: Wu, Yongji, et al.
Published: (2024)

MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision Tasks
by: Zhu, Xingkui, et al.
Published: (2024)

Early Prediction of In-Hospital ICU Mortality Using Innovative First-Day Data: A Review
by: Huang, Baozhu, et al.
Published: (2025)

MoFE-Time: Mixture of Frequency Domain Experts for Time-Series Forecasting Models
by: Liu, Yiwen, et al.
Published: (2025)

Pruning and Distilling Mixture-of-Experts into Dense Language Models
by: Kim, Junhyuck, et al.
Published: (2026)

Dense Backpropagation Improves Training for Sparse Mixture-of-Experts
by: Panda, Ashwinee, et al.
Published: (2025)

A Comprehensive Survey and Guide to Multimodal Large Language Models in Vision-Language Tasks
by: Liang, Chia Xin, et al.
Published: (2024)

Sparse-Dense Mixture of Experts Adapter for Multi-Modal Tracking
by: Zhu, Yabin, et al.
Published: (2026)

Tempo as the Stable Cue: Hierarchical Mixture of Tempo and Beat Experts for Music to 3D Dance Generation
by: Lyu, Guangtao, et al.
Published: (2025)

Gas elements of ODP Hole 110-671B
by: Mascle, Alain, et al.
Published: (2005)

Shear strength of ODP Hole 110-671B
by: Mascle, Alain, et al.
Published: (2005)

Sample corelog of ODP Hole 110-671B
by: Mascle, Alain, et al.
Published: (2005)

Thermal conductivity of ODP Hole 110-671B
by: Mascle, Alain, et al.
Published: (2005)

Downhole temperature in ODP Hole 110-671B
by: Mascle, Alain, et al.
Published: (2005)

Magnetic susceptibility on ODP Hole 110-671B
by: Mascle, Alain, et al.
Published: (2005)

Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion
by: Szatkowski, Filip, et al.
Published: (2023)

Multi-Task Dense Prediction via Mixture of Low-Rank Experts
by: Yang, Yuqi, et al.
Published: (2024)

FTSCommDetector: Discovering Behavioral Communities through Temporal Synchronization
by: Luo, Tianyang, et al.
Published: (2025)