Cover Image

Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Rongyu, Cheng, Aosong, Luo, Yulin, Dai, Gaole, Yang, Huanrui, Liu, Jiaming, Xu, Ran, Du, Li, Du, Yuan, Jiang, Yanbing, Zhang, Shanghang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptation
by: Zhang, Ronyu, et al.
Published: (2026)

T-REX: Mixture-of-Rank-One-Experts with Semantic-aware Intuition for Multi-task Large Language Model Finetuning
by: Zhang, Rongyu, et al.
Published: (2024)

MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation
by: Zhang, Rongyu, et al.
Published: (2025)

FactorLLM: Factorizing Knowledge via Mixture of Experts for Large Language Models
by: Zhao, Zhongyu, et al.
Published: (2024)

BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection
by: Zhang, Rongyu, et al.
Published: (2025)

SpikeGen: Decoupled "Rods and Cones" Visual Representation Processing with Latent Generative Framework
by: Dai, Gaole, et al.
Published: (2025)

Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation
by: Liu, Jiaming, et al.
Published: (2023)

Key-Embedded Privacy for Decentralized AI in Biomedical Omics
by: Zhang, Rongyu, et al.
Published: (2026)

RepCaM++: Exploring Transparent Visual Prompt With Inference-Time Re-Parameterization for Neural Video Delivery
by: Zhang, Rongyu, et al.
Published: (2025)

Distribution-Aware Continual Test-Time Adaptation for Semantic Segmentation
by: Ni, Jiayi, et al.
Published: (2023)

PAT: Pruning-Aware Tuning for Large Language Models
by: Liu, Yijiang, et al.
Published: (2024)

ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation
by: Liu, Jiaming, et al.
Published: (2023)

Orochi: Versatile Biomedical Image Processor
by: Dai, Gaole, et al.
Published: (2025)

Multimodal Large Language Models for Bioimage Analysis
by: Zhang, Shanghang, et al.
Published: (2024)

Mixture of Neuron Experts
by: Cheng, Runxi, et al.
Published: (2025)

Continual Adaptation for Autonomous Driving with the Mixture of Progressive Experts Network
by: Cui, Yixin, et al.
Published: (2025)

VeCAF: Vision-language Collaborative Active Finetuning with Training Objective Awareness
by: Zhang, Rongyu, et al.
Published: (2024)

Variational Continual Test-Time Adaptation
by: Lyu, Fan, et al.
Published: (2024)

SURGEON: Memory-Adaptive Fully Test-Time Adaptation via Dynamic Activation Sparsity
by: Ma, Ke, et al.
Published: (2025)

Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion
by: Szatkowski, Filip, et al.
Published: (2023)

Sparsity and Superposition in Mixture of Experts
by: Chaudhari, Marmik, et al.
Published: (2025)

MoSA: Mixture of Sparse Adapters for Visual Efficient Tuning
by: Zhang, Qizhe, et al.
Published: (2023)

Uncovering Intra-expert Activation Sparsity for Efficient Mixture-of-Expert Model Execution
by: Park, Jongseok, et al.
Published: (2026)

LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model
by: Luo, Yulin, et al.
Published: (2024)

WM-MoE: Weather-aware Multi-scale Mixture-of-Experts for Blind Adverse Weather Removal
by: Luo, Yulin, et al.
Published: (2023)

Mixture of Length and Pruning Experts for Knowledge Graphs Reasoning
by: Du, Enjun, et al.
Published: (2025)

IMSE: Intrinsic Mixture of Spectral Experts Fine-tuning for Test-Time Adaptation
by: Baek, Sunghyun, et al.
Published: (2026)

SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models
by: Fang, Hengyu, et al.
Published: (2025)

UniTTA: Unified Benchmark and Versatile Framework Towards Realistic Test-Time Adaptation
by: Du, Chaoqun, et al.
Published: (2024)

TAME: Test-Time Adversarial Prompt Tuning via Mixture-of-Experts for Vision-Language Models
by: Wang, Xin, et al.
Published: (2026)

DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editing
by: Jia, Yueru, et al.
Published: (2024)

Implicit Neural Image Field for Biological Microscopy Image Compression
by: Dai, Gaole, et al.
Published: (2024)

Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs
by: Zhou, Yixiao, et al.
Published: (2025)

Mixture-of-Experts for Open Set Domain Adaptation: A Dual-Space Detection Approach
by: Du, Zhenbang, et al.
Published: (2023)

Adaptive Detection of Fast Moving Celestial Objects Using a Mixture of Experts and Physical-Inspired Neural Network
by: Jia, Peng, et al.
Published: (2025)

Controllable Continual Test-Time Adaptation
by: Shi, Ziqi, et al.
Published: (2024)

SPEGC: Continual Test-Time Adaptation via Semantic-Prompt-Enhanced Graph Clustering for Medical Image Segmentation
by: Du, Xiaogang, et al.
Published: (2026)

TRAM: Test-Time Risk Adaptation with Mixture of Agents
by: Chehade, Mohamad Fares El Hajj, et al.
Published: (2024)

BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity
by: Song, Chenyang, et al.
Published: (2025)

Fisher-aware Quantization for DETR Detectors with Critical-category Objectives
by: Yang, Huanrui, et al.
Published: (2024)