Hierarchical LoRA MoE for Efficient CTR Model Scaling
Fuente:
arXiv
Guardado en:
| Autores principales: | Zeng, Zhichen, Hang, Mengyue, Liu, Xiaolong, Liu, Xiaoyi, Lin, Xiao, Qiu, Ruizhong, Wei, Tianxin, Liu, Zhining, Yuan, Siyang, Yang, Chaofei, Liu, Yiqun, Yin, Hang, Yang, Jiyan, Tong, Hanghang |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
A Collaborative Ensemble Framework for CTR Prediction
por: Liu, Xiaolong, et al.
Publicado: (2024)
por: Liu, Xiaolong, et al.
Publicado: (2024)
AIM: Attributing, Interpreting, Mitigating Data Unfairness
por: Liu, Zhining, et al.
Publicado: (2024)
por: Liu, Zhining, et al.
Publicado: (2024)
WAPITI: A Watermark for Finetuned Open-Source LLMs
por: Chen, Lingjie, et al.
Publicado: (2024)
por: Chen, Lingjie, et al.
Publicado: (2024)
ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning
por: Qiu, Ruizhong, et al.
Publicado: (2026)
por: Qiu, Ruizhong, et al.
Publicado: (2026)
CATS: Mitigating Correlation Shift for Multivariate Time Series Classification
por: Lin, Xiao, et al.
Publicado: (2025)
por: Lin, Xiao, et al.
Publicado: (2025)
BACKTIME: Backdoor Attacks on Multivariate Time Series Forecasting
por: Lin, Xiao, et al.
Publicado: (2024)
por: Lin, Xiao, et al.
Publicado: (2024)
PLANETALIGN: A Comprehensive Python Library for Benchmarking Network Alignment
por: Yu, Qi, et al.
Publicado: (2025)
por: Yu, Qi, et al.
Publicado: (2025)
Hierarchical Multi-Marginal Optimal Transport for Network Alignment
por: Zeng, Zhichen, et al.
Publicado: (2023)
por: Zeng, Zhichen, et al.
Publicado: (2023)
Octavius: Mitigating Task Interference in MLLMs via LoRA-MoE
por: Chen, Zeren, et al.
Publicado: (2023)
por: Chen, Zeren, et al.
Publicado: (2023)
AvAtar: Learning to Align via Active Optimal Transport
por: Yu, Qi, et al.
Publicado: (2026)
por: Yu, Qi, et al.
Publicado: (2026)
MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
por: Yang, Shu, et al.
Publicado: (2024)
por: Yang, Shu, et al.
Publicado: (2024)
Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptation
por: Bao, Wenxuan, et al.
Publicado: (2024)
por: Bao, Wenxuan, et al.
Publicado: (2024)
Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecasting
por: Liu, Zhining, et al.
Publicado: (2025)
por: Liu, Zhining, et al.
Publicado: (2025)
Towards Specialized Generalists: A Multi-Task MoE-LoRA Framework for Domain-Specific LLM Adaptation
por: Yang, Yuxin, et al.
Publicado: (2026)
por: Yang, Yuxin, et al.
Publicado: (2026)
Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization
por: Qiu, Ruizhong, et al.
Publicado: (2024)
por: Qiu, Ruizhong, et al.
Publicado: (2024)
MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning
por: Manzoni, Andrea
Publicado: (2026)
por: Manzoni, Andrea
Publicado: (2026)
LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025)
por: Li, Wenbing, et al.
Publicado: (2025)
InterFormer: Effective Heterogeneous Interaction Learning for Click-Through Rate Prediction
por: Zeng, Zhichen, et al.
Publicado: (2024)
por: Zeng, Zhichen, et al.
Publicado: (2024)
Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning
por: Li, Weihang, et al.
Publicado: (2026)
por: Li, Weihang, et al.
Publicado: (2026)
AdaFuse: Adaptive Ensemble Decoding with Test-Time Scaling for LLMs
por: Cui, Chengming, et al.
Publicado: (2026)
por: Cui, Chengming, et al.
Publicado: (2026)
GuiLoMo: Allocating Expert Number and Rank for LoRA-MoE via Bilevel Optimization with GuidedSelection Vectors
por: Zhang, Hengyuan, et al.
Publicado: (2025)
por: Zhang, Hengyuan, et al.
Publicado: (2025)
Ensuring User-side Fairness in Dynamic Recommender Systems
por: Yoo, Hyunsik, et al.
Publicado: (2023)
por: Yoo, Hyunsik, et al.
Publicado: (2023)
Class-Imbalanced Graph Learning without Class Rebalancing
por: Liu, Zhining, et al.
Publicado: (2023)
por: Liu, Zhining, et al.
Publicado: (2023)
A Language-Agnostic Hierarchical LoRA-MoE Architecture for CTC-based Multilingual ASR
por: Zheng, Yuang, et al.
Publicado: (2026)
por: Zheng, Yuang, et al.
Publicado: (2026)
LoRALib: A Standardized Benchmark for Evaluating LoRA-MoE Methods
por: Wang, Shaoheng, et al.
Publicado: (2025)
por: Wang, Shaoheng, et al.
Publicado: (2025)
Saffron-1: Safety Inference Scaling
por: Qiu, Ruizhong, et al.
Publicado: (2025)
por: Qiu, Ruizhong, et al.
Publicado: (2025)
SelfElicit: Your Language Model Secretly Knows Where is the Relevant Evidence
por: Liu, Zhining, et al.
Publicado: (2025)
por: Liu, Zhining, et al.
Publicado: (2025)
Harnessing Consistency for Robust Test-Time LLM Ensemble
por: Zeng, Zhichen, et al.
Publicado: (2025)
por: Zeng, Zhichen, et al.
Publicado: (2025)
HMVLM: Human Motion-Vision-Lanuage Model via MoE LoRA
por: Hu, Lei, et al.
Publicado: (2025)
por: Hu, Lei, et al.
Publicado: (2025)
AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach
por: Li, Xurui, et al.
Publicado: (2024)
por: Li, Xurui, et al.
Publicado: (2024)
R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
por: Liu, Jinda, et al.
Publicado: (2025)
por: Liu, Jinda, et al.
Publicado: (2025)
HiLoRA: Adaptive Hierarchical LoRA Routing for Training-Free Domain Generalization
por: Han, Ziyi, et al.
Publicado: (2025)
por: Han, Ziyi, et al.
Publicado: (2025)
Pave Your Own Path: Graph Gradual Domain Adaptation on Fused Gromov-Wasserstein Geodesics
por: Zeng, Zhichen, et al.
Publicado: (2025)
por: Zeng, Zhichen, et al.
Publicado: (2025)
Conditional LoRA Parameter Generation
por: Jin, Xiaolong, et al.
Publicado: (2024)
por: Jin, Xiaolong, et al.
Publicado: (2024)
SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
por: Liu, Jianmin, et al.
Publicado: (2025)
por: Liu, Jianmin, et al.
Publicado: (2025)
FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasets
por: Wang, Dannong, et al.
Publicado: (2025)
por: Wang, Dannong, et al.
Publicado: (2025)
FM-LoRA: Factorized Low-Rank Meta-Prompting for Continual Learning
por: Yu, Xiaobing, et al.
Publicado: (2025)
por: Yu, Xiaobing, et al.
Publicado: (2025)
Latte: Collaborative Test-Time Adaptation of Vision-Language Models in Federated Learning
por: Bao, Wenxuan, et al.
Publicado: (2025)
por: Bao, Wenxuan, et al.
Publicado: (2025)
ReLope: KL-Regularized LoRA Probes for Multimodal LLM Routing
por: Zeng, Yaopei, et al.
Publicado: (2026)
por: Zeng, Yaopei, et al.
Publicado: (2026)
CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models
por: Wang, Zhuxuanzi, et al.
Publicado: (2025)
por: Wang, Zhuxuanzi, et al.
Publicado: (2025)
Ejemplares similares
-
A Collaborative Ensemble Framework for CTR Prediction
por: Liu, Xiaolong, et al.
Publicado: (2024) -
AIM: Attributing, Interpreting, Mitigating Data Unfairness
por: Liu, Zhining, et al.
Publicado: (2024) -
WAPITI: A Watermark for Finetuned Open-Source LLMs
por: Chen, Lingjie, et al.
Publicado: (2024) -
ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning
por: Qiu, Ruizhong, et al.
Publicado: (2026) -
CATS: Mitigating Correlation Shift for Multivariate Time Series Classification
por: Lin, Xiao, et al.
Publicado: (2025)