Cover Image

Unlocking Emergent Modularity in Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qiu, Zihan, Huang, Zeyu, Fu, Jie
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Unlocking Continual Learning Abilities in Language Models
by: Du, Wenyu, et al.
Published: (2024)

Unlock the Potential of Large Language Models for Predictive Tabular Tasks in Data Science with Table-Specific Pretraining
by: Yang, Yazheng, et al.
Published: (2024)

GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory
by: Wu, Haoze, et al.
Published: (2024)

Emergent Causal-Geometric Dynamics Across Depth in Large Language Models
by: Haim, Shahar, et al.
Published: (2026)

Emergent Abilities in Large Language Models: A Survey
by: Berti, Leonardo, et al.
Published: (2025)

HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
by: Zhao, Hao, et al.
Published: (2024)

Unlock the Correlation between Supervised Fine-Tuning and Reinforcement Learning in Training Code Large Language Models
by: Chen, Jie, et al.
Published: (2024)

Understanding Emergent Abilities of Language Models from the Loss Perspective
by: Du, Zhengxiao, et al.
Published: (2024)

Modular Machine Learning: An Indispensable Path towards New-Generation Large Language Models
by: Wang, Xin, et al.
Published: (2025)

ROPO: Robust Preference Optimization for Large Language Models
by: Liang, Xize, et al.
Published: (2024)

In-Training Defenses against Emergent Misalignment in Language Models
by: Kaczér, David, et al.
Published: (2025)

SPaCe: Unlocking Sample-Efficient Large Language Models Training With Self-Pace Curriculum Learning
by: Do, Dai, et al.
Published: (2025)

Uncovering Emergent Physics Representations Learned In-Context by Large Language Models
by: Song, Yeongwoo, et al.
Published: (2025)

Machine Bullshit: Characterizing the Emergent Disregard for Truth in Large Language Models
by: Liang, Kaiqu, et al.
Published: (2025)

Preserving Diversity in Supervised Fine-Tuning of Large Language Models
by: Li, Ziniu, et al.
Published: (2024)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
by: Fang, Zihan, et al.
Published: (2024)

Knowledge Fusion of Large Language Models Via Modular SkillPacks
by: Du, Guodong, et al.
Published: (2025)

LMEraser: Large Model Unlearning through Adaptive Prompt Tuning
by: Xu, Jie, et al.
Published: (2024)

A Closer Look into Mixture-of-Experts in Large Language Models
by: Lo, Ka Man, et al.
Published: (2024)

Event-CausNet: Unlocking Causal Knowledge from Text with Large Language Models for Reliable Spatio-Temporal Forecasting
by: Niu, Luyao, et al.
Published: (2025)

SwiftPrune: Hessian-Free Weight Pruning for Large Language Models
by: Kang, Yuhan, et al.
Published: (2025)

Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training
by: Xu, Jie, et al.
Published: (2025)

SIGMA: Refining Large Language Model Reasoning via Sibling-Guided Monte Carlo Augmentation
by: Ren, Yanwei, et al.
Published: (2025)

EpiLLM: Unlocking the Potential of Large Language Models in Epidemic Forecasting
by: Gong, Chenghua, et al.
Published: (2025)

Model Organisms for Emergent Misalignment
by: Turner, Edward, et al.
Published: (2025)

Over-Searching in Search-Augmented Large Language Models
by: Xie, Roy, et al.
Published: (2026)

Emergent Semantic Role Understanding in Language Models
by: Griffiths, Carla, et al.
Published: (2026)

Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecasting
by: Liu, Zhining, et al.
Published: (2025)

Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Models
by: Guo, Yiran, et al.
Published: (2025)

Unlocking Memorization in Large Language Models with Dynamic Soft Prompting
by: Wang, Zhepeng, et al.
Published: (2024)

Reward Guidance for Reinforcement Learning Tasks Based on Large Language Models: The LMGT Framework
by: Deng, Yongxin, et al.
Published: (2024)

Composition of Experts: A Modular Compound AI System Leveraging Large Language Models
by: Jain, Swayambhoo, et al.
Published: (2024)

Optimizing Prompts for Large Language Models: A Causal Approach
by: Chen, Wei, et al.
Published: (2026)

Distributed Interpretability and Control for Large Language Models
by: Desai, Dev Arpan, et al.
Published: (2026)

Efficient Low Rank Attention for Long-Context Inference in Large Language Models
by: Li, Tenghui, et al.
Published: (2025)

Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling
by: Huang, Zeyu, et al.
Published: (2025)

Beyond Frequency: The Role of Redundancy in Large Language Model Memorization
by: Zhang, Jie, et al.
Published: (2025)

A Survey of Large Language Models for Graphs
by: Ren, Xubin, et al.
Published: (2024)

Bridging Visualization and Optimization: Multimodal Large Language Models on Graph-Structured Combinatorial Optimization
by: Zhao, Jie, et al.
Published: (2025)

SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Models
by: Chen, Yibin, et al.
Published: (2024)