Copertina

Mixture-of-Modules: Reinventing Transformers as Dynamic Assemblies of Modules

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Gong, Zhuocheng, Lv, Ang, Guan, Jian, Yan, Junxi, Wu, Wei, Zhang, Huishuai, Huang, Minlie, Zhao, Dongyan, Yan, Rui
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Latent Preference Coding: Aligning Large Language Models via Discrete Latent Codes
di: Gong, Zhuocheng, et al.
Pubblicazione: (2025)

Shorten After You're Right: Lazy Length Penalties for Reasoning RL
di: Yuan, Danlong, et al.
Pubblicazione: (2025)

Evidence-Enhanced Triplet Generation Framework for Hallucination Alleviation in Generative Question Answering
di: Du, Haowei, et al.
Pubblicazione: (2024)

Graph-Structured Speculative Decoding
di: Gong, Zhuocheng, et al.
Pubblicazione: (2024)

PromptCoT 2.0: Scaling Prompt Synthesis for Large Language Model Reasoning
di: Zhao, Xueliang, et al.
Pubblicazione: (2025)

SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling
di: Zhao, Anhao, et al.
Pubblicazione: (2025)

Efficient Continual Pre-training by Mitigating the Stability Gap
di: Guo, Yiduo, et al.
Pubblicazione: (2024)

Unlocking Reasoning Potential in Large Langauge Models by Scaling Code-form Planning
di: Wen, Jiaxin, et al.
Pubblicazione: (2024)

ReasVQA: Advancing VideoQA with Imperfect Reasoning Process
di: Liang, Jianxin, et al.
Pubblicazione: (2025)

Parallel Decoding via Hidden Transfer for Lossless Large Language Model Acceleration
di: Wu, Pengfei, et al.
Pubblicazione: (2024)

FIRP: Faster LLM inference via future intermediate representation prediction
di: Wu, Pengfei, et al.
Pubblicazione: (2024)

Mixture of In-Context Experts Enhance LLMs' Long Context Awareness
di: Lin, Hongzhan, et al.
Pubblicazione: (2024)

Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
di: Sun, Xiaoxi, et al.
Pubblicazione: (2024)

AMOR: A Recipe for Building Adaptable Modular Knowledge Agents Through Process Feedback
di: Guan, Jian, et al.
Pubblicazione: (2024)

VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format
di: Wang, Yueqian, et al.
Pubblicazione: (2024)

PolarQuant: Leveraging Polar Transformation for Efficient Key Cache Quantization and Decoding Acceleration
di: Wu, Songhao, et al.
Pubblicazione: (2025)

ReMamba: Equip Mamba with Effective Long-Sequence Modeling
di: Yuan, Danlong, et al.
Pubblicazione: (2024)

GeoBuildBench: A Benchmark for Interactive and Executable Geometry Construction from Natural Language
di: Kim, Jinwoong, et al.
Pubblicazione: (2026)

Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillation
di: Cheng, Chuanqi, et al.
Pubblicazione: (2025)

From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis
di: Cheng, Chuanqi, et al.
Pubblicazione: (2024)

Beyond Isolated Facts: Synthesizing Narrative and Grounded Supervision for VideoQA
di: Liang, Jianxin, et al.
Pubblicazione: (2025)

MMDuet2: Enhancing Proactive Interaction of Video MLLMs with Multi-Turn Reinforcement Learning
di: Wang, Yueqian, et al.
Pubblicazione: (2025)

Language Models Hallucinate, but May Excel at Fact Verification
di: Guan, Jian, et al.
Pubblicazione: (2023)

StyleChat: Learning Recitation-Augmented Memory in LLMs for Stylized Dialogue Generation
di: Li, Jinpeng, et al.
Pubblicazione: (2024)

Dynamic Domain Information Modulation Algorithm for Multi-domain Sentiment Analysis
di: Yue, Chunyi, et al.
Pubblicazione: (2025)

Extended Inductive Reasoning for Personalized Preference Inference from Behavioral Signals
di: Li, Jia-Nan, et al.
Pubblicazione: (2025)

Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models
di: Lv, Ang, et al.
Pubblicazione: (2024)

The Climb Carves Wisdom Deeper Than the Summit: On the Noisy Rewards in Learning to Reason
di: Lv, Ang, et al.
Pubblicazione: (2025)

2D-TPE: Two-Dimensional Positional Encoding Enhances Table Understanding for Large Language Models
di: Li, Jia-Nan, et al.
Pubblicazione: (2024)

xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token
di: Cheng, Xin, et al.
Pubblicazione: (2024)

From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignment
di: Li, Jia-Nan, et al.
Pubblicazione: (2025)

Coupling Experts and Routers in Mixture-of-Experts via an Auxiliary Loss
di: Lv, Ang, et al.
Pubblicazione: (2025)

De-Anonymization at Scale via Tournament-Style Attribution
di: Zhang, Lirui, et al.
Pubblicazione: (2026)

AIDBench: A benchmark for evaluating the authorship identification capability of large language models
di: Wen, Zichen, et al.
Pubblicazione: (2024)

Batch-ICL: Effective, Efficient, and Order-Agnostic In-Context Learning
di: Zhang, Kaiyi, et al.
Pubblicazione: (2024)

Internal and External Knowledge Interactive Refinement Framework for Knowledge-Intensive Question Answering
di: Du, Haowei, et al.
Pubblicazione: (2024)

In-Context Learning with Reinforcement Learning for Incomplete Utterance Rewriting
di: Du, Haowei, et al.
Pubblicazione: (2024)

Stick to Facts: Towards Fidelity-oriented Product Description Generation
di: Chan, Zhangming, et al.
Pubblicazione: (2025)

Language Models "Grok" to Copy
di: Lv, Ang, et al.
Pubblicazione: (2024)

Don't Reinvent the Wheel: Efficient Instruction-Following Text Embedding based on Guided Space Transformation
di: Feng, Yingchaojie, et al.
Pubblicazione: (2025)