:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Wang, Shaobo, Chen, Guo, Wang, Ziyue, Tang, Zhengyang, Liu, Qingyang, Ren, Xingzhang, Liu, Dayiheng, Zhang, Linfeng
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	https://arxiv.org/abs/2605.28020
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Empirical Study of Parameter Efficient Fine-tuning on Vision-Language Pre-train Model
by: Tian, Yuxin, et al.
Published: (2024)

OPUS: Towards Efficient and Principled Data Selection in Large Language Model Pre-training in Every Iteration
by: Wang, Shaobo, et al.
Published: (2026)

RefineX: Learning to Refine Pre-training Data at Scale from Expert-Guided Programs
by: Bi, Baolong, et al.
Published: (2025)

Reasoning Like an Economist: Post-Training on Economic Problems Induces Strategic Generalization in LLMs
by: Zhou, Yufa, et al.
Published: (2025)

Winning the Pruning Gamble: A Unified Approach to Joint Sample and Token Pruning for Efficient Supervised Fine-Tuning
by: Wang, Shaobo, et al.
Published: (2025)

DISA: Offline Importance Sampling for Distribution-Matching LLM-RL
by: Wang, Shaobo, et al.
Published: (2026)

Rethinking LLM Evaluation: Can We Evaluate LLMs with 200x Less Data?
by: Wang, Shaobo, et al.
Published: (2025)

On Predicting the Post-training Potential of Pre-trained LLMs
by: Li, Xiaoyuan, et al.
Published: (2026)

MUON+: Towards More Effective Muon via One Additional Normalization Step for LLM Pre-training
by: Zhang, Ruijie, et al.
Published: (2026)

CALM Before the STORM: Unlocking Native Reasoning for Optimization Modeling
by: Tang, Zhengyang, et al.
Published: (2025)

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training
by: Tang, Shengkun, et al.
Published: (2026)

MutDet: Mutually Optimizing Pre-training for Remote Sensing Object Detection
by: Huang, Ziyue, et al.
Published: (2024)

DataMan: Data Manager for Pre-training Large Language Models
by: Peng, Ru, et al.
Published: (2025)

Generic Knowledge Boosted Pre-training For Remote Sensing Images
by: Huang, Ziyue, et al.
Published: (2024)

Unlocking Proactivity in Task-Oriented Dialogue
by: Zhang, Hongbin, et al.
Published: (2026)

VibeContract: The Missing Quality Assurance Piece in Vibe Coding
by: Wang, Song
Published: (2026)

Assessing Learning: The Missing Piece in Instruction?
by: Harada, Violet H., et al.
Published: (2006)

The Missing Piece: A Case for Pre-Training in 3D Medical Object Detection
by: Eckstein, Katharina, et al.
Published: (2025)

LaX: Boosting Low-Rank Training of Foundation Models via Latent Crossing
by: Zhang, Ruijie, et al.
Published: (2025)

Bridging Visual Representation and Reinforcement Learning from Verifiable Rewards in Large Vision-Language Models
by: Han, Yuhang, et al.
Published: (2026)

TEON: Tensorized Orthonormalization Beyond Layer-Wise Muon for Large Language Model Pre-Training
by: Zhang, Ruijie, et al.
Published: (2026)

Unlock Anionic Behavior of Calcium Through Pressure Engineering
by: Lv, Yang, et al.
Published: (2025)

Task-Agnostic Pre-training and Task-Guided Fine-tuning for Versatile Diffusion Planner
by: Fan, Chenyou, et al.
Published: (2024)

Deep Learning Unlocks Behavioral Prediction and Neurobehavioral Decoding
by: Tianzhe Han, et al.
Published: (2026)

Pre-training by Predicting Program Dependencies for Vulnerability Analysis Tasks
by: Liu, Zhongxin, et al.
Published: (2024)

Legal Fact Prediction: The Missing Piece in Legal Judgment Prediction
by: Liu, Junkai, et al.
Published: (2024)

On the Transformations across Reward Model, Parameter Update, and In-Context Prompt
by: Cai, Deng, et al.
Published: (2024)

CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
by: Liu, Ziyue, et al.
Published: (2025)

Disentangling the Prosody and Semantic Information with Pre-trained Model for In-Context Learning based Zero-Shot Voice Conversion
by: Chen, Zhengyang, et al.
Published: (2024)

GLID: Pre-training a Generalist Encoder-Decoder Vision Model
by: Liu, Jihao, et al.
Published: (2024)

SpeCa: Accelerating Diffusion Transformers with Speculative Feature Caching
by: Liu, Jiacheng, et al.
Published: (2025)

Task-Oriented Pre-Training for Drivable Area Detection
by: Ma, Fulong, et al.
Published: (2024)

Large EEG-U-Transformer for Time-Step Level Detection Without Pre-Training
by: Wu, Kerui, et al.
Published: (2025)

Missing Data Imputation by Reducing Mutual Information with Rectified Flows
by: Yu, Jiahao, et al.
Published: (2025)

Generating Speakers by Prompting Listener Impressions for Pre-trained Multi-Speaker Text-to-Speech Systems
by: Chen, Zhengyang, et al.
Published: (2024)

Pre-training Everywhere: Parameter-Efficient Fine-Tuning for Medical Image Analysis via Target Parameter Pre-training
by: Lei, Xingliang, et al.
Published: (2024)

Delayed Bottlenecking: Alleviating Forgetting in Pre-trained Graph Neural Networks
by: Zhao, Zhe, et al.
Published: (2024)

Minotaur: A SIMD-Oriented Synthesizing Superoptimizer
by: Liu, Zhengyang, et al.
Published: (2023)

Space Alignment Matters: The Missing Piece for Inducing Neural Collapse in Long-Tailed Learning
by: Wang, Jinping, et al.
Published: (2025)

Learning Top-k Subtask Planning Tree based on Discriminative Representation Pre-training for Decision Making
by: Ruan, Jingqing, et al.
Published: (2023)