Copertina

ADEPT: Continual Pretraining via Adaptive Expansion and Dynamic Decoupled Tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Jinyang, Fang, Yue, Ding, Hongxin, Liao, Weibin, Ye, Muyang, Chu, Xu, Zhao, Junfeng, Wang, Yasha
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

3DS: Medical Domain Adaptation of LLMs via Decomposed Difficulty-based Data Selection
di: Ding, Hongxin, et al.
Pubblicazione: (2024)

GraphWalker: Graph-Guided In-Context Learning for Clinical Reasoning on Electronic Health Records
di: Fang, Yue, et al.
Pubblicazione: (2026)

DFAMS: Dynamic-flow guided Federated Alignment based Multi-prototype Search
di: Yang, Zhibang, et al.
Pubblicazione: (2025)

ProMed: Shapley Information Gain Guided Reinforcement Learning for Proactive Medical LLMs
di: Ding, Hongxin, et al.
Pubblicazione: (2025)

Bridging Global Intent with Local Details: A Hierarchical Representation Approach for Semantic Validation in Text-to-SQL
di: Qiu, Rihong, et al.
Pubblicazione: (2025)

TPO: Aligning Large Language Models with Multi-branch & Multi-step Preference Trees
di: Liao, Weibin, et al.
Pubblicazione: (2024)

SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Prediction
di: Yu, Zhihao, et al.
Pubblicazione: (2024)

IntelliCare: Improving Healthcare Analysis with Variance-Controlled Patient-Level Knowledge from Large Language Models
di: Yu, Zhihao, et al.
Pubblicazione: (2024)

Learnable Prompt as Pseudo-Imputation: Rethinking the Necessity of Traditional EHR Data Imputation in Downstream Clinical Prediction
di: Liao, Weibin, et al.
Pubblicazione: (2024)

Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention Guidance
di: Fang, Yue, et al.
Pubblicazione: (2025)

DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace Editing
di: Ma, Xinyu, et al.
Pubblicazione: (2025)

Infinite-Horizon Graph Filters: Leveraging Power Series to Enhance Sparse Information Aggregation
di: Zhang, Ruizhe, et al.
Pubblicazione: (2024)

Parenting: Optimizing Knowledge Selection of Retrieval-Augmented Language Models with Parameter Decoupling and Tailored Tuning
di: Xu, Yongxin, et al.
Pubblicazione: (2024)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
di: Ma, Xinyu, et al.
Pubblicazione: (2024)

HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responses
di: Jiang, Xinke, et al.
Pubblicazione: (2023)

ADEPT: Hierarchical Bayes Approach to Personalized Federated Unsupervised Learning
di: Ozkara, Kaan, et al.
Pubblicazione: (2024)

Self-Controlled Dynamic Expansion Model for Continual Learning
di: Wu, Runqing, et al.
Pubblicazione: (2025)

RAGraph: A General Retrieval-Augmented Graph Learning Framework
di: Jiang, Xinke, et al.
Pubblicazione: (2024)

ADEPT: Adaptive Dynamic Early-Exit Process for Transformers
di: Yoo, Sangmin, et al.
Pubblicazione: (2026)

Defending Membership Inference Attacks via Privacy-aware Sparsity Tuning
di: Hu, Qiang, et al.
Pubblicazione: (2024)

Adaptive Pruning of Pretrained Transformer via Differential Inclusions
di: Ding, Yizhuo, et al.
Pubblicazione: (2025)

Pretrain Value, Not Reward: Decoupled Value Policy Optimization
di: Huang, Chenghua, et al.
Pubblicazione: (2025)

APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
di: Zhao, Bowen, et al.
Pubblicazione: (2024)

LearNAT: Learning NL2SQL with AST-guided Task Decomposition for Large Language Models
di: Liao, Weibin, et al.
Pubblicazione: (2025)

ADEPT: Adaptive Diffusion Environment for Policy Transfer Sim-to-Real
di: Yu, Youwei, et al.
Pubblicazione: (2025)

DRAFT: Task Decoupled Latent Reasoning for Agent Safety
di: Wang, Lin, et al.
Pubblicazione: (2026)

Fine-tuning can Help Detect Pretraining Data from Large Language Models
di: Zhang, Hengxiang, et al.
Pubblicazione: (2024)

Imputation with Inter-Series Information from Prototypes for Irregular Sampled Time Series
di: Yu, Zhihao, et al.
Pubblicazione: (2024)

LACE: Loss-Adaptive Capacity Expansion for Continual Learning
di: Tathe, Shivnath
Pubblicazione: (2026)

ProtoAda: Prototype-Guided Adaptive Adapter Expansion and Geometric Consolidation for Multimodal Continual Instruction Tuning
di: Shi, Yu-Cheng, et al.
Pubblicazione: (2026)

Output Scaling: YingLong-Delayed Chain of Thought in a Large Pretrained Time Series Forecasting Model
di: Wang, Xue, et al.
Pubblicazione: (2025)

Mitigating Catastrophic Forgetting with Adaptive Transformer Block Expansion in Federated Fine-Tuning
di: Huo, Yujia, et al.
Pubblicazione: (2025)

ADEPT: RL-Aligned Agentic Decoding of Emotion via Evidence Probing Tools -- From Consensus Learning to Ambiguity-Driven Emotion Reasoning
di: Sun, Esther, et al.
Pubblicazione: (2026)

TapWeight: Reweighting Pretraining Objectives for Task-Adaptive Pretraining
di: Zhang, Ruiyi, et al.
Pubblicazione: (2024)

HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Model
di: Guo, Haiyang, et al.
Pubblicazione: (2025)

DA-PFL: Dynamic Affinity Aggregation for Personalized Federated Learning
di: Yang, Xu, et al.
Pubblicazione: (2024)

Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models
di: Wang, Shuoyuan, et al.
Pubblicazione: (2024)

Large-scale Dataset Pruning with Dynamic Uncertainty
di: He, Muyang, et al.
Pubblicazione: (2023)

Semi-Supervised Mixture Models under the Concept of Missing at Radom with Margin Confidence and Aranda Ordaz Function
di: Liao, Jinyang, et al.
Pubblicazione: (2026)

SecP-Tuning: Efficient Privacy-Preserving Prompt Tuning for Large Language Models via MPC
di: Luo, Jinglong, et al.
Pubblicazione: (2025)