Copertina

InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Yifan, Liu, Yafei, Shi, Chufan, Li, Haoling, Chen, Chen, Lu, Haonan, Yang, Yujiu
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LiFi: Lightweight Controlled Text Generation with Fine-Grained Control Codes
di: Shi, Chufan, et al.
Pubblicazione: (2024)

Hint-enhanced In-Context Learning wakes Large Language Models up for knowledge-intensive tasks
di: Wang, Yifan, et al.
Pubblicazione: (2023)

Fine-tuning Large Language Models with Sequential Instructions
di: Hu, Hanxu, et al.
Pubblicazione: (2024)

LLM2: Let Large Language Models Harness System 2 Reasoning
di: Yang, Cheng, et al.
Pubblicazione: (2024)

Demystifying Instruction Mixing for Fine-tuning Large Language Models
di: Wang, Renxi, et al.
Pubblicazione: (2023)

Enhancing Complex Instruction Following for Large Language Models with Mixture-of-Contexts Fine-tuning
di: Lu, Yuheng, et al.
Pubblicazione: (2025)

HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing
di: Chen, Jing, et al.
Pubblicazione: (2024)

A Thorough Examination of Decoding Methods in the Era of LLMs
di: Shi, Chufan, et al.
Pubblicazione: (2024)

RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions
di: Zhang, Yuansen, et al.
Pubblicazione: (2024)

Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agents
di: Wang, Renxi, et al.
Pubblicazione: (2024)

Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoning
di: Zhang, Xinlu, et al.
Pubblicazione: (2024)

An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
di: Luo, Yun, et al.
Pubblicazione: (2023)

InsBank: Evolving Instruction Subset for Ongoing Alignment
di: Shi, Jiayi, et al.
Pubblicazione: (2025)

AlpaCare:Instruction-tuned Large Language Models for Medical Application
di: Zhang, Xinlu, et al.
Pubblicazione: (2023)

Semi-supervised Fine-tuning for Large Language Models
di: Luo, Junyu, et al.
Pubblicazione: (2024)

InstructAV: Instruction Fine-tuning Large Language Models for Authorship Verification
di: Hu, Yujia, et al.
Pubblicazione: (2024)

Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
di: Li, Haoling, et al.
Pubblicazione: (2024)

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models
di: Lyu, Yougang, et al.
Pubblicazione: (2024)

InsTALL: Context-aware Instructional Task Assistance with Multi-modal Large Language Models
di: Nguyen, Pha, et al.
Pubblicazione: (2025)

MLLM-CL: Continual Learning for Multimodal Large Language Models
di: Zhao, Hongbo, et al.
Pubblicazione: (2025)

Data-efficient LLM Fine-tuning for Code Generation
di: Lv, Weijie, et al.
Pubblicazione: (2025)

ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models
di: Zhang, Yuxiang, et al.
Pubblicazione: (2024)

MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models
di: Ai, Mengting, et al.
Pubblicazione: (2023)

Fine-tuning a Large Language Model for Automating Computational Fluid Dynamics Simulations
di: Dong, Zhehao, et al.
Pubblicazione: (2025)

Learning or Self-aligning? Rethinking Instruction Fine-tuning
di: Ren, Mengjie, et al.
Pubblicazione: (2024)

InsQABench: Benchmarking Chinese Insurance Domain Question Answering with Large Language Models
di: Ding, Jing, et al.
Pubblicazione: (2025)

Fundamental Safety-Capability Trade-offs in Fine-tuning Large Language Models
di: Chen, Pin-Yu, et al.
Pubblicazione: (2025)

Sparse Matrix in Large Language Model Fine-tuning
di: He, Haoze, et al.
Pubblicazione: (2024)

GenX: Mastering Code and Test Generation with Execution Feedback
di: Wang, Nan, et al.
Pubblicazione: (2024)

Full Parameter Fine-tuning for Large Language Models with Limited Resources
di: Lv, Kai, et al.
Pubblicazione: (2023)

Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning
di: Zhao, Hang, et al.
Pubblicazione: (2024)

RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning
di: Chen, Yukun, et al.
Pubblicazione: (2026)

AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Models
di: Guggilla, Chinnappa, et al.
Pubblicazione: (2025)

How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition
di: Dong, Guanting, et al.
Pubblicazione: (2023)

A Study of Backdoors in Instruction Fine-tuned Language Models
di: Raghuram, Jayaram, et al.
Pubblicazione: (2024)

A Survey on the Honesty of Large Language Models
di: Li, Siheng, et al.
Pubblicazione: (2024)

When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models
di: Zheng, Yingming, et al.
Pubblicazione: (2025)

Chain of History: Learning and Forecasting with LLMs for Temporal Knowledge Graph Completion
di: Luo, Ruilin, et al.
Pubblicazione: (2024)

Obliviate: Neutralizing Task-agnostic Backdoors within the Parameter-efficient Fine-tuning Paradigm
di: Kim, Jaehan, et al.
Pubblicazione: (2024)

AlignSum: Data Pyramid Hierarchical Fine-tuning for Aligning with Human Summarization Preference
di: Han, Yang, et al.
Pubblicazione: (2024)