Cover Image

Smaller but Better: Self-Paced Knowledge Distillation for Lightweight yet Effective LCMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Yujia, Ye, Yang, Li, Zhongqi, Ma, Yuchi, Gao, Cuiyun
Format:	Preprint
Published:	2024
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Mitigating API Hallucination in Code Generated by LLMs with Hierarchical Dependency Aware
by: Chen, Yujia, et al.
Published: (2025)

Schedule-and-Calibrate: Utility-Guided Multi-Task Reinforcement Learning for Code LLMs
by: Chen, Yujia, et al.
Published: (2026)

RAG or Fine-tuning? A Comparative Study on LCMs-based Code Completion in Industry
by: Wang, Chaozheng, et al.
Published: (2025)

An Empirical Study of Knowledge Distillation for Code Understanding Tasks
by: Wang, Ruiqi, et al.
Published: (2025)

Bridge and Hint: Extending Pre-trained Language Models for Long-Range Code
by: Chen, Yujia, et al.
Published: (2024)

LLM-Based Test Case Generation in DBMS through Monte Carlo Tree Search
by: Chen, Yujia, et al.
Published: (2026)

APIGen: Generative API Method Recommendation
by: Chen, Yujia, et al.
Published: (2024)

Automated Prompt Generation for Code Intelligence: An Empirical study and Experience in WeChat
by: Ji, Kexing, et al.
Published: (2025)

FastFixer: An Efficient and Effective Approach for Repairing Programming Assignments
by: Liu, Fang, et al.
Published: (2024)

SPENCER: Self-Adaptive Model Distillation for Efficient Code Retrieval
by: Gu, Wenchao, et al.
Published: (2025)

SEER: Enhancing Chain-of-Thought Code Generation through Self-Exploring Deep Reasoning
by: Gao, Shuzheng, et al.
Published: (2025)

On the Effectiveness of Context Compression for Repository-Level Tasks: An Empirical Investigation
by: Feng, Jia, et al.
Published: (2026)

Leveraging Self-Paced Learning for Software Vulnerability Detection
by: Cheng, Zeru, et al.
Published: (2025)

Learning in the Wild: Towards Leveraging Unlabeled Data for Effectively Tuning Pre-trained Code Models
by: Gao, Shuzheng, et al.
Published: (2024)

Beyond Functional Correctness: Exploring Hallucinations in LLM-Generated Code
by: Liu, Fang, et al.
Published: (2024)

When Model Editing Meets Service Evolution: A Knowledge-Update Perspective for Service Recommendation
by: Fan, Guodong, et al.
Published: (2026)

Benchmarking Multimodal LLMs on Code Generation for Complex Interactive Webpages
by: Wu, Fan, et al.
Published: (2026)

Cascaded Code Editing: Large-Small Model Collaboration for Effective and Efficient Code Editing
by: Wang, Chaozheng, et al.
Published: (2026)

Deep Learning Based Code Generation Methods: Literature Review
by: Yang, Zezhou, et al.
Published: (2023)

Enhancing Code Generation Performance of Smaller Models by Distilling the Reasoning Ability of LLMs
by: Sun, Zhihong, et al.
Published: (2024)

ReposVul: A Repository-Level High-Quality Vulnerability Dataset
by: Wang, Xinchen, et al.
Published: (2024)

VulEval: Towards Repository-Level Evaluation of Software Vulnerability Detection
by: Wen, Xin-Cheng, et al.
Published: (2024)

SR-Eval: Evaluating LLMs on Code Generation under Stepwise Requirement Refinement
by: Zhan, Zexun, et al.
Published: (2025)

Distilled Lifelong Self-Adaptation for Configurable Systems
by: Ye, Yulong, et al.
Published: (2025)

Leveraging Large Vision Language Model For Better Automatic Web GUI Testing
by: Wang, Siyi, et al.
Published: (2024)

Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Data
by: Wen, Xin-Cheng, et al.
Published: (2025)

What to Retrieve for Effective Retrieval-Augmented Code Generation? An Empirical Study and Beyond
by: Gu, Wenchao, et al.
Published: (2025)

DistillSeq: A Framework for Safety Alignment Testing in Large Language Models using Knowledge Distillation
by: Yang, Mingke, et al.
Published: (2024)

An Empirical Study of Retrieval-Augmented Code Generation: Challenges and Opportunities
by: Yang, Zezhou, et al.
Published: (2025)

SPVR: syntax-to-prompt vulnerability repair based on large language models
by: Wang, Ruoke, et al.
Published: (2024)

The Current Challenges of Software Engineering in the Era of Large Language Models
by: Gao, Cuiyun, et al.
Published: (2024)

Vul-R2: A Reasoning LLM for Automated Vulnerability Repair
by: Wen, Xin-Cheng, et al.
Published: (2025)

When Shared Worlds Break: Demystifying Defects in Multi-User Extended Reality Software Systems
by: Li, Shuqing, et al.
Published: (2025)

Yet Even Less Is Even Better For Agentic, Reasoning, and Coding LLMs
by: CodeArts Model Team, et al.
Published: (2026)

CommitDistill: A Lightweight Knowledge-Centric Memory Layer for Software Repositories
by: Chukkapalli, Divya, et al.
Published: (2026)

A Deep Dive into Retrieval-Augmented Generation for Code Completion: Experience on WeChat
by: Yang, Zezhou, et al.
Published: (2025)

A Roadmap on Modern Code Review: Challenges and Opportunities
by: Yang, Zezhou, et al.
Published: (2024)

Modularization is Better: Effective Code Generation with Modular Prompting
by: Pan, Ruwei, et al.
Published: (2025)

Uncovering Weaknesses in Neural Code Generation
by: Lian, Xiaoli, et al.
Published: (2024)

AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation
by: Luo, Ziyang, et al.
Published: (2024)