Cover Image

On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Code

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Weyssow, Martin, Zhou, Xin, Kim, Kisub, Lo, David, Sahraoui, Houari
Format:	Preprint
Published:	2023
Subjects:	Software Engineering Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models
by: Weyssow, Martin, et al.
Published: (2023)

CodeUltraFeedback: An LLM-as-a-Judge Dataset for Aligning Large Language Models to Coding Preferences
by: Weyssow, Martin, et al.
Published: (2024)

Harnessing Large Language Models for Curated Code Reviews
by: Sghaier, Oussama Ben, et al.
Published: (2025)

Leveraging Reward Models for Guiding Code Review Comment Generation
by: Sghaier, Oussama Ben, et al.
Published: (2025)

Improving the Learning of Code Review Successive Tasks with Cross-Task Knowledge Distillation
by: Sghaier, Oussama Ben, et al.
Published: (2024)

Combining Large Language Models with Static Analyzers for Code Review Generation
by: Jaoua, Imen, et al.
Published: (2025)

Modeling Sampling Workflows for Code Repositories
by: Lefeuvre, Romain, et al.
Published: (2026)

An LLM-as-Judge Metric for Bridging the Gap with Human Evaluation in SE Tasks
by: Zhou, Xin, et al.
Published: (2025)

Multi-LLM Collaboration + Data-Centric Innovation = 2x Better Vulnerability Repair
by: Zhou, Xin, et al.
Published: (2024)

Artificial or Just Artful? Do LLMs Bend the Rules in Programming?
by: Sghaier, Oussama Ben, et al.
Published: (2025)

Automation in Model-Driven Engineering: A look back, and ahead
by: Burgueño, Lola, et al.
Published: (2024)

On the Utility of Domain Modeling Assistance with Large Language Models
by: Chaaben, Meriem Ben, et al.
Published: (2024)

iCodeReviewer: Improving Secure Code Review with Mixture of Prompts
by: Peng, Yun, et al.
Published: (2025)

LEANCODE: Understanding Models Better for Code Simplification of Pre-trained Large Language Models
by: Wang, Yan, et al.
Published: (2025)

Representation Learning for Stack Overflow Posts: How Far are We?
by: He, Junda, et al.
Published: (2023)

Hotfixing Large Language Models for Code
by: Yang, Zhou, et al.
Published: (2024)

A Functional Software Reference Architecture for LLM-Integrated Systems
by: Bucaioni, Alessio, et al.
Published: (2025)

Artificial Intelligence for Software Architecture: Literature Review and the Road Ahead
by: Bucaioni, Alessio, et al.
Published: (2025)

Curiosity-Driven Testing for Sequential Decision-Making Process
by: He, Junda, et al.
Published: (2025)

MONO2REST: Identifying and Exposing Microservices: a Reusable RESTification Approach
by: Lecrivain, Matthéo, et al.
Published: (2025)

Bridging Expert Knowledge with Deep Learning Techniques for Just-In-Time Defect Prediction
by: Zhou, Xin, et al.
Published: (2024)

Ecosystem of Large Language Models for Code
by: Yang, Zhou, et al.
Published: (2024)

PatchZero: Zero-Shot Automatic Patch Correctness Assessment
by: Zhou, Xin, et al.
Published: (2023)

Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models
by: Feng, Chengzhe, et al.
Published: (2024)

Learning in the Wild: Towards Leveraging Unlabeled Data for Effectively Tuning Pre-trained Code Models
by: Gao, Shuzheng, et al.
Published: (2024)

Code Membership Inference for Detecting Unauthorized Data Use in Code Pre-trained Language Models
by: Zhang, Sheng, et al.
Published: (2023)

LEGION: Harnessing Pre-trained Language Models for GitHub Topic Recommendations with Distribution-Balance Loss
by: Dang, Yen-Trang, et al.
Published: (2024)

Large Language Model for Vulnerability Detection: Emerging Results and Future Directions
by: Zhou, Xin, et al.
Published: (2024)

Bridge and Hint: Extending Pre-trained Language Models for Long-Range Code
by: Chen, Yujia, et al.
Published: (2024)

CoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Models
by: Yu, Hao, et al.
Published: (2023)

Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large Language Models
by: Wang, Yan, et al.
Published: (2024)

ACECode: A Reinforcement Learning Framework for Aligning Code Efficiency and Correctness in Code Language Models
by: Yang, Chengran, et al.
Published: (2024)

Benchmarking Large Language Models for Multi-Language Software Vulnerability Detection
by: Zhang, Ting, et al.
Published: (2025)

Greening Large Language Models of Code
by: Shi, Jieke, et al.
Published: (2023)

On the Effect of Token Merging on Pre-trained Models for Code
by: Saad, Mootez, et al.
Published: (2025)

Improving the Ability of Pre-trained Language Model by Imparting Large Language Model's Experience
by: Yin, Xin, et al.
Published: (2024)

PTM4Tag+: Tag Recommendation of Stack Overflow Posts with Pre-trained Models
by: He, Junda, et al.
Published: (2024)

Redundancy and Concept Analysis for Code-trained Language Models
by: Sharma, Arushi, et al.
Published: (2023)

Out of Distribution, Out of Luck: How Well Can LLMs Trained on Vulnerability Datasets Detect Top 25 CWE Weaknesses?
by: Li, Yikun, et al.
Published: (2025)

CodeIF: Benchmarking the Instruction-Following Capabilities of Large Language Models for Code Generation
by: Yan, Kaiwen, et al.
Published: (2025)