Cover Image

Towards Better Code Understanding in Decoder-Only Models with Contrastive Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lin, Jiayi, Wang, Yanlin, Yang, Yibiao, Zhang, Lei, Xie, Yutao
Format:	Preprint
Published:	2024
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scaling Laws Behind Code Understanding Model
by: Lin, Jiayi, et al.
Published: (2024)

Towards Better Correctness and Efficiency in Code Generation
by: Feng, Yunlong, et al.
Published: (2025)

DSTC: Direct Preference Learning with Only Self-Generated Tests and Code to Improve Code LMs
by: Liu, Zhihan, et al.
Published: (2024)

Towards an Understanding of Context Utilization in Code Intelligence
by: Wang, Yanlin, et al.
Published: (2025)

Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learning
by: Jiang, Nan, et al.
Published: (2023)

CodeSSM: Towards State Space Models for Code Understanding
by: Verma, Shweta, et al.
Published: (2025)

$\mathbb{USCD}$: Improving Code Generation of LLMs by Uncertainty-Aware Selective Contrastive Decoding
by: Wang, Shuai, et al.
Published: (2024)

SPENCER: Self-Adaptive Model Distillation for Efficient Code Retrieval
by: Gu, Wenchao, et al.
Published: (2025)

Empowering AI to Generate Better AI Code: Guided Generation of Deep Learning Projects with LLMs
by: Xie, Chen, et al.
Published: (2025)

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking
by: Wang, Zichong, et al.
Published: (2023)

Improving Code Search with Hard Negative Sampling Based on Fine-tuning
by: Dong, Hande, et al.
Published: (2023)

SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Models
by: Xu, Jingxuan, et al.
Published: (2025)

GenCode: A Generic Data Augmentation Framework for Boosting Deep Learning-Based Code Understanding
by: Dong, Zeming, et al.
Published: (2024)

Once4All: Skeleton-Guided SMT Solver Fuzzing with LLM-Synthesized Generators
by: Sun, Maolin, et al.
Published: (2025)

WebCompass: Towards Multimodal Web Coding Evaluation for Code Language Models
by: Lei, Xinping, et al.
Published: (2026)

Beyond Functional Correctness: Investigating Coding Style Inconsistencies in Large Language Models
by: Wang, Yanlin, et al.
Published: (2024)

TransformCode: A Contrastive Learning Framework for Code Embedding via Subtree Transformation
by: Xian, Zixiang, et al.
Published: (2023)

Autoregressive, Yet Revisable: In Decoding Revision for Secure Code Generation
by: Yang, Chengran, et al.
Published: (2026)

Flow2Code: Evaluating Large Language Models for Flowchart-based Code Generation Capability
by: He, Mengliang, et al.
Published: (2025)

Generating High-Quality Datasets for Code Editing via Open-Source Language Models
by: Zhang, Zekai, et al.
Published: (2025)

Repair-R1: Better Test Before Repair
by: Hu, Haichuan, et al.
Published: (2025)

KADEL: Knowledge-Aware Denoising Learning for Commit Message Generation
by: Tao, Wei, et al.
Published: (2024)

An Empirical Study of Knowledge Distillation for Code Understanding Tasks
by: Wang, Ruiqi, et al.
Published: (2025)

Fine-Tuning Code Language Models to Detect Cross-Language Bugs
by: Li, Zengyang, et al.
Published: (2025)

CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking
by: Su, Zian, et al.
Published: (2024)

Understanding Defects in Generated Codes by Language Models
by: Esfahani, Ali Mohammadi, et al.
Published: (2024)

Repository Structure-Aware Training Makes SLMs Better Issue Resolver
by: Ma, Zexiong, et al.
Published: (2024)

LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigation
by: Zhang, Ziyao, et al.
Published: (2024)

Klear-CodeTest: Scalable Test Case Generation for Code Reinforcement Learning
by: Fu, Jia, et al.
Published: (2025)

AlignCoder: Aligning Retrieval with Target Intent for Repository-Level Code Completion
by: Jiang, Tianyue, et al.
Published: (2026)

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code
by: He, Kaifeng, et al.
Published: (2026)

Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities
by: Ma, Wei, et al.
Published: (2022)

RustEvo^2: An Evolving Benchmark for API Evolution in LLM-based Rust Code Generation
by: Liang, Linxi, et al.
Published: (2025)

Integrating Various Software Artifacts for Better LLM-based Bug Localization and Program Repair
by: Feng, Qiong, et al.
Published: (2024)

Do Code LLMs Understand Design Patterns?
by: Pan, Zhenyu, et al.
Published: (2025)

Toward Executable Repository-Level Code Generation via Environment Alignment
by: Pan, Ruwei, et al.
Published: (2026)

Weakly Supervised Vulnerability Localization via Multiple Instance Learning
by: Gu, Wenchao, et al.
Published: (2025)

Less is More: Towards Green Code Large Language Models via Unified Structural Pruning
by: Yang, Guang, et al.
Published: (2024)

FastCode: Fast and Cost-Efficient Code Understanding and Reasoning
by: Li, Zhonghang, et al.
Published: (2026)

An Empirical Study on Capability of Large Language Models in Understanding Code Semantics
by: Nguyen, Thu-Trang, et al.
Published: (2024)