On The Impact of Merge Request Deviations on Code Review Practices

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kansab, Samah, Bordeleau, Francis, Tizghadam, Ali
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909645733363712
author Kansab, Samah
Bordeleau, Francis
Tizghadam, Ali
author_facet Kansab, Samah
Bordeleau, Francis
Tizghadam, Ali
contents Code review is a key practice in software engineering, ensuring quality and collaboration. However, industrial Merge Request (MR) workflows often deviate from standardized review processes, with many MRs serving non-review purposes (e.g., drafts, rebases, or dependency updates). We term these cases deviations and hypothesize that ignoring them biases analytics and undermines ML models for review analysis. We identify seven deviation categories, occurring in 37.02% of MRs, and propose a few-shot learning detection method (91% accuracy). By excluding deviations, ML models predicting review completion time improve performance in 53.33% of cases (up to 2.25x) and exhibit significant shifts in feature importance (47% overall, 60% top-*k*). Our contributions include: (1) a taxonomy of MR deviations, (2) an AI-driven detection approach, and (3) empirical evidence of their impact on ML-based review analytics. This work aids practitioners in optimizing review efforts and ensuring reliable insights.
format Preprint
id arxiv_https___arxiv_org_abs_2506_08860
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On The Impact of Merge Request Deviations on Code Review Practices
Kansab, Samah
Bordeleau, Francis
Tizghadam, Ali
Software Engineering
Artificial Intelligence
Machine Learning
Code review is a key practice in software engineering, ensuring quality and collaboration. However, industrial Merge Request (MR) workflows often deviate from standardized review processes, with many MRs serving non-review purposes (e.g., drafts, rebases, or dependency updates). We term these cases deviations and hypothesize that ignoring them biases analytics and undermines ML models for review analysis. We identify seven deviation categories, occurring in 37.02% of MRs, and propose a few-shot learning detection method (91% accuracy). By excluding deviations, ML models predicting review completion time improve performance in 53.33% of cases (up to 2.25x) and exhibit significant shifts in feature importance (47% overall, 60% top-*k*). Our contributions include: (1) a taxonomy of MR deviations, (2) an AI-driven detection approach, and (3) empirical evidence of their impact on ML-based review analytics. This work aids practitioners in optimizing review efforts and ensuring reliable insights.
title On The Impact of Merge Request Deviations on Code Review Practices
topic Software Engineering
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2506.08860