arXiv cs.AI· Antonio Collante, Samuel Abedu, SayedHassan Khatoonabadi, Ahmad Abdellatif, Ebube Alor, Emad Shihab·· 1 小时前AI 评分50
研究显示 GPT 辅助的 GitHub PR 中位解决时间缩短超 60%
The Impact of Large Language Models (LLMs) on Code Review Process
AI 导读
一项 arXiv 研究分析了 9,254 个 GitHub 项目的 25,473 个 PR，用半自动启发式方法识别 GPT 辅助的 PR 并做统计建模。
正文 · 原文
Abstract:Large language models (LLMs) have recently gained prominence in the field of software development, significantly boosting productivity and simplifying teamwork. Although prior studies have examined task-specific applications, the phase-specific effects of LLM assistance on the efficiency of code review processes remain underexplored. This research investigates the effect of GPT on GitHub pull request (PR) workflows, with a focus on reducing resolution time, optimizing phase-specific performance, and assisting developers. We curated a dataset of 25,473 PRs from 9,254 GitHub projects and identified GPT-assisted PRs using a semi-automated heuristic approach that combines keyword-based detection, regular expression filtering, and manual verification until achieving 95% labeling accuracy. We then applied statistical modeling, including multiple linear regression and Mann-Whitney U test, to evaluate differences between GPT-assisted and non-assisted PRs, both at the overall resolution level and across distinct review phases. Our research has revealed that early adoption of GPT can substantially boost the effectiveness of the PR process, leading to considerable time savings at various stages. Our findings suggest that GPT-assisted PRs reduced median resolution time by more than 60% (9 hours compared to 23 hours for non-assisted PRs). We discovered that utilizing GPT can reduce the review time by 33% and the waiting time before acceptance by 87%. Analyzing a sample dataset of 300 GPT-assisted PRs, we discovered that developers predominantly use GPT for code optimization (60%), bug fixing (26%), and documentation updates (12%). This research sheds light on the impact of the GPT model on the code review process, offering actionable insights for software teams seeking to enhance workflows and promote seamless collaboration.
| Subjects: | Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2508.11034 [cs.SE] |
| (or arXiv:2508.11034v2 [cs.SE] for this version) | |
| https://doi.org/10.48550/arXiv.2508.11034 arXiv-issued DOI via DataCite |
Submission history
From: Antonio Collante [view email]
[v1]
Thu, 14 Aug 2025 19:39:01 UTC (605 KB)
[v2]
Thu, 13 Nov 2025 13:33:44 UTC (540 KB)
来源：arXiv cs.AI · arxiv.org