Copertina

SWE-CI: Evaluating Agent Capabilities in Maintaining Codebases via Continuous Integration

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Jialong, Xu, Xander, Wei, Hu, Chen, Chuan, Zhao, Bing
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Software Engineering Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

FormulaCode: Evaluating Agentic Optimization on Large Codebases
di: Sehgal, Atharva, et al.
Pubblicazione: (2026)

Confucius Code Agent: Scalable Agent Scaffolding for Real-World Codebases
di: Wong, Sherman, et al.
Pubblicazione: (2025)

Kimi-Dev: Agentless Training as Skill Prior for SWE-Agents
di: Yang, Zonghan, et al.
Pubblicazione: (2025)

SWE-smith: Scaling Data for Software Engineering Agents
di: Yang, John, et al.
Pubblicazione: (2025)

APEX-SWE
di: Kottamasu, Abhi, et al.
Pubblicazione: (2026)

Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
di: Zan, Daoguang, et al.
Pubblicazione: (2025)

RPG: A Repository Planning Graph for Unified and Scalable Codebase Generation
di: Luo, Jane, et al.
Pubblicazione: (2025)

GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
di: Shetty, Manish, et al.
Pubblicazione: (2025)

SWE-AGI: Benchmarking Specification-Driven Software Construction with MoonBit in the Era of Autonomous Agents
di: Zhang, Zhirui, et al.
Pubblicazione: (2026)

SWE-Chain: Benchmarking Coding Agents on Chained Release-Level Package Upgrades
di: Lam, Man Ho, et al.
Pubblicazione: (2026)

Satori-SWE: Evolutionary Test-Time Scaling for Sample-Efficient Software Engineering
di: Zeng, Guangtao, et al.
Pubblicazione: (2025)

SWE-bench Goes Live!
di: Zhang, Linghao, et al.
Pubblicazione: (2025)

SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution
di: Wei, Yuxiang, et al.
Pubblicazione: (2025)

Dissecting the SWE-Bench Leaderboards: Profiling Submitters and Architectures of LLM- and Agent-Based Repair Systems
di: Martinez, Matias, et al.
Pubblicazione: (2025)

daVinci-Env: Open SWE Environment Synthesis at Scale
di: Fu, Dayuan, et al.
Pubblicazione: (2026)

SWE-bench-java: A GitHub Issue Resolving Benchmark for Java
di: Zan, Daoguang, et al.
Pubblicazione: (2024)

GameDevBench: Evaluating Agentic Capabilities Through Game Development
di: Chi, Wayne, et al.
Pubblicazione: (2026)

SWE-MERA: A Dynamic Benchmark for Agenticly Evaluating Large Language Models on Software Engineering Tasks
di: Adamenko, Pavel, et al.
Pubblicazione: (2025)

A Note on Code Quality Score: LLMs for Maintainable Large Codebases
di: Wong, Sherman, et al.
Pubblicazione: (2025)

Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?
di: Xia, Chunqiu Steven, et al.
Pubblicazione: (2025)

SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding
di: Cai, Songcheng, et al.
Pubblicazione: (2026)

Toward Training Superintelligent Software Agents through Self-Play SWE-RL
di: Wei, Yuxiang, et al.
Pubblicazione: (2025)

LocAgent: Graph-Guided LLM Agents for Code Localization
di: Chen, Zhaoling, et al.
Pubblicazione: (2025)

BugPilot: Complex Bug Generation for Efficient Learning of SWE Skills
di: Sonwane, Atharv, et al.
Pubblicazione: (2025)

Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation Capabilities
di: Wang, Hanbin, et al.
Pubblicazione: (2025)

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
di: Yang, John, et al.
Pubblicazione: (2024)

SWE-Protégé: Learning to Selectively Collaborate With an Expert Unlocks Small Language Models as Software Engineering Agents
di: Kon, Patrick Tser Jern, et al.
Pubblicazione: (2026)

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
di: Jimenez, Carlos E., et al.
Pubblicazione: (2023)

OmniCode: A Benchmark for Evaluating Software Engineering Agents
di: Sonwane, Atharv, et al.
Pubblicazione: (2026)

AgentLens: Revealing The Lucky Pass Problem in SWE-Agent Evaluation
di: Sahoo, Priyam, et al.
Pubblicazione: (2026)

SWE-Spot: Building Small Repo-Experts with Repository-Centric Learning
di: Peng, Jinjun, et al.
Pubblicazione: (2026)

DebugBench: Evaluating Debugging Capability of Large Language Models
di: Tian, Runchu, et al.
Pubblicazione: (2024)

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks
di: Chung, Isaac, et al.
Pubblicazione: (2025)

SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training
di: Song, Huatong, et al.
Pubblicazione: (2026)

BUILD-AND-FIND: An Effort-Aware Protocol for Evaluating Agent-Managed Codebases
di: Lin, Jhen-Ke
Pubblicazione: (2026)

Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination
di: Chen, Simin, et al.
Pubblicazione: (2025)

RGD: Multi-LLM Based Agent Debugger via Refinement and Generation Guidance
di: Jin, Haolin, et al.
Pubblicazione: (2024)

Adaptable and Precise: Enterprise-Scenario LLM Function-Calling Capability Training Pipeline
di: Zeng, Guancheng, et al.
Pubblicazione: (2024)

EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repair
di: Chen, Jiaao, et al.
Pubblicazione: (2026)

Converted, Not Equivalent: Benchmarking Codebase Conversion via Observational Equivalence
di: Song, Linxin, et al.
Pubblicazione: (2026)