Copertina

SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Miserendino, Samuel, Wang, Michele, Patwardhan, Tejal, Heidecke, Johannes
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Software Engineering
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SWE-Tester: Training Open-Source LLMs for Issue Reproduction in Real-World Repositories
di: Soni, Aditya Bharat, et al.
Pubblicazione: (2026)

SWE-Arena: An Interactive Platform for Evaluating Foundation Models in Software Engineering
di: Zhao, Zhimin
Pubblicazione: (2025)

Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?
di: Xia, Chunqiu Steven, et al.
Pubblicazione: (2025)

SWE-Replay: Efficient Test-Time Scaling for Software Engineering Agents
di: Ding, Yifeng, et al.
Pubblicazione: (2026)

SWE-MiniSandbox: Container-Free Reinforcement Learning for Building Software Engineering Agents
di: Yuan, Danlong, et al.
Pubblicazione: (2026)

SWE-Universe: Scale Real-World Verifiable Environments to Millions
di: Chen, Mouxiang, et al.
Pubblicazione: (2026)

SWE-Exp: Experience-Driven Software Issue Resolution
di: Chen, Silin, et al.
Pubblicazione: (2025)

SWE-Protégé: Learning to Selectively Collaborate With an Expert Unlocks Small Language Models as Software Engineering Agents
di: Kon, Patrick Tser Jern, et al.
Pubblicazione: (2026)

IDE-Bench: Evaluating Large Language Models as IDE Agents on Real-World Software Engineering Tasks
di: Mateega, Spencer, et al.
Pubblicazione: (2026)

SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution
di: Li, Han, et al.
Pubblicazione: (2025)

Breaking the Silence: the Threats of Using LLMs in Software Engineering
di: Sallou, June, et al.
Pubblicazione: (2023)

Can LLMs Replace Manual Annotation of Software Engineering Artifacts?
di: Ahmed, Toufique, et al.
Pubblicazione: (2024)

Programming with Pixels: Can Computer-Use Agents do Software Engineering?
di: Aggarwal, Pranjal, et al.
Pubblicazione: (2025)

Should Code Models Learn Pedagogically? A Preliminary Evaluation of Curriculum Learning for Real-World Software Engineering Tasks
di: Khant, Kyi Shin, et al.
Pubblicazione: (2025)

SWE-Next: Scalable Real-World Software Engineering Tasks for Agents
di: Liang, Jiarong, et al.
Pubblicazione: (2026)

Investigating Test Overfitting on SWE-bench
di: Ahmed, Toufique, et al.
Pubblicazione: (2025)

SWE Atlas: Benchmarking Coding Agents Beyond Issue Resolution
di: Raghavendra, Mohit, et al.
Pubblicazione: (2026)

SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositories
di: Wang, Lilin, et al.
Pubblicazione: (2025)

Otter: Generating Tests from Issues to Validate SWE Patches
di: Ahmed, Toufique, et al.
Pubblicazione: (2025)

GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
di: Shetty, Manish, et al.
Pubblicazione: (2025)

LLMs in Coding and their Impact on the Commercial Software Engineering Landscape
di: Belozerov, Vladislav, et al.
Pubblicazione: (2025)

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
di: Yang, John, et al.
Pubblicazione: (2024)

Toward Training Superintelligent Software Agents through Self-Play SWE-RL
di: Wei, Yuxiang, et al.
Pubblicazione: (2025)

SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?
di: Han, Tingxu, et al.
Pubblicazione: (2026)

Agint: Agentic Graph Compilation for Software Engineering Agents
di: Chivukula, Abhi, et al.
Pubblicazione: (2025)

SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories?
di: He, Xinyi, et al.
Pubblicazione: (2025)

SWE-World: Building Software Engineering Agents in Docker-Free Environments
di: Sun, Shuang, et al.
Pubblicazione: (2026)

Software Engineering Principles for Fairer Systems: Experiments with GroupCART
di: Peng, Kewen, et al.
Pubblicazione: (2025)

Large Language Models for Software Engineering: A Reproducibility Crisis
di: Siddiq, Mohammed Latif, et al.
Pubblicazione: (2025)

Assessing the Use of AutoML for Data-Driven Software Engineering
di: Calefato, Fabio, et al.
Pubblicazione: (2023)

SeaView: Software Engineering Agent Visual Interface for Enhanced Workflow
di: Bula, Timothy, et al.
Pubblicazione: (2025)

Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findings
di: González, Alexandra, et al.
Pubblicazione: (2025)

A Systematic Literature Review on the Use of Machine Learning in Software Engineering
di: Fred, Nyaga, et al.
Pubblicazione: (2024)

SWE-Bench-CL: Continual Learning for Coding Agents
di: Joshi, Thomas, et al.
Pubblicazione: (2025)

More Rigorous Software Engineering Would Improve Reproducibility in Machine Learning Research
di: Wolter, Moritz, et al.
Pubblicazione: (2025)

Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineering
di: Zhuo, Hao, et al.
Pubblicazione: (2025)

Beyond the Comfort Zone: Emerging Solutions to Overcome Challenges in Integrating LLMs into Software Products
di: Nahar, Nadia, et al.
Pubblicazione: (2024)

Perspective of Software Engineering Researchers on Machine Learning Practices Regarding Research, Review, and Education
di: Mojica-Hanke, Anamaria, et al.
Pubblicazione: (2024)

HE-SNR: Uncovering Latent Logic via Entropy for Guiding Mid-Training on SWE-bench
di: Wang, Yueyang, et al.
Pubblicazione: (2026)

CPP-UT-Bench: Can LLMs Write Complex Unit Tests in C++?
di: Bhargava, Vaishnavi, et al.
Pubblicazione: (2024)