Cover Image

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, John, Jimenez, Carlos E., Zhang, Alex L., Lieret, Kilian, Yang, Joyce, Wu, Xindi, Press, Ori, Muennighoff, Niklas, Synnaeve, Gabriel, Narasimhan, Karthik R., Yang, Diyi, Wang, Sida I., Press, Ofir
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
by: Yang, John, et al.
Published: (2024)

SWE-smith: Scaling Data for Software Engineering Agents
by: Yang, John, et al.
Published: (2025)

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
by: Jimenez, Carlos E., et al.
Published: (2023)

CodeClash: Benchmarking Goal-Oriented Software Engineering
by: Yang, John, et al.
Published: (2025)

ProgramBench: Can Language Models Rebuild Programs From Scratch?
by: Yang, John, et al.
Published: (2026)

VideoGameBench: Can Vision-Language Models complete popular video games?
by: Zhang, Alex L., et al.
Published: (2025)

CiteME: Can Language Models Accurately Cite Scientific Claims?
by: Press, Ori, et al.
Published: (2024)

Toward Training Superintelligent Software Agents through Self-Play SWE-RL
by: Wei, Yuxiang, et al.
Published: (2025)

SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution
by: Wei, Yuxiang, et al.
Published: (2025)

EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities
by: Abramovich, Talor, et al.
Published: (2024)

$τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
by: Yao, Shunyu, et al.
Published: (2024)

AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?
by: Yoran, Ori, et al.
Published: (2024)

The Head-Mounted Displays (HMDs): Towards a Playful Approach to Architectural Space. Case Study of Augmented Grounds by Hahm, Jung, and Lee
by: IEREK Press
Published: (2025)

Online Service Migration in Mobile Edge With Incomplete System Information: A Deep Recurrent Actor-Critic Learning Approach
by: REA Press
Published: (2025)

Integrating Health and Well-being into Urban Design
by: IEREK Press
Published: (2024)

Ripples of Hope
by: Press, Robert
Published: (2025)

Earth / Frank Press, Raymond Siever
by: Press, Frank
Published: (1985)

SWE-fficiency: Can Language Models Optimize Real-World Repositories on Real Workloads?
by: Ma, Jeffrey Jian, et al.
Published: (2025)

RDumb: A simple approach that questions our progress in continual test-time adaptation
by: Press, Ori, et al.
Published: (2023)

SWE-bench Goes Live!
by: Zhang, Linghao, et al.
Published: (2025)

Multiplicative Langevin Process for Volatilities Produces Observed Q-Variance Regularities
by: Press, William H., et al.
Published: (2026)

Investigating Test Overfitting on SWE-bench
by: Ahmed, Toufique, et al.
Published: (2025)

INDIA'S LIVE EVENTS ECONOMY: A STRATEGIC GROWTH IMPERATIVE
by: National Press Associates
Published: (2025)

A STUDY ON OVERLOAD PRINCIPLE AND ITS ROLE IN IMPROVING SPORTS PERFORMANCE
by: National Press Associates
Published: (2026)

ROLE OF AI AND BIG DATA ANALYTICS IN SHAPING CONSUMER BUYING BEHAVIOUR TOWARDS FMCG GOODS
by: National Press Associates
Published: (2025)

ਗੁਰੂ ਤੇਗ ਬਹਾਦਰ ਜੀ ਦੀ ਬਾਣੀ: ਮਨੋਵਿਿਗਆਨਕ ਪੱਖ
by: National Press Associates
Published: (2026)

THE ROLE OF AI AND DIGITAL TECHNOLOGIES IN SHAPING TOMORROW'S COMMERCE EDUCATION
by: National Press Associates
Published: (2025)

समस्तीपुर नगर में नशा-उपयोग की प्रचलन दर और किशोर मानसिक स्वास्थ्य का तुलनात्मक अध्ययन
by: National Press Associates
Published: (2026)

A STUDY ON THE COMPARATIVE ANALYSIS OF EQUITY AND DEBT MUTUAL FUND SCHEMES WITH SPECIAL REFERENCE TO HDFC FUNDS MANAGEMENT PVT. LTD.
by: National Press Associates
Published: (2026)

PRACTICES OF CSR IN FERTILIZER INDUSTRIES: STUDY ON ATTEMPTS OF DCM SHRIRAM FERTILIZER
by: National Press Associates
Published: (2025)

PHYSICAL ACTIVITY PRESCRIPTION FOR NON COMMUNICABLE DISEASES (NCDs)- AN OVERVIEW
by: National Press Associates
Published: (2026)

ASSESSMENT AND MONITORING OF PHYSICAL FITNESS USING WEARABLE TECHNOLOGY – AN OVERVIEW
by: National Press Associates
Published: (2026)

A COMPARATIVE STUDY OF SELF-CONCEPT BETWEEN PRIMARY SCHOOL STUDENTS WITH HEARING AND SPEECH IMPAIRMENTS AND THEIR TYPICALLY DEVELOPING PEERS
by: National Press Associates
Published: (2026)

THE DARK SIDE OF ALGORITHMIC VISIBILITY: THE STRATEGIC RISKS OF OVER-OPTIMIZATION OF SOCIAL MEDIA RECOMMENDATIONS TO SMALL BUSINESSES.
by: National Press Associates
Published: (2025)

INSTITUTIONAL AND NON-INSTITUTIONAL CREDIT IN RURAL KARNATAKA: AN OVERVIEW
by: National Press Associates
Published: (2025)

SUSTAINABLE DIGITAL FINANCE: THE PROMISE AND CHALLENGES OF FINTECH IN PROMOTING FINANCIAL INCLUSION
by: National Press Associates
Published: (2025)

THE EFFECTIVENESS OF DIGITAL MARKETING ON CONSUMERS PURCHASING DECISIONS: A CONCEPTUAL STUDY
by: National Press Associates
Published: (2026)

CONCEPTUAL UNDERSTANDING OF DIGITAL LITERACY: IN INDIA
by: National Press Associates
Published: (2025)

SUSTAINABLE HUMAN DEVELOPMENT OF WOMEN THROUGH NGO's
by: National Press Associates
Published: (2025)

ਗੁਰੂ ਤੇਗ ਬਹਾਦਰ ਜੀ ਦੀ ਬਾਣੀ ਵਿੱਚ ਨਾਸ਼ਮਾਨਤਾ ਦਾ ਸੰਕਲਪ
by: National Press Associates
Published: (2026)