Imagen de Portada

When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific Research

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Son, Guijin, Hong, Jiwoo, Fan, Honglu, Nam, Heejeong, Ko, Hyunwoo, Lim, Seungwon, Song, Jinyeop, Choi, Jinha, Paulo, Gonçalo, Yu, Youngjae, Biderman, Stella
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Linguistic Generalizability of Test-Time Scaling in Mathematical Reasoning
por: Son, Guijin, et al.
Publicado: (2025)

Multi-Step Reasoning in Korean and the Emergent Mirage
por: Son, Guijin, et al.
Publicado: (2025)

Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap
por: Ko, Hyunwoo, et al.
Publicado: (2025)

ResearchMath-14K: Scaling Research-Level Mathematics via Agents
por: Son, Guijin, et al.
Publicado: (2026)

Won: Establishing Best Practices for Korean Financial NLP
por: Son, Guijin, et al.
Publicado: (2025)

KAIO: A Collection of More Challenging Korean Questions
por: Lee, Nahyun, et al.
Publicado: (2025)

Controlling Language Confusion in Multilingual LLMs
por: Lee, Nahyun, et al.
Publicado: (2025)

Grokking Group Multiplication with Cosets
por: Stander, Dashiell, et al.
Publicado: (2023)

LLM-as-a-Judge & Reward Model: What They Can and Cannot Do
por: Son, Guijin, et al.
Publicado: (2024)

Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Math
por: Son, Guijin, et al.
Publicado: (2026)

Scaling Self-Supervised Representation Learning for Symbolic Piano Performance
por: Bradshaw, Louis, et al.
Publicado: (2025)

Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thought
por: Son, Guijin, et al.
Publicado: (2025)

VAGUE: Visual Contexts Clarify Ambiguous Expressions
por: Nam, Heejeong, et al.
Publicado: (2024)

KMMLU: Measuring Massive Multitask Language Understanding in Korean
por: Son, Guijin, et al.
Publicado: (2024)

Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback
por: Son, Guijin, et al.
Publicado: (2026)

Persona Dynamics: Unveiling the Impact of Personality Traits on Agents in Text-Based Games
por: Lim, Seungwon, et al.
Publicado: (2025)

MASS: Overcoming Language Bias in Image-Text Matching
por: Chung, Jiwan, et al.
Publicado: (2025)

What Users Leave Unsaid: Under-Specified Queries Limit Vision-Language Models
por: Choi, Dasol, et al.
Publicado: (2026)

Ko-PIQA: A Korean Physical Commonsense Reasoning Dataset with Cultural Context
por: Choi, Dasol, et al.
Publicado: (2025)

The Silent Scientist: When Software Research Fails to Reach Its Audience
por: Wyrich, Marvin, et al.
Publicado: (2025)

KMMMU: Evaluation of Massive Multi-discipline Multimodal Understanding in Korean Language and Context
por: Lee, Nahyun, et al.
Publicado: (2026)

Pushing the Boundaries of Multiple Choice Evaluation to One Hundred Options
por: Lee, Nahyun, et al.
Publicado: (2026)

Can visual language models resolve textual ambiguity with visual cues? Let visual puns tell you!
por: Chung, Jiwan, et al.
Publicado: (2024)

CLARA: Classifying and Disambiguating User Commands for Reliable Interactive Robotic Agents
por: Park, Jeongeun, et al.
Publicado: (2023)

A sociocultural perspective on AI assistive technology for older adults' social connectedness: A scoping review
por: Soobin You, et al.
Publicado: (2024)

Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once?
por: Son, Guijin, et al.
Publicado: (2024)

An Adversarial Learning Approach to Irregular Time-Series Forecasting
por: Nam, Heejeong, et al.
Publicado: (2024)

Second Order Expansion of Gibbs State Reduced Density Matrices in the Gross-Pitaevskii Regime
por: Brennecke, Christian, et al.
Publicado: (2023)

VisEscape: A Benchmark for Evaluating Exploration-driven Decision-making in Virtual Escape Rooms
por: Lim, Seungwon, et al.
Publicado: (2025)

When Verification Fails: How Compositionally Infeasible Claims Escape Rejection
por: Liu, Muxin, et al.
Publicado: (2026)

Topology of independence complexes and cycle structure of hypergraphs
por: Kim, Jinha
Publicado: (2024)

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
por: Lu, Chris, et al.
Publicado: (2024)

Revisiting the Uniform Information Density Hypothesis in LLM Reasoning
por: Gwak, Minju, et al.
Publicado: (2025)

Revisiting the UID Hypothesis in LLM Reasoning Traces
por: Gwak, Minju, et al.
Publicado: (2025)

AI Scientists Fail Without Strong Implementation Capability
por: Zhu, Minjun, et al.
Publicado: (2025)

Information Support for Scientists and Researchers in Greece.
por: Vourou, Stella
Publicado: (1996)

On the Robustness of Reward Models for Language Model Alignment
por: Hong, Jiwoo, et al.
Publicado: (2025)

From 'Individual Scientist' to 'Integrated Scientist': The Evolution of Scientific Organizational panels and Their Impact on the Scientific System
por: Zhang, Zekai
Publicado: (2025)

Health Shocks and the Spatial Dynamics of Intergenerational Proximity in South Korea: Evidence From 2006 to 2022
por: Heejeong Choi, et al.
Publicado: (2026)

Viewpoint-Tolerant Depth Perception for Shared Extended Space Experience on Wall-Sized Display
por: Kim, Dooyoung, et al.
Publicado: (2025)