Copertina

SPhyR: Spatial-Physical Reasoning Benchmark on Material Distribution

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Siedler, Philipp D.
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Strategic Persuasion with Trait-Conditioned Multi-Agent Systems for Iterative Legal Argumentation
di: Siedler, Philipp D.
Pubblicazione: (2026)

Learning to Communicate and Collaborate in a Competitive Multi-Agent Setup to Clean the Ocean from Macroplastics
di: Siedler, Philipp Dominic
Pubblicazione: (2023)

HIVEX: A High-Impact Environment Suite for Multi-Agent Research (extended version)
di: Siedler, Philipp Dominic
Pubblicazione: (2025)

LLM-Mediated Guidance of MARL Systems
di: Siedler, Philipp D., et al.
Pubblicazione: (2025)

PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoning
di: Zhang, Qiran, et al.
Pubblicazione: (2026)

Spatial CAPTCHA: Generatively Benchmarking Spatial Reasoning for Human-Machine Differentiation
di: Kharlamova, Arina, et al.
Pubblicazione: (2025)

AtomWorld: A Benchmark for Evaluating Spatial Reasoning in Large Language Models on Crystalline Materials
di: Lv, Taoyuze, et al.
Pubblicazione: (2025)

Compositional-ARC: Assessing Systematic Generalization in Abstract Spatial Reasoning
di: Mondorf, Philipp, et al.
Pubblicazione: (2025)

MSQA: Benchmarking LLMs on Graduate-Level Materials Science Reasoning and Knowledge
di: Cheung, Jerry Junyang, et al.
Pubblicazione: (2025)

FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representations
di: Rodionov, Fedor, et al.
Pubblicazione: (2025)

ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraints
di: Xu, Rui, et al.
Pubblicazione: (2025)

PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning
di: Zhang, Xinyu, et al.
Pubblicazione: (2025)

DeepPHY: Benchmarking Agentic VLMs on Physical Reasoning
di: Xu, Xinrun, et al.
Pubblicazione: (2025)

Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
di: Liu, Weichen, et al.
Pubblicazione: (2025)

MatSciBench: Benchmarking the Reasoning Ability of Large Language Models in Materials Science
di: Zhang, Junkai, et al.
Pubblicazione: (2025)

GRASP: A Grid-Based Benchmark for Evaluating Commonsense Spatial Reasoning
di: Tang, Zhisheng, et al.
Pubblicazione: (2024)

FeynmanBench: Benchmarking Multimodal LLMs on Diagrammatic Physics Reasoning
di: Wang, Zeyu, et al.
Pubblicazione: (2026)

QSTRBench: a New Benchmark to Evaluate the Ability of Language Models to Reason with Qualitative Spatial and Temporal Calculi
di: Cohn, Anthony G., et al.
Pubblicazione: (2026)

TableVision: A Large-Scale Benchmark for Spatially Grounded Reasoning over Complex Hierarchical Tables
di: Chen, Xiaoyu, et al.
Pubblicazione: (2026)

EarthSpatialBench: Benchmarking Spatial Reasoning Capabilities of Multimodal LLMs on Earth Imagery
di: Xu, Zelin, et al.
Pubblicazione: (2026)

MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
di: Lee, Youngwan, et al.
Pubblicazione: (2026)

LogicSkills: A Structured Benchmark for Formal Reasoning in Large Language Models
di: Rabern, Brian, et al.
Pubblicazione: (2026)

Xiangqi-R1: Enhancing Spatial Strategic Reasoning in LLMs for Chinese Chess via Reinforcement Learning
di: Chen, Yuhao, et al.
Pubblicazione: (2025)

Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models
di: Wang, Xingrui, et al.
Pubblicazione: (2025)

Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning
di: Li, Fangjun, et al.
Pubblicazione: (2024)

MIXPINN: Mixed-Material Simulations by Physics-Informed Neural Network
di: Yuan, Xintian, et al.
Pubblicazione: (2025)

Deconstructing Spatial Complexity: Hierarchical Decomposition for LLM Spatial Reasoning
di: Wang, Yi, et al.
Pubblicazione: (2026)

OmniMatBench: A Human-Calibrated Multimodal Reasoning Benchmark Across 19 Materials Science Subfields
di: Liu, Wanhao, et al.
Pubblicazione: (2026)

OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models
di: Jia, Mengdi, et al.
Pubblicazione: (2025)

Spatial Atlas: Compute-Grounded Reasoning for Spatial-Aware Research Agent Benchmarks
di: Sharma, Arun
Pubblicazione: (2026)

MIRAGE: A Multi-modal Benchmark for Spatial Perception, Reasoning, and Intelligence
di: Liu, Chonghan, et al.
Pubblicazione: (2025)

SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
di: Xu, Peiran, et al.
Pubblicazione: (2025)

SpatialEpiBench: Benchmarking Spatial Information and Epidemic Priors in Forecasting
di: Lyu, Ruiqi, et al.
Pubblicazione: (2026)

Enhancing Agent Safety Judgment: Controlled Benchmark Rewriting and Analogical Reasoning for Deceptive Out-of-Distribution Scenarios
di: Zhang, Zuoyu, et al.
Pubblicazione: (2026)

Spatial Competence Benchmark
di: Vira, Jash, et al.
Pubblicazione: (2026)

PhysUniBench: A Multi-Modal Physics Reasoning Benchmark at Undergraduate Level
di: Wang, Lintao, et al.
Pubblicazione: (2025)

SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models
di: Yang, Wanqi, et al.
Pubblicazione: (2025)

Pedagogy-R1: Pedagogically-Aligned Reasoning Model with Balanced Educational Benchmark
di: Lee, Unggi, et al.
Pubblicazione: (2025)

Watson & Holmes: A Naturalistic Benchmark for Comparing Human and LLM Reasoning
di: Leelawat, Thatchawin, et al.
Pubblicazione: (2026)

Verifiable Benchmarking of Long-Horizon Spatial Biology
di: Diks, Ian, et al.
Pubblicazione: (2026)