ReactBench: A Benchmark for Topological Reasoning in MLLMs on Chemical Reaction Diagrams
Fuente:
arXiv
Guardado en:
| Autores principales: | Xu, Qiang, Bai, Shengyuan, Wang, Yu, Cao, He, Chen, Leqing, Liu, Yuanyuan, Feng, Bin, Liu, Zijing, Li, Yu |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
ChemLabs on ChemO: A Multi-Agent System for Multimodal Reasoning on IChO 2025
por: Xu, Qiang, et al.
Publicado: (2025)
por: Xu, Qiang, et al.
Publicado: (2025)
Mozi: Governed Autonomy for Drug Discovery LLM Agents
por: Cao, He, et al.
Publicado: (2026)
por: Cao, He, et al.
Publicado: (2026)
ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation
por: Zhou, Shizhe, et al.
Publicado: (2026)
por: Zhou, Shizhe, et al.
Publicado: (2026)
MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension
por: Lu, Xingyu, et al.
Publicado: (2024)
por: Lu, Xingyu, et al.
Publicado: (2024)
MileBench: Benchmarking MLLMs in Long Context
por: Song, Dingjie, et al.
Publicado: (2024)
por: Song, Dingjie, et al.
Publicado: (2024)
PunchBench: Benchmarking MLLMs in Multimodal Punchline Comprehension
por: Ouyang, Kun, et al.
Publicado: (2024)
por: Ouyang, Kun, et al.
Publicado: (2024)
Cube Bench: A Benchmark for Spatial Visual Reasoning in MLLMs
por: Anand, Dhruv, et al.
Publicado: (2025)
por: Anand, Dhruv, et al.
Publicado: (2025)
MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs
por: Yuan, Jiakang, et al.
Publicado: (2025)
por: Yuan, Jiakang, et al.
Publicado: (2025)
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning
por: Wang, Xukai, et al.
Publicado: (2025)
por: Wang, Xukai, et al.
Publicado: (2025)
Hologram Reasoning for Solving Algebra Problems with Geometry Diagrams
por: Huang, Litian, et al.
Publicado: (2024)
por: Huang, Litian, et al.
Publicado: (2024)
$A^3$-Bench: Benchmarking Memory-Driven Scientific Reasoning via Anchor and Attractor Activation
por: Zhang, Jian, et al.
Publicado: (2026)
por: Zhang, Jian, et al.
Publicado: (2026)
ChemVA: Advancing Large Language Models on Chemical Reaction Diagrams Understanding
por: Rao, Mingyang, et al.
Publicado: (2026)
por: Rao, Mingyang, et al.
Publicado: (2026)
CSR-Bench: A Benchmark for Evaluating the Cross-modal Safety and Reliability of MLLMs
por: Liu, Yuxuan, et al.
Publicado: (2026)
por: Liu, Yuxuan, et al.
Publicado: (2026)
AgentRecBench: Benchmarking LLM Agent-based Personalized Recommender Systems
por: Shang, Yu, et al.
Publicado: (2025)
por: Shang, Yu, et al.
Publicado: (2025)
ReactZyme: A Benchmark for Enzyme-Reaction Prediction
por: Hua, Chenqing, et al.
Publicado: (2024)
por: Hua, Chenqing, et al.
Publicado: (2024)
Beyond Chemical QA: Evaluating LLM's Chemical Reasoning with Modular Chemical Operations
por: Li, Hao, et al.
Publicado: (2025)
por: Li, Hao, et al.
Publicado: (2025)
MolRecBench-Wild: A Real-World Benchmark for Optical Chemical Structure Recognition
por: Yang, Haote, et al.
Publicado: (2026)
por: Yang, Haote, et al.
Publicado: (2026)
TopoBench: Benchmarking LLMs on Hard Topological Reasoning
por: Maniparambil, Mayug, et al.
Publicado: (2026)
por: Maniparambil, Mayug, et al.
Publicado: (2026)
1D-Bench: A Benchmark for Iterative UI Code Generation with Visual Feedback in Real-World
por: Xu, Qiao, et al.
Publicado: (2026)
por: Xu, Qiao, et al.
Publicado: (2026)
EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs
por: Dai, Yang, et al.
Publicado: (2026)
por: Dai, Yang, et al.
Publicado: (2026)
FairReason: Balancing Reasoning and Social Bias in MLLMs
por: Pan, Zhenyu, et al.
Publicado: (2025)
por: Pan, Zhenyu, et al.
Publicado: (2025)
TCC-Bench: Benchmarking the Traditional Chinese Culture Understanding Capabilities of MLLMs
por: Xu, Pengju, et al.
Publicado: (2025)
por: Xu, Pengju, et al.
Publicado: (2025)
Not Search, But Scan: Benchmarking MLLMs on Scan-Oriented Academic Paper Reasoning
por: Li, Rongjin, et al.
Publicado: (2026)
por: Li, Rongjin, et al.
Publicado: (2026)
HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks
por: Zhang, Fengji, et al.
Publicado: (2024)
por: Zhang, Fengji, et al.
Publicado: (2024)
Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark
por: Cheng, Ziming, et al.
Publicado: (2025)
por: Cheng, Ziming, et al.
Publicado: (2025)
Efficient Antibody Structure Refinement Using Energy-Guided SE(3) Flow Matching
por: Zhang, Jiying, et al.
Publicado: (2024)
por: Zhang, Jiying, et al.
Publicado: (2024)
BioMD: All-atom Generative Model for Biomolecular Dynamics Simulation
por: Feng, Bin, et al.
Publicado: (2025)
por: Feng, Bin, et al.
Publicado: (2025)
DW-Bench: Benchmarking LLMs on Data Warehouse Graph Topology Reasoning
por: Ahmed, Ahmed G. A. H, et al.
Publicado: (2026)
por: Ahmed, Ahmed G. A. H, et al.
Publicado: (2026)
OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMs
por: Li, Caorui, et al.
Publicado: (2025)
por: Li, Caorui, et al.
Publicado: (2025)
Redundancy Principles for MLLMs Benchmarks
por: Zhang, Zicheng, et al.
Publicado: (2025)
por: Zhang, Zicheng, et al.
Publicado: (2025)
Rethinking Text-based Protein Understanding: Retrieval or LLM?
por: Wu, Juntong, et al.
Publicado: (2025)
por: Wu, Juntong, et al.
Publicado: (2025)
From Static Structures to Ensembles: Studying and Harnessing Protein Structure Tokenization
por: Liu, Zijing, et al.
Publicado: (2025)
por: Liu, Zijing, et al.
Publicado: (2025)
E-React: Towards Emotionally Controlled Synthesis of Human Reactions
por: Zhu, Chen, et al.
Publicado: (2025)
por: Zhu, Chen, et al.
Publicado: (2025)
MACReD: A Multi-Agent Collaborative Reasoning Framework for Reaction Diagram Parsing
por: Tang, Chuang, et al.
Publicado: (2026)
por: Tang, Chuang, et al.
Publicado: (2026)
CrossCult-KIBench: A Benchmark for Cross-Cultural Knowledge Insertion in MLLMs
por: Zeng, Zhen, et al.
Publicado: (2026)
por: Zeng, Zhen, et al.
Publicado: (2026)
SMH-Bench: Benchmarking LLM Agents for Environment-Grounded Reasoning and Action in Smart Homes
por: Li, Kuan, et al.
Publicado: (2026)
por: Li, Kuan, et al.
Publicado: (2026)
WGSR-Bench: Wargame-based Game-theoretic Strategic Reasoning Benchmark for Large Language Models
por: Yin, Qiyue, et al.
Publicado: (2025)
por: Yin, Qiyue, et al.
Publicado: (2025)
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs
por: Zhao, Xiangyu, et al.
Publicado: (2025)
por: Zhao, Xiangyu, et al.
Publicado: (2025)
InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery
por: Cao, He, et al.
Publicado: (2023)
por: Cao, He, et al.
Publicado: (2023)
GeoFM: Enhancing Geometric Reasoning of MLLMs via Synthetic Data Generation through Formal Language
por: Zhang, Yuhao, et al.
Publicado: (2025)
por: Zhang, Yuhao, et al.
Publicado: (2025)
Ejemplares similares
-
ChemLabs on ChemO: A Multi-Agent System for Multimodal Reasoning on IChO 2025
por: Xu, Qiang, et al.
Publicado: (2025) -
Mozi: Governed Autonomy for Drug Discovery LLM Agents
por: Cao, He, et al.
Publicado: (2026) -
ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation
por: Zhou, Shizhe, et al.
Publicado: (2026) -
MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension
por: Lu, Xingyu, et al.
Publicado: (2024) -
MileBench: Benchmarking MLLMs in Long Context
por: Song, Dingjie, et al.
Publicado: (2024)