Image de couverture de livre

MatSciBench: Benchmarking the Reasoning Ability of Large Language Models in Materials Science

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Junkai, Gan, Jingru, Wang, Xiaoxuan, Jia, Zian, Gu, Changquan, Chen, Jianpeng, Zhu, Yanqiao, Ma, Mingyu Derek, Zhou, Dawei, Li, Ling, Wang, Wei
Format:	Preprint
Publié:	2025
Sujets:	Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MetamatBench: Integrating Heterogeneous Data, Computational Tools, and Visual Interface for Metamaterial Discovery
par: Chen, Jianpeng, et autres
Publié: (2025)

SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models
par: Wang, Xiaoxuan, et autres
Publié: (2023)

METASYMBO: Multi-Agent Language-Guided Metamaterial Discovery via Symbolic Latent Evolution
par: Chen, Jianpeng, et autres
Publié: (2026)

OmniMatBench: A Human-Calibrated Multimodal Reasoning Benchmark Across 19 Materials Science Subfields
par: Liu, Wanhao, et autres
Publié: (2026)

MatLLMSearch: Crystal Structure Discovery with Evolution-Guided Large Language Models
par: Gan, Jingru, et autres
Publié: (2025)

MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Design
par: Qi, Jingyuan, et autres
Publié: (2024)

Benchmarking Cross-Scale Perception Ability of Large Multimodal Models in Material Science
par: Zheng, Yuting, et autres
Publié: (2026)

MatTools: Benchmarking Large Language Models for Materials Science Tools
par: Liu, Siyu, et autres
Publié: (2025)

SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Models
par: Deng, Andong, et autres
Publié: (2025)

LLM4Mat-Bench: Benchmarking Large Language Models for Materials Property Prediction
par: Rubungo, Andre Niyongabo, et autres
Publié: (2024)

VideoMat: Extracting PBR Materials from Video Diffusion Models
par: Munkberg, Jacob, et autres
Publié: (2025)

CliBench: A Multifaceted and Multigranular Evaluation of Large Language Models for Clinical Decision Making
par: Ma, Mingyu Derek, et autres
Publié: (2024)

MatFormBench: A Benchmarking Evaluation Framework for Target-Driven Materials Formulation
par: Wu, Linhan, et autres
Publié: (2026)

DataSciBench: An LLM Agent Benchmark for Data Science
par: Zhang, Dan, et autres
Publié: (2025)

VocalBench: Benchmarking the Vocal Conversational Abilities for Speech Interaction Models
par: Liu, Heyang, et autres
Publié: (2025)

SOVA-Bench: Benchmarking the Speech Conversation Ability for LLM-based Voice Assistant
par: Hou, Yixuan, et autres
Publié: (2025)

ICU-Bench:Benchmarking Continual Unlearning in Multimodal Large Language Models
par: Wang, Yuhang, et autres
Publié: (2026)

VocalBench-zh: Decomposing and Benchmarking the Speech Conversational Abilities in Mandarin Context
par: Liu, Heyang, et autres
Publié: (2025)

Disentangling Memory and Reasoning Ability in Large Language Models
par: Jin, Mingyu, et autres
Publié: (2024)

Entropy-Based Adaptive Weighting for Self-Training
par: Wang, Xiaoxuan, et autres
Publié: (2025)

FetchBench: A Simulation Benchmark for Robot Fetching
par: Han, Beining, et autres
Publié: (2024)

AQA-Bench: An Interactive Benchmark for Evaluating LLMs' Sequential Reasoning Ability
par: Yang, Siwei, et autres
Publié: (2024)

LogicGame: Benchmarking Rule-Based Reasoning Abilities of Large Language Models
par: Gui, Jiayi, et autres
Publié: (2024)

Towards Heterogeneous Long-tailed Learning: Benchmarking, Metrics, and Toolbox
par: Wang, Haohui, et autres
Publié: (2023)

MatSciRE: Leveraging Pointer Networks to Automate Entity and Relation Extraction for Material Science Knowledge-base Construction
par: Mullick, Ankan, et autres
Publié: (2024)

Seeing Beyond Words: MatVQA for Challenging Visual-Scientific Reasoning in Materials Science
par: Wu, Sifan, et autres
Publié: (2025)

TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models
par: Chu, Zheng, et autres
Publié: (2023)

SciEval: A Benchmark for Automatic Evaluation of K-12 Science Instructional Materials
par: Li, Zhaohui, et autres
Publié: (2026)

AVA-Bench: Atomic Visual Ability Benchmark for Vision Foundation Models
par: Mai, Zheda, et autres
Publié: (2025)

MatWheel: Addressing Data Scarcity in Materials Science Through Synthetic Data
par: Li, Wentao, et autres
Publié: (2025)

Pet-Bench: Benchmarking the Abilities of Large Language Models as E-Pets in Social Network Services
par: Guo, Hongcheng, et autres
Publié: (2025)

NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes
par: Fan, Lizhou, et autres
Publié: (2023)

AudioRAG: A Challenging Benchmark for Audio Reasoning and Information Retrieval
par: Lin, Jingru, et autres
Publié: (2026)

SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors
par: Hu, Tiancheng, et autres
Publié: (2025)

Memorize and Rank: Elevating Large Language Models for Clinical Diagnosis Prediction
par: Ma, Mingyu Derek, et autres
Publié: (2025)

HSSBench: Benchmarking Humanities and Social Sciences Ability for Multimodal Large Language Models
par: Kang, Zhaolu, et autres
Publié: (2025)

AtmosSci-Bench: Evaluating the Recent Advance of Large Language Model for Atmospheric Science
par: Li, Chenyue, et autres
Publié: (2025)

STAR: Boosting Low-Resource Information Extraction by Structure-to-Text Data Generation with Large Language Models
par: Ma, Mingyu Derek, et autres
Publié: (2023)

Adaptive-Solver Framework for Dynamic Strategy Selection in Large Language Model Reasoning
par: Zhou, Jianpeng, et autres
Publié: (2023)

Are Large-Language Models Graph Algorithmic Reasoners?
par: Taylor, Alexander K, et autres
Publié: (2024)