Imagen de Portada

MaterialBENCH: Evaluating College-Level Materials Science Problem-Solving Abilities of Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Yoshitake, Michiko, Suzuki, Yuta, Igarashi, Ryo, Ushiku, Yoshitaka, Nagato, Keisuke
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Materials Science
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MaterialFigBENCH: benchmark dataset with figures for evaluating college-level materials science problem-solving abilities of multimodal large language models
por: Yoshitake, Michiko, et al.
Publicado: (2026)

Bridging Text and Crystal Structures: Literature-driven Contrastive Learning for Materials Science
por: Suzuki, Yuta, et al.
Publicado: (2025)

SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models
por: Wang, Xiaoxuan, et al.
Publicado: (2023)

Crystalformer: Infinitely Connected Attention for Periodic Structure Encoding
por: Taniai, Tatsunori, et al.
Publicado: (2024)

CrystalFramer: Rethinking the Role of Frames for SE(3)-Invariant Crystal Structure Modeling
por: Ito, Yusei, et al.
Publicado: (2025)

MatTools: Benchmarking Large Language Models for Materials Science Tools
por: Liu, Siyu, et al.
Publicado: (2025)

Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Research
por: Hatakeyama-Sato, Kan, et al.
Publicado: (2025)

Foundational Large Language Models for Materials Research
por: Mishra, Vaibhav, et al.
Publicado: (2024)

NEO-BENCH: Evaluating Robustness of Large Language Models with Neologisms
por: Zheng, Jonathan, et al.
Publicado: (2024)

AtomWorld: A Benchmark for Evaluating Spatial Reasoning in Large Language Models on Crystalline Materials
por: Lv, Taoyuze, et al.
Publicado: (2025)

LLMatDesign: Autonomous Materials Discovery with Large Language Models
por: Jia, Shuyi, et al.
Publicado: (2024)

STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Models
por: Chen, Kai, et al.
Publicado: (2025)

LLM4Mat-Bench: Benchmarking Large Language Models for Materials Property Prediction
por: Rubungo, Andre Niyongabo, et al.
Publicado: (2024)

Enhancing Large Language Models with Domain-Specific Knowledge: The Case in Topological Materials
por: Xu, HuangChao, et al.
Publicado: (2024)

Benchmarking Cross-Scale Perception Ability of Large Multimodal Models in Material Science
por: Zheng, Yuting, et al.
Publicado: (2026)

Reliable End-to-End Material Information Extraction from the Literature with Source-Tracked Multi-Stage Large Language Models
por: Wang, Xin, et al.
Publicado: (2025)

Rethinking Gradient-Based Methods: Multi-Property Materials Design Beyond Differentiable Targets
por: Fujii, Akihiro, et al.
Publicado: (2024)

Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions
por: Wang, Hongchen, et al.
Publicado: (2024)

Language-Native Materials Processing Design by Lightly Structured Text Database and Reasoning Large Language Model
por: Liu, Yuze, et al.
Publicado: (2025)

LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation
por: Chiang, Yuan, et al.
Publicado: (2024)

Reconstructing Materials Tetrahedron: Challenges in Materials Information Extraction
por: Hira, Kausik, et al.
Publicado: (2023)

Structured Extraction of Process Structure Properties Relationships in Materials Science
por: Verma, Amit K, et al.
Publicado: (2025)

Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discovery
por: Matsubara, Yoshitomo, et al.
Publicado: (2022)

Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineering
por: Polak, Maciej P., et al.
Publicado: (2023)

Evaluating Large Language Models for Material Selection
por: Grandi, Daniele, et al.
Publicado: (2024)

Type-Based Verification of Connectivity Constraints in Lattice Surgery
por: Wakizaka, Ryo, et al.
Publicado: (2024)

Where is the answer? Investigating Positional Bias in Language Model Knowledge Extraction
por: Saito, Kuniaki, et al.
Publicado: (2024)

Hierarchical Multi-agent Large Language Model Reasoning for Autonomous Functional Materials Discovery
por: Rothfarb, Samuel, et al.
Publicado: (2025)

Creativity or Brute Force? Using Brainteasers as a Window into the Problem-Solving Abilities of Large Language Models
por: Han, Simeng, et al.
Publicado: (2025)

Selecting and Evaluating Science Materials for Children at the Elementary Level
por: Howie, Kathryn S.
Publicado: (1974)

Foreign Languages: Selected Materials for Prospective Teachers of Foreign Languages.
por: Crane, Joanna Breedlove
Publicado: (1971)

Books and Materials for Language Teachers.
Publicado: (1967)

Matter-of-Fact: A Benchmark for Verifying the Feasibility of Literature-Supported Claims in Materials Science
por: Jansen, Peter, et al.
Publicado: (2025)

Construction and Application of Materials Knowledge Graph in Multidisciplinary Materials Science via Large Language Model
por: Ye, Yanpeng, et al.
Publicado: (2024)

Generative Chemical Language Models for Energetic Materials Discovery
por: Salij, Andrew, et al.
Publicado: (2026)

DiSCoMaT: Distantly Supervised Composition Extraction from Tables in Materials Science Articles
por: Gupta, Tanishq, et al.
Publicado: (2022)

Flexible, Model-Agnostic Method for Materials Data Extraction from Text Using General Purpose Language Models
por: Polak, Maciej P., et al.
Publicado: (2023)

DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues
por: Jang, Kyochul, et al.
Publicado: (2025)

Exploring the Expertise of Large Language Models in Materials Science and Metallurgical Engineering
por: Bajan, Christophe, et al.
Publicado: (2025)

Mathify: Evaluating Large Language Models on Mathematical Problem Solving Tasks
por: Anand, Avinash, et al.
Publicado: (2024)