Cover Image

Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Hongchen, Li, Kangming, Ramsay, Scott, Fehlis, Yao, Kim, Edward, Hattrick-Simpers, Jason
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Materials Science Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLM4Mat-Bench: Benchmarking Large Language Models for Materials Property Prediction
by: Rubungo, Andre Niyongabo, et al.
Published: (2024)

Training-Free Active Learning Framework in Materials Science with Large Language Models
by: Wang, Hongchen, et al.
Published: (2025)

Reproducibility in Computational Materials Science: Lessons from 'A General-Purpose Machine Learning Framework for Predicting Properties of Inorganic Materials'
by: Persaud, Daniel, et al.
Published: (2023)

Building informative materials datasets beyond targeted objectives
by: Castañeda, Rafael Espinosa, et al.
Published: (2026)

When Active Learning Fails, Uncalibrated Out of Distribution Uncertainty Quantification Might Be the Problem
by: Dale, Ashley S., et al.
Published: (2025)

Efficient first principles based modeling via machine learning: from simple representations to high entropy materials
by: Li, Kangming, et al.
Published: (2024)

Aligning Reasoning LLMs for Materials Discovery with Physics-aware Rejection Sampling
by: Hyun, Lee, et al.
Published: (2025)

Building Trustworthy AI for Materials Discovery: From Autonomous Laboratories to Z-scores
by: Amirian, Benhour, et al.
Published: (2025)

Matter-of-Fact: A Benchmark for Verifying the Feasibility of Literature-Supported Claims in Materials Science
by: Jansen, Peter, et al.
Published: (2025)

Are LLMs Ready for Real-World Materials Discovery?
by: Miret, Santiago, et al.
Published: (2024)

AtomWorld: A Benchmark for Evaluating Spatial Reasoning in Large Language Models on Crystalline Materials
by: Lv, Taoyuze, et al.
Published: (2025)

Automated Extraction of Material Properties using LLM-based AI Agents
by: Ghosh, Subham, et al.
Published: (2025)

Probing out-of-distribution generalization in machine learning for materials
by: Li, Kangming, et al.
Published: (2024)

Fine-Tuning Vision-Language Models for Multimodal Polymer Property Prediction
by: Vuong, An, et al.
Published: (2025)

LLMatDesign: Autonomous Materials Discovery with Large Language Models
by: Jia, Shuyi, et al.
Published: (2024)

MatExpert: Decomposing Materials Discovery by Mimicking Human Experts
by: Ding, Qianggang, et al.
Published: (2024)

Property Prediction of Stacked Bilayer Materials: A Multimodal Learning Approach
by: Vuong, An, et al.
Published: (2026)

Research Paradigm of Materials Science Tetrahedra with Artificial Intelligence
by: Zhang, Shiyun, et al.
Published: (2026)

Kernel Learning Assisted Synthesis Condition Exploration for Ternary Spinel
by: Liu, Yutong, et al.
Published: (2025)

Supervised Pretraining for Material Property Prediction
by: Rahman, Chowdhury Mohammad Abid, et al.
Published: (2025)

An Assessment of Commonly Used Equivalent Circuit Models for Corrosion Analysis: A Bayesian Approach to Electrochemical Impedance Spectroscopy
by: Zhang, Runze, et al.
Published: (2024)

PDDFormer: Pairwise Distance Distribution Graph Transformer for Crystal Material Property Prediction
by: Shen, Xiangxiang, et al.
Published: (2024)

LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation
by: Chiang, Yuan, et al.
Published: (2024)

Exploring the Limitations of kNN Noisy Feature Detection and Recovery for Self-Driving Labs
by: Shi, Qiuyu, et al.
Published: (2025)

Flexible, Model-Agnostic Method for Materials Data Extraction from Text Using General Purpose Language Models
by: Polak, Maciej P., et al.
Published: (2023)

Towards Agentic Intelligence for Materials Science
by: Zhang, Huan, et al.
Published: (2026)

Tensor Completion for Surrogate Modeling of Material Property Prediction
by: Pakala, Shaan, et al.
Published: (2025)

Multimodal Transformer for Sample-Aware Prediction of Metal-Organic Framework Properties
by: Han, Seunghee, et al.
Published: (2026)

Autonomous Sampling and SHAP Interpretation of Deposition-Rates in Bipolar HiPIMS
by: Wieczorek, Alexander, et al.
Published: (2026)

Language-Native Materials Processing Design by Lightly Structured Text Database and Reasoning Large Language Model
by: Liu, Yuze, et al.
Published: (2025)

Uncovering Bottlenecks and Optimizing Scientific Lab Workflows with Cycle Time Reduction Agents
by: Fehlis, Yao
Published: (2025)

Hierarchical Multi-agent Large Language Model Reasoning for Autonomous Functional Materials Discovery
by: Rothfarb, Samuel, et al.
Published: (2025)

Material Property Prediction with Element Attribute Knowledge Graphs and Multimodal Representation Learning
by: Huang, Chao, et al.
Published: (2024)

Dynamic In-context Learning with Conversational Models for Data Extraction and Materials Property Prediction
by: Ekuma, Chinedu
Published: (2024)

Reshaping MOFs text mining with a dynamic multi-agents framework of large language model
by: Lin, Zuhong, et al.
Published: (2025)

Agentic Design of Compositional Descriptors via Autoresearch for Materials Science Applications
by: Cobelli, Matteo, et al.
Published: (2026)

From Text to Test: AI-Generated Control Software for Materials Science Instruments
by: Fébba, Davi M, et al.
Published: (2024)

From Data to Theory: Autonomous Large Language Model Agents for Materials Science
by: Alfred, Samuel Onimpa, et al.
Published: (2026)

Developing and Validating a High-Throughput Robotic System for the Accelerated Development of Porous Membranes
by: Wang, Hongchen, et al.
Published: (2025)

BeamPERL: Parameter-Efficient RL with Verifiable Rewards Specializes Compact LLMs for Structured Beam Mechanics Reasoning
by: Hage, Tarjei Paule, et al.
Published: (2026)