Cover Image

From Queries to Criteria: Understanding How Astronomers Evaluate LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hyk, Alina, McCormick, Kiera, Zhong, Mian, Ciucă, Ioana, Sharma, Sanjib, Wu, John F, Peek, J. E. G., Iyer, Kartheik G., Xiao, Ziang, Field, Anjalie
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Instrumentation and Methods for Astrophysics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Designing an Evaluation Framework for Large Language Models in Astronomy Research
by: Wu, John F., et al.
Published: (2024)

Encoding and Understanding Astrophysical Information in Large Language Model-Generated Summaries
by: McCormick, Kiera, et al.
Published: (2025)

pathfinder: A Semantic Framework for Literature Review and Knowledge Discovery in Astronomy
by: Iyer, Kartheik G., et al.
Published: (2024)

The Effect of Document Selection on Query-focused Text Analysis
by: Rangreji, Sandesh S, et al.
Published: (2026)

HICode: Hierarchical Inductive Coding with LLMs
by: Zhong, Mian, et al.
Published: (2025)

Using Felis to Represent the Semantics and Metadata of Astronomical Data Catalogs
by: McCormick, Jeremy, et al.
Published: (2024)

The Multimodal Universe: Enabling Large-Scale Machine Learning with 100TB of Astronomical Scientific Data
by: The Multimodal Universe Collaboration, et al.
Published: (2024)

What Makes a Good Response? An Empirical Analysis of Quality in Qualitative Interviews
by: Ivey, Jonathan, et al.
Published: (2026)

Machine Learning Supports Existence of Previously Unrecognized Transient Astronomical Phenomena in Historical Observatory Images
by: Bruehl, Stephen, et al.
Published: (2026)

The Hubble Image Similarity Project
by: White, Richard L., et al.
Published: (2025)

Metasurface-Enabled Astronomical Polarimetry
by: Li, Lisa W., et al.
Published: (2025)

Pediatric lung ultrasound
by: Ioana Ciuca
Published: (2024)

DECH: Software Package for Astronomical Spectral Data Processing and Analysis
by: Galazutdinov, G. A.
Published: (2025)

How Do Observational Astronomers Learn to Inspect Imaging Data
by: Walsh, Hugo, et al.
Published: (2024)

Observers' Data Access Portal: Realtime Streaming for Astronomical Data
by: Coda, T., et al.
Published: (2024)

An Astronomers Guide to Machine Learning
by: Webb, Sara A., et al.
Published: (2023)

Deep-TAO: The Deep Learning Transient Astronomical Object data set for Astronomical Transient Event Classification
by: Suárez-Pérez, John F., et al.
Published: (2025)

radio-llava: Advancing Vision-Language Models for Radio Astronomical Source Analysis
by: Riggi, S., et al.
Published: (2025)

ATAT: Astronomical Transformer for time series And Tabular data
by: Cabrera-Vives, G., et al.
Published: (2024)

Astronomical images sonification: inclusion or outreach?
by: Casado, Johanna, et al.
Published: (2024)

ATCAT: Astronomical Timeseries CAusal Transformer
by: Tung, Zora
Published: (2025)

TRIPP: A General Purpose Data Pipeline for Astronomical Image Processing
by: Thomas, Alex, et al.
Published: (2025)

AstroAlertBench: Evaluating the Accuracy, Reasoning, and Honesty of Multimodal LLMs in Astronomical Classification
by: Chen, Claire, et al.
Published: (2026)

The Extended Atlas of Low-resolution Spectra from the Infrared Astronomical Satellite
by: Sloan, G. C., et al.
Published: (2025)

Gender equality activities in Astronomical Society of Japan
by: Bamba, Aya, et al.
Published: (2026)

An Introduction to Single-Antenna Radio Astronomical Polarimetry
by: van Straten, Willem
Published: (2022)

Leveraging Transfer Learning for Astronomical Image Analysis
by: Cavuoti, Stefano, et al.
Published: (2024)

Astronomical Optical Interferometry from the Lunar Surface
by: van Belle, Gerard, et al.
Published: (2025)

Machine Learning Assisted NEO Discovery and Polarimetric Characterisation with Astronomical Surveys
by: Kleijn, G. A. Verdoes, et al.
Published: (2026)

Learning Transferable Latent User Preferences for Human-Aligned Decision Making
by: Hyk, Alina, et al.
Published: (2026)

Evaluation of Provenance Serialisations for Astronomical Provenance
by: Johnson, Michael A. C., et al.
Published: (2024)

AstroLLaMA-Chat: Scaling AstroLLaMA with Conversational and Diverse Datasets
by: Perkowski, Ernest, et al.
Published: (2024)

Searching for Fast Astronomical Transients in Archival Photographic Plates
by: Busko, Ivo
Published: (2026)

Forced Measurement of Astronomical Sources at Low Signal to Noise
by: Dutta, Anirban, et al.
Published: (2024)

Six Maxims of Statistical Acumen for Astronomical Data Analysis
by: Tak, Hyungsuk, et al.
Published: (2024)

Diving deep into the Milky Way using Anti-Reflection Coatings for Astronomical CCDs
by: Aggarwal, Anmol, et al.
Published: (2025)

The Astronomical Plate Digitization at SHAO
by: Yu, Yong, et al.
Published: (2025)

Pathway to Devasthal Astronomical Observatory, ARIES
by: Sagar, Ram, et al.
Published: (2023)

Controlled Generation for Private Synthetic Text
by: Zhao, Zihao, et al.
Published: (2025)

Toward Vision-Language Assistants for Radio Astronomical Source Analysis
by: Riggi, S.
Published: (2026)