Cover Image

Designing an Evaluation Framework for Large Language Models in Astronomy Research

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, John F., Hyk, Alina, McCormick, Kiera, Ye, Christine, Astarita, Simone, Baral, Elina, Ciuca, Jo, Cranney, Jesse, Field, Anjalie, Iyer, Kartheik, Koehn, Philipp, Kotler, Jenn, Kruk, Sandor, Ntampaka, Michelle, O'Neill, Charles, Peek, Joshua E. G., Sharma, Sanjib, Yunus, Mikaeel
Format:	Preprint
Published:	2024
Subjects:	Instrumentation and Methods for Astrophysics Artificial Intelligence Human-Computer Interaction Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Queries to Criteria: Understanding How Astronomers Evaluate LLMs
by: Hyk, Alina, et al.
Published: (2025)

pathfinder: A Semantic Framework for Literature Review and Knowledge Discovery in Astronomy
by: Iyer, Kartheik G., et al.
Published: (2024)

Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomy
by: Astarita, Simone, et al.
Published: (2024)

Encoding and Understanding Astrophysical Information in Large Language Model-Generated Summaries
by: McCormick, Kiera, et al.
Published: (2025)

Controlled Generation for Private Synthetic Text
by: Zhao, Zihao, et al.
Published: (2025)

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters
by: Ntampaka, Michelle, et al.
Published: (2025)

What Makes a Good Response? An Empirical Analysis of Quality in Qualitative Interviews
by: Ivey, Jonathan, et al.
Published: (2026)

Does Local News Stay Local?: Online Content Shifts in Sinclair-Acquired Stations
by: Wanner, Miriam, et al.
Published: (2025)

The Effect of Document Selection on Query-focused Text Analysis
by: Rangreji, Sandesh S, et al.
Published: (2026)

HICode: Hierarchical Inductive Coding with LLMs
by: Zhong, Mian, et al.
Published: (2025)

Improving Posterior Inference of Galaxy Properties with Image-Based Conditional Flow Matching
by: Yunus, Mikaeel, et al.
Published: (2025)

A Survey on Hypothesis Generation for Scientific Discovery in the Era of Large Language Models
by: Alkan, Atilla Kaan, et al.
Published: (2025)

AstroLLaMA-Chat: Scaling AstroLLaMA with Conversational and Diverse Datasets
by: Perkowski, Ernest, et al.
Published: (2024)

Disentangling Dense Embeddings with Sparse Autoencoders
by: O'Neill, Charles, et al.
Published: (2024)

An Overview of Bartnik's Quasi-Local Mass
by: McCormick, Stephen
Published: (2024)

Mass, Staticity, and a Riemannian Penrose Inequality for Weighted Manifolds
by: McCormick, Stephen
Published: (2026)

V-static metrics and the volume-renormalised mass
by: McCormick, Stephen
Published: (2024)

A Ghost Lemma for Commutative Ring Homomorphisms via André-Quillen Homology
by: McCormick, Daniel
Published: (2025)

Felícita "La Prieta" Méndez (1916-1998) and the end of Latino school segregation in California
by: Jennifer McCormick
Published: (2007)

The "Plagiario" and the Professor in Our Peculiar Institution.
by: McCormick, Frank
Published: (1989)

Ethnic Studies Materials for School Libraries: How to Choose and Use Them.
by: McCormick, Regina
Published: (1980)

Reseña de "William Petty and the ambitions of political arithmetic" de Shapin, Steven.
by: Ted McCormick
Published: (2012)

EL FUTURO DE LOS CLUSTERS Y LAS CADENAS PRODUCTIVAS
by: David McCormick
Published: (2005)

Estimating the triaxiality of massive clusters from 2D observables in MillenniumTNG with machine learning
by: Delgado, Ana Maria, et al.
Published: (2025)

How do we measure privacy in text? A survey of text anonymization metrics
by: Ren, Yaxuan, et al.
Published: (2025)

Unrequited Emotions: Investigating the Gaps in Motivation and Practice in Speech Emotion Recognition Research
by: Wong, Taryn, et al.
Published: (2026)

AdaProb: Efficient Machine Unlearning via Adaptive Probability
by: Zhao, Zihao, et al.
Published: (2024)

Learning Transferable Latent User Preferences for Human-Aligned Decision Making
by: Hyk, Alina, et al.
Published: (2026)

Theodor Storm’s Novellen
by: McCormick, E. Allen
Published: (2020)

Detecting Metastable Basins in High Dimensions via Marginal Trajectory Distribution Discrimination
by: Jones-McCormick, Taj
Published: (2026)

We Are Pregnant with Freedom
by: Selmon McCormick, Stacie
Published: (2025)

Elements of oceanography / J. Michael McCormick, John V. Thiruvathukal
by: McCormick, J. Michael
Published: (1976)

Physiological and hormonal differences among Atlantic salmon parr and smolts reared in the wild, and hatchery smolts / Stephen D. Mccormick
by: McCormick, Stephen D
Published: (1994)

Ten Summer Rejuvenators for School Counselors.
by: McCormick, John F.
Published: (1998)

Publishing at ALA: The Quest for Success.
by: McCormick, Edith J.
Published: (1984)

A virtual Environment: Exploring the Brain Forest
by: Bruce H. McCormick
Published: (1997)

Jacques Le Goff, ¿Realmente es necesario cortar la historia en rebanadas?, traducción al castellano de Yenny Enríquez, México, Fondo de Cultura Económica, 2016, 109 pp. ISBN 978- 607-164-257-8
by: Carlos Astarita
Published: (2017)

Sobre Umberto Eco (coord.), La Edad Media. II. Catedrales, caballeros y ciudades
by: Carlos Astarita
Published: (2021)

Sobre Umberto Eco (coord.), La Edad Media, III. Castillos, mercaderes y poetas
by: Carlos Astarita
Published: (2021)

La transición democrática española y el medievalismo.Una visión desde la periferia
by: Carlos Astarita
Published: (2022)