Cover Image

AstroMMBench: A Benchmark for Evaluating Multimodal Large Language Models Capabilities in Astronomy

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shi, Jinghang, Tang, Xiaoyu, Huang, Yang, Li, Yuyang, Kong, Xiao, Zhang, Yanxia, Yue, Caizhan
Format:	Preprint
Published:	2025
Subjects:	Instrumentation and Methods for Astrophysics Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AstroPT: Scaling Large Observation Models for Astronomy
by: Smith, Michael J., et al.
Published: (2024)

AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy
by: Pan, Rui, et al.
Published: (2024)

A Catalogue of Mid-infrared Variable Sources from unTimely
by: kang, Zihan, et al.
Published: (2025)

AstroMLab 3: Achieving GPT-4o Level Performance in Astronomy with a Specialized 8B-Parameter Large Language Model
by: de Haan, Tijmen, et al.
Published: (2024)

Astro-COLIBRI: Empowering Citizen Scientists in Time Domain Astronomy
by: Schüssler, Fabian, et al.
Published: (2024)

OntoPortal-Astro, a Semantic Artefact Catalogue for Astronomy
by: Cecconi, Baptiste, et al.
Published: (2025)

AstroVisBench: A Code Benchmark for Scientific Computing and Visualization in Astronomy
by: Joseph, Sebastian Antony, et al.
Published: (2025)

AstroMLab 4: Benchmark-Topping Performance in Astronomy Q&A with a 70B-Parameter Domain-Specialized Reasoning Model
by: de Haan, Tijmen, et al.
Published: (2025)

Large Projects in Astronomy: An Indian Endeavour
by: Wadadekar, Yogesh, et al.
Published: (2024)

AstroAlertBench: Evaluating the Accuracy, Reasoning, and Honesty of Multimodal LLMs in Astronomical Classification
by: Chen, Claire, et al.
Published: (2026)

AstroMLab 1: Who Wins Astronomy Jeopardy!?
by: Ting, Yuan-Sen, et al.
Published: (2024)

Large-scale Array for Radio Astronomy on the Farside
by: Chen, Xuelei, et al.
Published: (2024)

Deeper Learning in Astronomy
by: Scott, Douglas, et al.
Published: (2024)

Montage and Radio Astronomy
by: Berriman, G. Bruce, et al.
Published: (2024)

What is the Role of Large Language Models in the Evolution of Astronomy Research?
by: Fouesneau, Morgan, et al.
Published: (2024)

Evaluation of gamma-ray response of the AstroPix4 HV-CMOS active pixel sensor
by: Suda, Yusuke, et al.
Published: (2025)

Workforce Development in Astronomy and Astroinformatics
by: Sheth, Kartik, et al.
Published: (2024)

Regional and Global Collaborations in Astronomy
by: Sekiguchi, Kazuhiro, et al.
Published: (2024)

Performance of the Segment Anything Model in Various RFI/Events Detection in Radio Astronomy
by: Yang, Yanbin, et al.
Published: (2024)

Monitoring and Evaluating Astronomy-for-Development Initiatives
by: Mdhluli, Joyful E.
Published: (2025)

Photometric redshift estimation for emission line galaxies of DESI Legacy Imaging Surveys by CNN-MLP
by: Wei, Shirui, et al.
Published: (2025)

US Adaptive Optics Roadmap to Achieve Astro2020
by: Christou, Julian, et al.
Published: (2024)

Characterization of the Teledyne COSMOS Camera: A Large Format CMOS Image Sensor for Astronomy
by: Layden, Christopher, et al.
Published: (2025)

Surveying Image Segmentation Approaches in Astronomy
by: Xu, Duo, et al.
Published: (2024)

The Office of Astronomy for Development Impact Cycle
by: Mdhluli, Joyful E.
Published: (2025)

FAIR approach for Low Frequency Radio Astronomy
by: Cecconi, Baptiste
Published: (2024)

An Optical Daytime Astronomy Pathfinder for the Huntsman Telescope
by: Caddy, Sarah Elizabeth, et al.
Published: (2024)

Astronomy Open Science Competence Centre in Europe
by: Molinaro, Marco, et al.
Published: (2026)

The UK Submillimetre and Millimetre Astronomy Roadmap 2024
by: Pattle, K., et al.
Published: (2024)

Teaching Astronomy with Large Language Models
by: Ting, Yuan-Sen, et al.
Published: (2025)

Synthesizer: Synthetic Observables For Modern Astronomy
by: Roper, Will J., et al.
Published: (2025)

A-STEP: The AstroPix Sounding Rocket Technology Demonstration Payload
by: Violette, Daniel P., et al.
Published: (2024)

Astro-MoE: Mixture of Experts for Multiband Astronomical Time Series
by: Cádiz-Leyton, Martina, et al.
Published: (2025)

Experiences of Commercial Supercomputing in Radio Astronomy Data Processing
by: Kemp, Ian, et al.
Published: (2025)

AstroPix: A Pixelated HVCMOS Sensor for Space-Based Gamma-Ray Measurement
by: Steinhebel, Amanda L., et al.
Published: (2025)

Detection and classification of astronomical sources with Astro-RetinaNet in crowded stellar fields
by: Yan, Yibo, et al.
Published: (2026)

Polarimetry in Planetary Sciences and Astronomy
by: Patty, C. H. Lucas, et al.
Published: (2026)

The Ghana Radio Astronomy Observatory
by: Proven-Adzri, Emmanuel, et al.
Published: (2026)

Development and Potential of new Micro-Mirror Devices Optimized for Astronomy
by: Robberto, Massimo, et al.
Published: (2025)

Stratospheric Balloon Payloads for Astronomy: the challenge of coping with rising complexity
by: Picouet, Vincent
Published: (2025)