Imagen de Portada

The Structured Output Benchmark: A Multi-Source Benchmark for Evaluating Structured Output Quality in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Singh, Abhinav Kumar, Khurdula, Harsha Vardhan, Khemlani, Yoeven D, Agarwal, Vineet
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Interfaze: The Future of AI is built on Task-Specific Small Models
por: Khurdula, Harsha Vardhan, et al.
Publicado: (2026)

JSONSchemaBench: A Rigorous Benchmark of Structured Outputs for Language Models
por: Geng, Saibo, et al.
Publicado: (2025)

SLOT: Structuring the Output of Large Language Models
por: Wang, Darren Yow-Bang, et al.
Publicado: (2025)

StructEval: Benchmarking LLMs' Capabilities to Generate Structural Outputs
por: Yang, Jialin, et al.
Publicado: (2025)

Safe Inputs but Unsafe Output: Benchmarking Cross-modality Safety Alignment of Large Vision-Language Model
por: Wang, Siyin, et al.
Publicado: (2024)

The Outputs of Large Language Models are Meaningless
por: Hattiangadi, Anandi, et al.
Publicado: (2025)

Beyond Visual Understanding: Introducing PARROT-360V for Vision Language Model Benchmarking
por: Khurdula, Harsha Vardhan, et al.
Publicado: (2024)

StruEdit: Structured Outputs Enable the Fast and Accurate Knowledge Editing for Large Language Models
por: Bi, Baolong, et al.
Publicado: (2024)

An Evaluation on Large Language Model Outputs: Discourse and Memorization
por: de Wynter, Adrian, et al.
Publicado: (2023)

Can LLMs Narrate Tabular Data? An Evaluation Framework for Natural Language Representations of Text-to-SQL System Outputs
por: Singh, Jyotika, et al.
Publicado: (2025)

From Architecture to Output: Structural Origins of Hallucination in Large Language Models and the Amplifying Role of Data
por: Sadi, Md. Rejaul Korim Sadi, et al.
Publicado: (2026)

GAUSS: Benchmarking Structured Mathematical Skills for Large Language Models
por: Zhang, Yue, et al.
Publicado: (2025)

STED and Consistency Scoring: A Framework for Evaluating LLM Structured Output Reliability
por: Wang, Guanghui, et al.
Publicado: (2025)

Output Scouting: Auditing Large Language Models for Catastrophic Responses
por: Bell, Andrew, et al.
Publicado: (2024)

What Is Missing: Interpretable Ratings for Large Language Model Outputs
por: Stranges, Nicholas, et al.
Publicado: (2026)

Convergence of Outputs When Two Large Language Models Interact in a Multi-Agentic Setup
por: Maiti, Aniruddha, et al.
Publicado: (2025)

Structured Outputs Enable General-Purpose LLMs to be Medical Experts
por: Guo, Guangfu, et al.
Publicado: (2025)

AccessEval: Benchmarking Disability Bias in Large Language Models
por: Panda, Srikant, et al.
Publicado: (2025)

Ensuring Safe and High-Quality Outputs: A Guideline Library Approach for Language Models
por: Luo, Yi, et al.
Publicado: (2024)

LogicSkills: A Structured Benchmark for Formal Reasoning in Large Language Models
por: Rabern, Brian, et al.
Publicado: (2026)

When Correct Isn't Usable: Improving Structured Output Reliability in Small Language Models
por: Galeone, Cosimo, et al.
Publicado: (2026)

SO-Bench: A Structural Output Evaluation of Multimodal LLMs
por: Feng, Di, et al.
Publicado: (2025)

Detoxification of Large Language Models through Output-layer Fusion with a Calibration Model
por: Tian, Yuanhe, et al.
Publicado: (2025)

Benchmarking Automatic Speech Recognition for Indian Languages in Agricultural Contexts
por: S, Chandrashekar M, et al.
Publicado: (2026)

Evaluating the Performance of Large Language Models on GAOKAO Benchmark
por: Zhang, Xiaotian, et al.
Publicado: (2023)

Meaning Typed Prompting: A Technique for Efficient, Reliable Structured Output Generation
por: Irugalbandara, Chandra
Publicado: (2024)

DecMetrics: Structured Claim Decomposition Scoring for Factually Consistent LLM Outputs
por: Huang, Minghui
Publicado: (2025)

Structure Liberates: How Constrained Sensemaking Produces More Novel Research Output
por: Mooney, James, et al.
Publicado: (2026)

Benchmarking Open-Source Large Language Models on Healthcare Text Classification Tasks
por: Guo, Yuting, et al.
Publicado: (2025)

Group-Aware Reinforcement Learning for Output Diversity in Large Language Models
por: Anschel, Oron, et al.
Publicado: (2025)

IndicMMLU-Pro: Benchmarking Indic Large Language Models on Multi-Task Language Understanding
por: KJ, Sankalp, et al.
Publicado: (2025)

Phase Transitions in the Output Distribution of Large Language Models
por: Arnold, Julian, et al.
Publicado: (2024)

Mind the Gap: Conformative Decoding to Improve Output Diversity of Instruction-Tuned Large Language Models
por: Peeperkorn, Max, et al.
Publicado: (2025)

Benchmarking Multi-National Value Alignment for Large Language Models
por: Shi, Weijie, et al.
Publicado: (2025)

Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translation
por: Huang, Xu, et al.
Publicado: (2024)

DynamicRAG: Leveraging Outputs of Large Language Model as Feedback for Dynamic Reranking in Retrieval-Augmented Generation
por: Sun, Jiashuo, et al.
Publicado: (2025)

LTLBench: Towards Benchmarks for Evaluating Temporal Reasoning in Large Language Models
por: Tang, Weizhi, et al.
Publicado: (2024)

TurkBench: A Benchmark for Evaluating Turkish Large Language Models
por: Toraman, Çağrı, et al.
Publicado: (2026)

FLEX: A Benchmark for Evaluating Robustness of Fairness in Large Language Models
por: Jung, Dahyun, et al.
Publicado: (2025)

EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models
por: Chen, Yuyan, et al.
Publicado: (2024)