Diagnosing Structural Failures in LLM-Based Evidence Extraction for Meta-Analysis
Fuente:
arXiv
Saved in:
| Main Authors: | Tan, Zhiyin, D'Souza, Jennifer |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models
by: Tan, Zhiyin, et al.
Published: (2025)
by: Tan, Zhiyin, et al.
Published: (2025)
Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluation
by: Tan, Zhiyin, et al.
Published: (2025)
by: Tan, Zhiyin, et al.
Published: (2025)
SemEval-2025 Task 5: LLMs4Subjects -- LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalog
by: D'Souza, Jennifer, et al.
Published: (2025)
by: D'Souza, Jennifer, et al.
Published: (2025)
Exploring the Latest LLMs for Leaderboard Extraction
by: Kabongo, Salomon, et al.
Published: (2024)
by: Kabongo, Salomon, et al.
Published: (2024)
Diagnosing Training Inference Mismatch in LLM Reinforcement Learning
by: Zhong, Tianle, et al.
Published: (2026)
by: Zhong, Tianle, et al.
Published: (2026)
De Jure: Iterative LLM Self-Refinement for Structured Extraction of Regulatory Rules
by: Guliani, Keerat, et al.
Published: (2026)
by: Guliani, Keerat, et al.
Published: (2026)
Elias in the Lighthouse, Again? Diagnosing Low Diversity in LLM Stories
by: Hamilton, Sil, et al.
Published: (2026)
by: Hamilton, Sil, et al.
Published: (2026)
Diagnosing LLM Judge Reliability: Conformal Prediction Sets and Transitivity Violations
by: Gupta, Manan, et al.
Published: (2026)
by: Gupta, Manan, et al.
Published: (2026)
What Level of Automation is "Good Enough"? A Benchmark of Large Language Models for Meta-Analysis Data Extraction
by: Li, Lingbo, et al.
Published: (2025)
by: Li, Lingbo, et al.
Published: (2025)
MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
by: Qin, Jiayu, et al.
Published: (2025)
by: Qin, Jiayu, et al.
Published: (2025)
Graphical Reasoning: LLM-based Semi-Open Relation Extraction
by: Tao, Yicheng, et al.
Published: (2024)
by: Tao, Yicheng, et al.
Published: (2024)
Extraction of Research Objectives, Machine Learning Model Names, and Dataset Names from Academic Papers and Analysis of Their Interrelationships Using LLM and Network Analysis
by: Nishio, S., et al.
Published: (2024)
by: Nishio, S., et al.
Published: (2024)
YESciEval: Robust LLM-as-a-Judge for Scientific Question Answering
by: D'Souza, Jennifer, et al.
Published: (2025)
by: D'Souza, Jennifer, et al.
Published: (2025)
Learning a Generative Meta-Model of LLM Activations
by: Luo, Grace, et al.
Published: (2026)
by: Luo, Grace, et al.
Published: (2026)
MPO: Boosting LLM Agents with Meta Plan Optimization
by: Xiong, Weimin, et al.
Published: (2025)
by: Xiong, Weimin, et al.
Published: (2025)
From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization
by: Zhou, Chenxi, et al.
Published: (2026)
by: Zhou, Chenxi, et al.
Published: (2026)
Diagnosing Medical Datasets with Training Dynamics
by: Wenderoth, Laura
Published: (2024)
by: Wenderoth, Laura
Published: (2024)
A FAIR and Free Prompt-based Research Assistant
by: Shamsabadi, Mahsa, et al.
Published: (2024)
by: Shamsabadi, Mahsa, et al.
Published: (2024)
Effective Structured Prompting by Meta-Learning and Representative Verbalizer
by: Jiang, Weisen, et al.
Published: (2023)
by: Jiang, Weisen, et al.
Published: (2023)
A Dataset for Evaluating LLM-based Evaluation Functions for Research Question Extraction Task
by: Fujisaki, Yuya, et al.
Published: (2024)
by: Fujisaki, Yuya, et al.
Published: (2024)
Student sentiment Analysis Using Classification With Feature Extraction Techniques
by: Tamrakar, Latika, et al.
Published: (2021)
by: Tamrakar, Latika, et al.
Published: (2021)
Robust LLM Unlearning with MUDMAN: Meta-Unlearning with Disruption Masking And Normalization
by: Sondej, Filip, et al.
Published: (2025)
by: Sondej, Filip, et al.
Published: (2025)
MultiSoc-4D: A Benchmark for Diagnosing Instruction-Induced Label Collapse in Closed-Set LLM Annotation of Bengali Social Media
by: Pramanik, Souvik, et al.
Published: (2026)
by: Pramanik, Souvik, et al.
Published: (2026)
Structured Extraction of Real World Medical Knowledge using LLMs for Summarization and Search
by: Kim, Edward, et al.
Published: (2024)
by: Kim, Edward, et al.
Published: (2024)
LLMSurgeon: Diagnosing Data Mixture of Large Language Models
by: Luo, Yaxin, et al.
Published: (2026)
by: Luo, Yaxin, et al.
Published: (2026)
CUPCase: Clinically Uncommon Patient Cases and Diagnoses Dataset
by: Perets, Oriel, et al.
Published: (2025)
by: Perets, Oriel, et al.
Published: (2025)
When Greedy Wins: Emergent Exploitation Bias in Meta-Bandit LLM Training
by: Chen, Sanxing, et al.
Published: (2025)
by: Chen, Sanxing, et al.
Published: (2025)
DeferMem: Query-Time Evidence Distillation via Reinforcement Learning for Long-Term Memory QA
by: Yin, Jianing, et al.
Published: (2026)
by: Yin, Jianing, et al.
Published: (2026)
From Keywords to Structured Summaries: Streamlining Scholarly Information Access
by: Shamsabadi, Mahsa, et al.
Published: (2024)
by: Shamsabadi, Mahsa, et al.
Published: (2024)
Large Language Models for Scientific Information Extraction: An Empirical Study for Virology
by: Shamsabadi, Mahsa, et al.
Published: (2024)
by: Shamsabadi, Mahsa, et al.
Published: (2024)
Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making
by: Hsu, Aliyah R., et al.
Published: (2023)
by: Hsu, Aliyah R., et al.
Published: (2023)
CliqueParcel: An Approach For Batching LLM Prompts That Jointly Optimizes Efficiency And Faithfulness
by: Liu, Jiayi, et al.
Published: (2024)
by: Liu, Jiayi, et al.
Published: (2024)
GPT-3 Powered Information Extraction for Building Robust Knowledge Bases
by: Choudhury, Ritabrata Roy, et al.
Published: (2024)
by: Choudhury, Ritabrata Roy, et al.
Published: (2024)
From Rubrics to Reliable Scores: Evidence-Grounded Text Evaluation with LLM Judges
by: Hong, Yihan, et al.
Published: (2026)
by: Hong, Yihan, et al.
Published: (2026)
Symbolic Prompt Program Search: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization
by: Schnabel, Tobias, et al.
Published: (2024)
by: Schnabel, Tobias, et al.
Published: (2024)
Method-Based Reasoning for Large Language Models: Extraction, Reuse, and Continuous Improvement
by: Su, Hong
Published: (2025)
by: Su, Hong
Published: (2025)
AgentCollabBench: Diagnosing When Good Agents Make Bad Collaborators
by: Mazumder, Aritra, et al.
Published: (2026)
by: Mazumder, Aritra, et al.
Published: (2026)
The Model Agreed, But Didn't Learn: Diagnosing Surface Compliance in Large Language Models
by: Gu, Xiaojie, et al.
Published: (2026)
by: Gu, Xiaojie, et al.
Published: (2026)
Model Medicine: A Clinical Framework for Understanding, Diagnosing, and Treating AI Models
by: Jeong, Jihoon
Published: (2026)
by: Jeong, Jihoon
Published: (2026)
Graph Neural Network-Based Entity Extraction and Relationship Reasoning in Complex Knowledge Graphs
by: Du, Junliang, et al.
Published: (2024)
by: Du, Junliang, et al.
Published: (2024)
Similar Items
-
Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models
by: Tan, Zhiyin, et al.
Published: (2025) -
Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluation
by: Tan, Zhiyin, et al.
Published: (2025) -
SemEval-2025 Task 5: LLMs4Subjects -- LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalog
by: D'Souza, Jennifer, et al.
Published: (2025) -
Exploring the Latest LLMs for Leaderboard Extraction
by: Kabongo, Salomon, et al.
Published: (2024) -
Diagnosing Training Inference Mismatch in LLM Reinforcement Learning
by: Zhong, Tianle, et al.
Published: (2026)