Cover Image

PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	You, Zhiwen, Guo, Yue
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

APPLS: Evaluating Evaluation Metrics for Plain Language Summarization
by: Guo, Yue, et al.
Published: (2023)

FactPICO: Factuality Evaluation for Plain Language Summarization of Medical Evidence
by: Joseph, Sebastian Antony, et al.
Published: (2024)

mFACE: Multilingual Summarization with Factual Consistency Evaluation
by: Aharoni, Roee, et al.
Published: (2022)

Stress Testing Factual Consistency Metrics for Long-Document Summarization
by: Mujahid, Zain Muhammad, et al.
Published: (2025)

Fine-grained and Explainable Factuality Evaluation for Multimodal Summarization
by: Zhang, Yue, et al.
Published: (2024)

BanglaSummEval: Reference-Free Factual Consistency Evaluation for Bangla Summarization
by: Rafid, Ahmed, et al.
Published: (2026)

Adapting Biomedical Abstracts into Plain language using Large Language Models
by: Gangavarapu, Haritha, et al.
Published: (2025)

Improving Factual Consistency of News Summarization by Contrastive Preference Optimization
by: Feng, Huawen, et al.
Published: (2023)

SummExecEdit: A Factual Consistency Benchmark in Summarization with Executable Edits
by: Thorat, Onkar, et al.
Published: (2024)

ReFEree: Reference-Free and Fine-Grained Method for Evaluating Factual Consistency in Real-World Code Summarization
by: Bae, Suyoung, et al.
Published: (2026)

Enhancing Factuality through Consensus and Consistency in Summarization Using Minimum Bayes Risk Decoding
by: Soetedjo, Riza Setiawan, et al.
Published: (2026)

Lessons from the TREC Plain Language Adaptation of Biomedical Abstracts (PLABA) track
by: Ondov, Brian, et al.
Published: (2025)

Face4RAG: Factual Consistency Evaluation for Retrieval Augmented Generation in Chinese
by: Xu, Yunqi, et al.
Published: (2024)

Using Similarity to Evaluate Factual Consistency in Summaries
by: Ye, Yuxuan, et al.
Published: (2024)

Do Automatic Factuality Metrics Measure Factuality? A Critical Evaluation
by: Ramprasad, Sanjana, et al.
Published: (2024)

RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering
by: Liang, Sichu, et al.
Published: (2025)

An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation
by: Mahapatra, Joy, et al.
Published: (2024)

Estimating Optimal Context Length for Hybrid Retrieval-augmented Multi-document Summarization
by: Pratapa, Adithya, et al.
Published: (2025)

Agent-as-Judge for Factual Summarization of Long Narratives
by: Jeong, Yeonseok, et al.
Published: (2025)

ISQA: Informative Factuality Feedback for Scientific Summarization
by: Li, Zekai, et al.
Published: (2024)

AMRFact: Enhancing Summarization Factuality Evaluation with AMR-Driven Negative Samples Generation
by: Qiu, Haoyi, et al.
Published: (2023)

Discourse-Driven Evaluation: Unveiling Factual Inconsistency in Long Document Summarization
by: Zhong, Yang, et al.
Published: (2025)

CASPR: Automated Evaluation Metric for Contrastive Summarization
by: Ananthamurugan, Nirupan, et al.
Published: (2024)

Calibrating Model-Based Evaluation Metrics for Summarization
by: Liu, Hongye, et al.
Published: (2026)

DecMetrics: Structured Claim Decomposition Scoring for Factually Consistent LLM Outputs
by: Huang, Minghui
Published: (2025)

AlignCheck: a Semantic Open-Domain Metric for Factual Consistency Assessment
by: Aghaebrahimian, Ahmad
Published: (2025)

Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains
by: Ramprasad, Sanjana, et al.
Published: (2024)

Factual Consistency of Multilingual Pretrained Language Models
by: Fierro, Constanza, et al.
Published: (2022)

Retrieval augmentation of large language models for lay language generation
by: Guo, Yue, et al.
Published: (2022)

Exploring the Factual Consistency in Dialogue Comprehension of Large Language Models
by: She, Shuaijie, et al.
Published: (2023)

Zero-shot Factual Consistency Evaluation Across Domains
by: Agarwal, Raunak
Published: (2024)

SciPrompt: Knowledge-augmented Prompting for Fine-grained Categorization of Scientific Topics
by: You, Zhiwen, et al.
Published: (2024)

Knowledge-augmented Pre-trained Language Models for Biomedical Relation Extraction
by: Sänger, Mario, et al.
Published: (2025)

ReLay: Personalized LLM-Generated Plain-Language Summaries for Better Understanding, but at What Cost?
by: Chan, Joey, et al.
Published: (2026)

Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages
by: Yari, Amir Hossein, et al.
Published: (2025)

Temporally Consistent Factuality Probing for Large Language Models
by: Bajpai, Ashutosh, et al.
Published: (2024)

Rethinking Scientific Summarization Evaluation: Grounding Explainable Metrics on Facet-aware Benchmark
by: Chen, Xiuying, et al.
Published: (2024)

Grounded Visual Factualization: Factual Anchor-Based Finetuning for Enhancing MLLM Factual Consistency
by: Morbiato, Filippo, et al.
Published: (2025)

Prompt-Based Simplification for Plain Language using Spanish Language Models
by: Moreno, Lourdes, et al.
Published: (2025)

CLR-Fact: Evaluating the Complex Logical Reasoning Capability of Large Language Models over Factual Knowledge
by: Zheng, Tianshi, et al.
Published: (2024)