SummExecEdit: A Factual Consistency Benchmark in Summarization with Executable Edits
Fuente:
arXiv
Saved in:
| Main Authors: | Thorat, Onkar, Laban, Philippe, Wu, Chien-Sheng |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Edits
by: Chakrabarty, Tuhin, et al.
Published: (2024)
by: Chakrabarty, Tuhin, et al.
Published: (2024)
AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computation
by: Chakrabarty, Tuhin, et al.
Published: (2025)
by: Chakrabarty, Tuhin, et al.
Published: (2025)
BanglaSummEval: Reference-Free Factual Consistency Evaluation for Bangla Summarization
by: Rafid, Ahmed, et al.
Published: (2026)
by: Rafid, Ahmed, et al.
Published: (2026)
SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization
by: Mishra, Prakamya, et al.
Published: (2024)
by: Mishra, Prakamya, et al.
Published: (2024)
EditPropBench: Measuring Factual Edit Propagation in Scientific Manuscripts
by: Kruthof, Garvin
Published: (2026)
by: Kruthof, Garvin
Published: (2026)
Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articles
by: Huang, Kung-Hsiang, et al.
Published: (2023)
by: Huang, Kung-Hsiang, et al.
Published: (2023)
ReflectSumm: A Benchmark for Course Reflection Summarization
by: Zhong, Yang, et al.
Published: (2024)
by: Zhong, Yang, et al.
Published: (2024)
Search Engines in an AI Era: The False Promise of Factual and Verifiable Source-Cited Responses
by: Venkit, Pranav Narayanan, et al.
Published: (2024)
by: Venkit, Pranav Narayanan, et al.
Published: (2024)
Improving Summarization with Human Edits
by: Yao, Zonghai, et al.
Published: (2023)
by: Yao, Zonghai, et al.
Published: (2023)
Edisum: Summarizing and Explaining Wikipedia Edits at Scale
by: Šakota, Marija, et al.
Published: (2024)
by: Šakota, Marija, et al.
Published: (2024)
PreSumm: Predicting Summarization Performance Without Summarizing
by: Koniaev, Steven, et al.
Published: (2025)
by: Koniaev, Steven, et al.
Published: (2025)
LexSumm and LexT5: Benchmarking and Modeling Legal Summarization Tasks in English
by: Santosh, T. Y. S. S., et al.
Published: (2024)
by: Santosh, T. Y. S. S., et al.
Published: (2024)
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems
by: Laban, Philippe, et al.
Published: (2024)
by: Laban, Philippe, et al.
Published: (2024)
Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experiment
by: Laban, Philippe, et al.
Published: (2023)
by: Laban, Philippe, et al.
Published: (2023)
ExecRepoBench: Multi-level Executable Code Completion Evaluation
by: Yang, Jian, et al.
Published: (2024)
by: Yang, Jian, et al.
Published: (2024)
mFACE: Multilingual Summarization with Factual Consistency Evaluation
by: Aharoni, Roee, et al.
Published: (2022)
by: Aharoni, Roee, et al.
Published: (2022)
Factual and Edit-Sensitive Graph-to-Sequence Generation via Graph-Aware Adaptive Noising
by: Shahane, Aditya Hemant, et al.
Published: (2026)
by: Shahane, Aditya Hemant, et al.
Published: (2026)
LexAbSumm: Aspect-based Summarization of Legal Decisions
by: Santosh, T. Y. S. S, et al.
Published: (2024)
by: Santosh, T. Y. S. S, et al.
Published: (2024)
AdvSumm: Adversarial Training for Bias Mitigation in Text Summarization
by: Gupta, Mukur, et al.
Published: (2025)
by: Gupta, Mukur, et al.
Published: (2025)
Improving Factual Consistency of News Summarization by Contrastive Preference Optimization
by: Feng, Huawen, et al.
Published: (2023)
by: Feng, Huawen, et al.
Published: (2023)
AnyEdit: Edit Any Knowledge Encoded in Language Models
by: Jiang, Houcheng, et al.
Published: (2025)
by: Jiang, Houcheng, et al.
Published: (2025)
ThreadSumm: Summarization of Nested Discourse Threads Using Tree of Thoughts
by: Olabisi, Olubusayo, et al.
Published: (2026)
by: Olabisi, Olubusayo, et al.
Published: (2026)
Vec2Summ: Text Summarization via Probabilistic Sentence Embeddings
by: Li, Mao, et al.
Published: (2025)
by: Li, Mao, et al.
Published: (2025)
EquiSumm : A Gender Bias-Aware Framework for Inclusive Tweet Summarization
by: Wanjari, Chaitanya, et al.
Published: (2026)
by: Wanjari, Chaitanya, et al.
Published: (2026)
How Well Can Knowledge Edit Methods Edit Perplexing Knowledge?
by: Ge, Huaizhi, et al.
Published: (2024)
by: Ge, Huaizhi, et al.
Published: (2024)
Do RAG Systems Cover What Matters? Evaluating and Optimizing Responses with Sub-Question Coverage
by: Xie, Kaige, et al.
Published: (2024)
by: Xie, Kaige, et al.
Published: (2024)
Art or Artifice? Large Language Models and the False Promise of Creativity
by: Chakrabarty, Tuhin, et al.
Published: (2023)
by: Chakrabarty, Tuhin, et al.
Published: (2023)
GlobeSumm: A Challenging Benchmark Towards Unifying Multi-lingual, Cross-lingual and Multi-document News Summarization
by: Ye, Yangfan, et al.
Published: (2024)
by: Ye, Yangfan, et al.
Published: (2024)
CitiLink-Summ: Summarization of Discussion Subjects in European Portuguese Municipal Meeting Minutes
by: Marques, Miguel, et al.
Published: (2026)
by: Marques, Miguel, et al.
Published: (2026)
Stress Testing Factual Consistency Metrics for Long-Document Summarization
by: Mujahid, Zain Muhammad, et al.
Published: (2025)
by: Mujahid, Zain Muhammad, et al.
Published: (2025)
Tracing and Reversing Edits in LLMs
by: Youssef, Paul, et al.
Published: (2025)
by: Youssef, Paul, et al.
Published: (2025)
EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correction
by: Ye, Jingheng, et al.
Published: (2024)
by: Ye, Jingheng, et al.
Published: (2024)
UniEdit: A Unified Knowledge Editing Benchmark for Large Language Models
by: Chen, Qizhou, et al.
Published: (2025)
by: Chen, Qizhou, et al.
Published: (2025)
Enhancing Factuality through Consensus and Consistency in Summarization Using Minimum Bayes Risk Decoding
by: Soetedjo, Riza Setiawan, et al.
Published: (2026)
by: Soetedjo, Riza Setiawan, et al.
Published: (2026)
SKT5SciSumm -- Revisiting Extractive-Generative Approach for Multi-Document Scientific Summarization
by: To, Huy Quoc, et al.
Published: (2024)
by: To, Huy Quoc, et al.
Published: (2024)
Overview of the BioLaySumm 2024 Shared Task on the Lay Summarization of Biomedical Research Articles
by: Goldsack, Tomas, et al.
Published: (2024)
by: Goldsack, Tomas, et al.
Published: (2024)
Learning to Edit: Aligning LLMs with Knowledge Editing
by: Jiang, Yuxin, et al.
Published: (2024)
by: Jiang, Yuxin, et al.
Published: (2024)
PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarization
by: You, Zhiwen, et al.
Published: (2025)
by: You, Zhiwen, et al.
Published: (2025)
MotionEdit: Benchmarking and Learning Motion-Centric Image Editing
by: Wan, Yixin, et al.
Published: (2025)
by: Wan, Yixin, et al.
Published: (2025)
EditGRPO: Reinforcement Learning with Post-Rollout Edits for Clinically Accurate Chest X-Ray Report Generation
by: Zhang, Kai, et al.
Published: (2025)
by: Zhang, Kai, et al.
Published: (2025)
Similar Items
-
Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Edits
by: Chakrabarty, Tuhin, et al.
Published: (2024) -
AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computation
by: Chakrabarty, Tuhin, et al.
Published: (2025) -
BanglaSummEval: Reference-Free Factual Consistency Evaluation for Bangla Summarization
by: Rafid, Ahmed, et al.
Published: (2026) -
SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization
by: Mishra, Prakamya, et al.
Published: (2024) -
EditPropBench: Measuring Factual Edit Propagation in Scientific Manuscripts
by: Kruthof, Garvin
Published: (2026)