Cover Image

Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Yujian, Chang, Shiyu, Jaakkola, Tommi, Zhang, Yang
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective
by: Liu, Yujian, et al.
Published: (2024)

HarnessLLM: Automatic Testing Harness Generation via Reinforcement Learning
by: Liu, Yujian, et al.
Published: (2025)

How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings
by: Liu, Yujian, et al.
Published: (2026)

Correcting Diffusion Generation through Resampling
by: Liu, Yujian, et al.
Published: (2023)

Defending LLM Watermarking Against Spoofing Attacks with Contrastive Representation Learning
by: An, Li, et al.
Published: (2025)

Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentation
by: Chen, Xiangyan, et al.
Published: (2025)

ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning
by: Hou, Bairu, et al.
Published: (2025)

The Curious Case of Factuality Finetuning: Models' Internal Beliefs Can Improve Factuality
by: Newman, Benjamin, et al.
Published: (2025)

Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference
by: Ji, Jiabao, et al.
Published: (2024)

Is Factuality Enhancement a Free Lunch For LLMs? Better Factuality Can Lead to Worse Context-Faithfulness
by: Bi, Baolong, et al.
Published: (2024)

Decomposing Uncertainty for Large Language Models through Input Clarification Ensembling
by: Hou, Bairu, et al.
Published: (2023)

A Probabilistic Framework for LLM Hallucination Detection via Belief Tree Propagation
by: Hou, Bairu, et al.
Published: (2024)

Next Semantic Scale Prediction via Hierarchical Diffusion Language Models
by: Zhou, Cai, et al.
Published: (2025)

Augment before You Try: Knowledge-Enhanced Table Question Answering via Table Expansion
by: Liu, Yujian, et al.
Published: (2024)

InFact: Informativeness Alignment for Improved LLM Factuality
by: Cohen, Roi, et al.
Published: (2025)

How Long Reasoning Chains Influence LLMs' Judgment of Answer Factuality
by: Tu, Minzhu, et al.
Published: (2026)

Improving Factuality with Explicit Working Memory
by: Chen, Mingda, et al.
Published: (2024)

Improving Factuality in Large Language Models via Decoding-Time Hallucinatory and Truthful Comparators
by: Yang, Dingkang, et al.
Published: (2024)

Improving Factual Error Correction for Abstractive Summarization via Data Distillation and Conditional-generation Cloze
by: Li, Yiyang, et al.
Published: (2024)

From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMs
by: Gong, Xuan, et al.
Published: (2025)

Think Through Uncertainty: Improving Long-Form Generation Factuality via Reasoning Calibration
by: Liu, Xin, et al.
Published: (2026)

Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge
by: Cui, Xinyue, et al.
Published: (2025)

Improving Factuality in LLMs via Inference-Time Knowledge Graph Construction
by: Wu, Shanglin, et al.
Published: (2025)

Improving LLMs' Learning for Coreference Resolution
by: Gan, Yujian, et al.
Published: (2025)

ART: Attention Replacement Technique to Improve Factuality in LLMs
by: Luo, Ziqin, et al.
Published: (2026)

TOFU: A Task of Fictitious Unlearning for LLMs
by: Maini, Pratyush, et al.
Published: (2024)

Integrative Decoding: Improve Factuality via Implicit Self-consistency
by: Cheng, Yi, et al.
Published: (2024)

Learning to Reason for Factuality
by: Chen, Xilun, et al.
Published: (2025)

SIFiD: Reassess Summary Factual Inconsistency Detection with LLM
by: Yang, Jiuding, et al.
Published: (2024)

Best Practices and Lessons Learned on Synthetic Data
by: Liu, Ruibo, et al.
Published: (2024)

Identifying Factual Inconsistencies in Summaries: Grounding LLM Inference via Task Taxonomy
by: Xu, Liyan, et al.
Published: (2024)

Improving Model Factuality with Fine-grained Critique-based Evaluator
by: Xie, Yiqing, et al.
Published: (2024)

JointCQ: Improving Factual Hallucination Detection with Joint Claim and Query Generation
by: Xu, Fan, et al.
Published: (2025)

Learning to Generate Answers with Citations via Factual Consistency Models
by: Aly, Rami, et al.
Published: (2024)

Reducing Hallucinations in LLMs via Factuality-Aware Preference Learning
by: Chaduvula, Sindhuja, et al.
Published: (2026)

Improving Academic Skills Assessment with NLP and Ensemble Learning
by: Huang, Xinyi, et al.
Published: (2024)

UniArk: Improving Generalisation and Consistency for Factual Knowledge Extraction through Debiasing
by: Yang, Yijun, et al.
Published: (2024)

Atomic Skills are the Prerequisite: When Reinforcement Learning Synthesizes Compositional Reasoning, and When It Only Amplifies
by: Cheng, Sitao, et al.
Published: (2025)

LEAPS: A discrete neural sampler via locally equivariant networks
by: Holderrieth, Peter, et al.
Published: (2025)

Re-Ex: Revising after Explanation Reduces the Factual Errors in LLM Responses
by: Kim, Juyeon, et al.
Published: (2024)