Image de couverture de livre

Alternate Preference Optimization for Unlearning Factual Knowledge in Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Mekala, Anmol, Dorna, Vineeth, Dubey, Shreya, Lalwani, Abhishek, Koleczek, David, Rungta, Mukund, Hasan, Sadid, Lobo, Elita
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Does Prompt Formatting Have Any Impact on LLM Performance?
par: He, Jia, et autres
Publié: (2024)

OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics
par: Dorna, Vineeth, et autres
Publié: (2025)

Machine Unlearning in Large Language Models
par: Gundavarapu, Saaketh Koundinya, et autres
Publié: (2024)

On the Impact of Fine-Tuning on Chain-of-Thought Reasoning
par: Lobo, Elita, et autres
Publié: (2024)

Reasoning Factual Knowledge in Structured Data with Large Language Models
par: Huang, Sirui, et autres
Publié: (2024)

Does quantization affect models' performance on long-context tasks?
par: Mekala, Anmol, et autres
Publié: (2025)

ZeroUnlearn: Few-Shot Knowledge Unlearning in Large Language Models
par: Lin, Yujie, et autres
Publié: (2026)

Not All That Is Fluent Is Factual: Investigating Hallucinations of Large Language Models in Academic Writing
par: Khan, Humam, et autres
Publié: (2026)

Beyond Under-Alignment: Atomic Preference Enhanced Factuality Tuning for Large Language Models
par: Yuan, Hongbang, et autres
Publié: (2024)

Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models
par: Ju, Tianjie, et autres
Publié: (2024)

Improving Factual Consistency of News Summarization by Contrastive Preference Optimization
par: Feng, Huawen, et autres
Publié: (2023)

Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
par: Xu, Derong, et autres
Publié: (2024)

Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation
par: Ren, Ruiyang, et autres
Publié: (2023)

CiPO: Counterfactual Unlearning for Large Reasoning Models through Iterative Preference Optimization
par: Li, Junyi, et autres
Publié: (2026)

Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs
par: Liu, Xiaoze, et autres
Publié: (2024)

Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models
par: Chen, Yuheng, et autres
Publié: (2024)

Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons
par: Wang, Yifei, et autres
Publié: (2024)

Multilingual Knowledge Editing with Language-Agnostic Factual Neurons
par: Zhang, Xue, et autres
Publié: (2024)

How Do Large Language Models Acquire Factual Knowledge During Pretraining?
par: Chang, Hoyeon, et autres
Publié: (2024)

Direct Preference Knowledge Distillation for Large Language Models
par: Li, Yixing, et autres
Publié: (2024)

Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge
par: Lu, Weikai, et autres
Publié: (2024)

Smaller Language Models are capable of selecting Instruction-Tuning Training Data for Larger Language Models
par: Mekala, Dheeraj, et autres
Publié: (2024)

Aligning Knowledge Graphs and Language Models for Factual Accuracy
par: Nishat, Nur A Zarin, et autres
Publié: (2025)

Inside-Out: Hidden Factual Knowledge in LLMs
par: Gekhman, Zorik, et autres
Publié: (2025)

CLR-Fact: Evaluating the Complex Logical Reasoning Capability of Large Language Models over Factual Knowledge
par: Zheng, Tianshi, et autres
Publié: (2024)

HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classification
par: Jain, Vidit, et autres
Publié: (2024)

Follow the Path: Reasoning over Knowledge Graph Paths to Improve Large Language Model Factuality
par: Zhang, Mike, et autres
Publié: (2025)

Preference Packing: Efficient Preference Optimization for Large Language Models
par: Cho, Jaekyung
Publié: (2026)

Mitigating Geospatial Knowledge Hallucination in Large Language Models: Benchmarking and Dynamic Factuality Aligning
par: Wang, Shengyuan, et autres
Publié: (2025)

Factuality Challenges in the Era of Large Language Models
par: Augenstein, Isabelle, et autres
Publié: (2023)

Factuality of Large Language Models: A Survey
par: Wang, Yuxia, et autres
Publié: (2024)

Concept Unlearning in Large Language Models via Self-Constructed Knowledge Triplets
par: Yamashita, Tomoya, et autres
Publié: (2025)

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models
par: Jin, Zhuoran, et autres
Publié: (2024)

LLM Surgery: Efficient Knowledge Unlearning and Editing in Large Language Models
par: Veldanda, Akshaj Kumar, et autres
Publié: (2024)

Tracing Pharmacological Knowledge In Large Language Models
par: Khwaja, Basil Hasan, et autres
Publié: (2026)

Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning
par: Fan, Chongyu, et autres
Publié: (2024)

Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning
par: Zhang, Ruiqi, et autres
Publié: (2024)

Reducing Hallucinations in LLMs via Factuality-Aware Preference Learning
par: Chaduvula, Sindhuja, et autres
Publié: (2026)

Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models
par: Xiang, Hao, et autres
Publié: (2024)

Exploring the Factual Consistency in Dialogue Comprehension of Large Language Models
par: She, Shuaijie, et autres
Publié: (2023)