Buchumschlag

RKLD: Reverse KL-Divergence-based Knowledge Distillation for Unlearning Personal Information in Large Language Models

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Wang, Bichen, Zi, Yuzhe, Sun, Yixin, Zhao, Yanyan, Qin, Bing
Format:	Preprint
Veröffentlicht:	2024
Schlagworte:	Computation and Language
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Psychological Counseling Cannot Be Achieved Overnight: Automated Psychological Counseling Through Multi-Session Conversations
von: Wang, Junzhe, et al.
Veröffentlicht: (2025)

CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling
von: Wang, Bichen, et al.
Veröffentlicht: (2025)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
von: Wu, Taiqiang, et al.
Veröffentlicht: (2024)

Can Large Language Models Understand You Better? An MBTI Personality Detection Dataset Aligned with Population Traits
von: Li, Bohan, et al.
Veröffentlicht: (2024)

Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning
von: Zhao, Yang, et al.
Veröffentlicht: (2024)

Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignment
von: Zhao, Weixiang, et al.
Veröffentlicht: (2025)

Not Every Token Needs Forgetting: Selective Unlearning to Limit Change in Utility in Large Language Model Unlearning
von: Wan, Yixin, et al.
Veröffentlicht: (2025)

Large Language Model Agents Are Not Always Faithful Self-Evolvers
von: Zhao, Weixiang, et al.
Veröffentlicht: (2026)

Distilling Rule-based Knowledge into Large Language Models
von: Yang, Wenkai, et al.
Veröffentlicht: (2023)

Evolving Knowledge Distillation with Large Language Models and Active Learning
von: Liu, Chengyuan, et al.
Veröffentlicht: (2024)

Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering
von: Liu, Runxuan, et al.
Veröffentlicht: (2025)

Unveiling Entity-Level Unlearning for Large Language Models: A Comprehensive Analysis
von: Ma, Weitao, et al.
Veröffentlicht: (2024)

Separate the Wheat from the Chaff: A Post-Hoc Approach to Safety Re-Alignment for Fine-Tuned Language Models
von: Wu, Di, et al.
Veröffentlicht: (2024)

Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence
von: Zhao, Weixiang, et al.
Veröffentlicht: (2024)

DeepSight: Bridging Depth Maps and Language with a Depth-Driven Multimodal Model
von: Yang, Hao, et al.
Veröffentlicht: (2026)

Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models
von: Xing, Wang, et al.
Veröffentlicht: (2026)

A Survey on Unlearning in Large Language Models
von: Qiu, Ruichen, et al.
Veröffentlicht: (2025)

Direct Preference Knowledge Distillation for Large Language Models
von: Li, Yixing, et al.
Veröffentlicht: (2024)

ZeroUnlearn: Few-Shot Knowledge Unlearning in Large Language Models
von: Lin, Yujie, et al.
Veröffentlicht: (2026)

Data Uncertainty-Aware Learning for Multimodal Aspect-based Sentiment Analysis
von: Yang, Hao, et al.
Veröffentlicht: (2024)

Does Knowledge Distillation Matter for Large Language Model based Bundle Generation?
von: Feng, Kaidong, et al.
Veröffentlicht: (2025)

Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge
von: Lu, Weikai, et al.
Veröffentlicht: (2024)

Dual-Space Knowledge Distillation for Large Language Models
von: Zhang, Songming, et al.
Veröffentlicht: (2024)

Personalized Graph-Empowered Large Language Model for Proactive Information Access
von: Chang, Chia Cheng, et al.
Veröffentlicht: (2026)

SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models
von: Zhao, Weixiang, et al.
Veröffentlicht: (2024)

Learning and Unlearning of Fabricated Knowledge in Language Models
von: Sun, Chen, et al.
Veröffentlicht: (2024)

Lens: Rethinking Multilingual Enhancement for Large Language Models
von: Zhao, Weixiang, et al.
Veröffentlicht: (2024)

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models
von: Jin, Zhuoran, et al.
Veröffentlicht: (2024)

ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents
von: Fu, Xing, et al.
Veröffentlicht: (2026)

Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter
von: Zhao, Weixiang, et al.
Veröffentlicht: (2025)

Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey
von: Yang, Hao, et al.
Veröffentlicht: (2024)

DDK: Distilling Domain Knowledge for Efficient Large Language Models
von: Liu, Jiaheng, et al.
Veröffentlicht: (2024)

UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language Models
von: Dong, Yijiang River, et al.
Veröffentlicht: (2024)

Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate
von: Xiong, Kai, et al.
Veröffentlicht: (2023)

Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarization
von: Feng, Xiachong, et al.
Veröffentlicht: (2023)

How Does Sequence Modeling Architecture Influence Base Capabilities of Pre-trained Language Models? Exploring Key Architecture Design Principles to Avoid Base Capabilities Degradation
von: Lu, Xin, et al.
Veröffentlicht: (2025)

Knowledge Distillation of Black-Box Large Language Models
von: Chen, Hongzhan, et al.
Veröffentlicht: (2024)

A Survey on Knowledge Distillation of Large Language Models
von: Xu, Xiaohan, et al.
Veröffentlicht: (2024)

BrainBench: Exposing the Commonsense Reasoning Gap in Large Language Models
von: Tang, Yuzhe
Veröffentlicht: (2026)

Reverse Modeling in Large Language Models
von: Yu, Sicheng, et al.
Veröffentlicht: (2024)