Imagen de Portada

What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Jin, Xisen, Ren, Xiang
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Demystifying Language Model Forgetting with Low-rank Example Associations
por: Jin, Xisen, et al.
Publicado: (2024)

Dataless Knowledge Fusion by Merging Weights of Language Models
por: Jin, Xisen, et al.
Publicado: (2022)

Learning and Forgetting Unsafe Examples in Large Language Models
por: Zhao, Jiachen, et al.
Publicado: (2023)

What Should LLMs Forget? Quantifying Personal Data in LLMs for Right-to-Be-Forgotten Requests
por: Staufer, Dimitri
Publicado: (2025)

What's In My Big Data?
por: Elazar, Yanai, et al.
Publicado: (2023)

Graceful Forgetting in Generative Language Models
por: Jiang, Chunyang, et al.
Publicado: (2025)

Understanding Catastrophic Forgetting in Language Models via Implicit Inference
por: Kotha, Suhas, et al.
Publicado: (2023)

Did You Forget What I Asked? Prospective Memory Failures in Large Language Models
por: Mittal, Avni
Publicado: (2026)

Elephants Never Forget: Testing Language Models for Memorization of Tabular Data
por: Bordt, Sebastian, et al.
Publicado: (2024)

Erasing Without Remembering: Implicit Knowledge Forgetting in Large Language Models
por: Wang, Huazheng, et al.
Publicado: (2025)

iFlip: Iterative Feedback-driven Counterfactual Example Refinement
por: Wang, Yilong, et al.
Publicado: (2026)

Unveiling and Addressing Pseudo Forgetting in Large Language Models
por: Sun, Huashan, et al.
Publicado: (2024)

Offline Learning and Forgetting for Reasoning with Large Language Models
por: Ni, Tianwei, et al.
Publicado: (2025)

Mapping Post-Training Forgetting in Language Models at Scale
por: Harmon, Jackson, et al.
Publicado: (2025)

Drifting Objectives for Refining Discrete Diffusion Language Models
por: Oba, Daisuke, et al.
Publicado: (2026)

Reinforcement Learning for Reasoning in Large Language Models with One Training Example
por: Wang, Yiping, et al.
Publicado: (2025)

Self-Refining Language Model Anonymizers via Adversarial Distillation
por: Kim, Kyuyoung, et al.
Publicado: (2025)

A Gradient Analysis Framework for Rewarding Good and Penalizing Bad Examples in Language Models
por: Tuan, Yi-Lin, et al.
Publicado: (2024)

Macroeconomic Forecasting with Large Language Models
por: Carriero, Andrea, et al.
Publicado: (2024)

Compact Example-Based Explanations for Language Models
por: Schoenegger, Loris, et al.
Publicado: (2026)

Unfamiliar Finetuning Examples Control How Language Models Hallucinate
por: Kang, Katie, et al.
Publicado: (2024)

Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models
por: Bordt, Sebastian, et al.
Publicado: (2024)

FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning
por: Feng, Yujie, et al.
Publicado: (2026)

What Evidence Do Language Models Find Convincing?
por: Wan, Alexander, et al.
Publicado: (2024)

What is Wrong with Perplexity for Long-context Language Modeling?
por: Fang, Lizhe, et al.
Publicado: (2024)

What Is Wrong with My Model? Identifying Systematic Problems with Semantic Data Slicing
por: Yang, Chenyang, et al.
Publicado: (2024)

Scaling Laws for Forgetting When Fine-Tuning Large Language Models
por: Kalajdzievski, Damjan
Publicado: (2024)

BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization
por: Lee, Gihun, et al.
Publicado: (2024)

Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack
por: Xu, Xiaoyue, et al.
Publicado: (2024)

Forgetting to Forget: Attention Sink as A Gateway for Backdooring LLM Unlearning
por: Shang, Bingqi, et al.
Publicado: (2025)

Consistency Checks for Language Model Forecasters
por: Paleka, Daniel, et al.
Publicado: (2024)

FIT to Forget: Robust Continual Unlearning for Large Language Models
por: Xu, Xiaoyu, et al.
Publicado: (2026)

Forget What Matters, Keep the Rest: Selective Unlearning of Informative Tokens
por: Koh, Seunghee, et al.
Publicado: (2026)

AutoTimes: Autoregressive Time Series Forecasters via Large Language Models
por: Liu, Yong, et al.
Publicado: (2024)

What Do Language Models Learn in Context? The Structured Task Hypothesis
por: Li, Jiaoda, et al.
Publicado: (2024)

Parameter-Efficient Tuning Large Language Models for Graph Representation Learning
por: Zhu, Qi, et al.
Publicado: (2024)

Fine-Tuning Without Forgetting In-Context Learning: A Theoretical Analysis of Linear Attention Models
por: Lee, Chungpa, et al.
Publicado: (2026)

Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Models
por: Cao, Jinghan, et al.
Publicado: (2026)

SSR: Socratic Self-Refine for Large Language Model Reasoning
por: Shi, Haizhou, et al.
Publicado: (2025)

Efficient Real-time Refinement of Language Model Text Generation
por: Ko, Joonho, et al.
Publicado: (2025)