Curriculum Approximate Unlearning for Session-based Recommendation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Liu, Ren, Zhaochun, Zhao, Ziqi, Ren, Pengjie, Chen, Zhumin, Li, Xinyi, Peng, Zhiming, Shi, Daiting, de Rijke, Maarten, Xin, Xin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917239987372032
author Yang, Liu
Ren, Zhaochun
Zhao, Ziqi
Ren, Pengjie
Chen, Zhumin
Li, Xinyi
Peng, Zhiming
Shi, Daiting
de Rijke, Maarten
Xin, Xin
author_facet Yang, Liu
Ren, Zhaochun
Zhao, Ziqi
Ren, Pengjie
Chen, Zhumin
Li, Xinyi
Peng, Zhiming
Shi, Daiting
de Rijke, Maarten
Xin, Xin
contents Approximate unlearning for session-based recommendation refers to eliminating the influence of specific training samples from the recommender without retraining of (sub-)models. Gradient ascent (GA) is a representative method to conduct approximate unlearning. However, there still exist dual challenges to apply GA for session-based recommendation. On the one hand, naive applying of GA could lead to degradation of recommendation performance. On the other hand, existing studies fail to consider the ordering of unlearning samples when simultaneously processing multiple unlearning requests, leading to sub-optimal recommendation performance and unlearning effect. To address the above challenges, we introduce CAU, a curriculum approximate unlearning framework tailored to session-based recommendation. CAU handles the unlearning task with a GA term on unlearning samples. Specifically, to address the first challenge, CAU formulates the overall optimization task as a multi-objective optimization problem, where the GA term for unlearning samples is combined with retaining terms for preserving performance. The multi-objective optimization problem is solved through seeking the Pareto-Optimal solution, which achieves effective unlearning with trivial sacrifice on recommendation performance. To tackle the second challenge, CAU adopts a curriculum-based sequence to conduct unlearning on batches of unlearning samples. The key motivation is to perform unlearning from easy samples to harder ones. To this end, CAU first introduces two metrics to measure the unlearning difficulty, including gradient unlearning difficulty and embedding unlearning difficulty. Then, two strategies, hard-sampling and soft-sampling, are proposed to select unlearning samples according to difficulty scores.
format Preprint
id arxiv_https___arxiv_org_abs_2508_15263
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Curriculum Approximate Unlearning for Session-based Recommendation
Yang, Liu
Ren, Zhaochun
Zhao, Ziqi
Ren, Pengjie
Chen, Zhumin
Li, Xinyi
Peng, Zhiming
Shi, Daiting
de Rijke, Maarten
Xin, Xin
Information Retrieval
Approximate unlearning for session-based recommendation refers to eliminating the influence of specific training samples from the recommender without retraining of (sub-)models. Gradient ascent (GA) is a representative method to conduct approximate unlearning. However, there still exist dual challenges to apply GA for session-based recommendation. On the one hand, naive applying of GA could lead to degradation of recommendation performance. On the other hand, existing studies fail to consider the ordering of unlearning samples when simultaneously processing multiple unlearning requests, leading to sub-optimal recommendation performance and unlearning effect. To address the above challenges, we introduce CAU, a curriculum approximate unlearning framework tailored to session-based recommendation. CAU handles the unlearning task with a GA term on unlearning samples. Specifically, to address the first challenge, CAU formulates the overall optimization task as a multi-objective optimization problem, where the GA term for unlearning samples is combined with retaining terms for preserving performance. The multi-objective optimization problem is solved through seeking the Pareto-Optimal solution, which achieves effective unlearning with trivial sacrifice on recommendation performance. To tackle the second challenge, CAU adopts a curriculum-based sequence to conduct unlearning on batches of unlearning samples. The key motivation is to perform unlearning from easy samples to harder ones. To this end, CAU first introduces two metrics to measure the unlearning difficulty, including gradient unlearning difficulty and embedding unlearning difficulty. Then, two strategies, hard-sampling and soft-sampling, are proposed to select unlearning samples according to difficulty scores.
title Curriculum Approximate Unlearning for Session-based Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2508.15263