Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jia, Renqi, Zhang, Xiaokun, He, Bowei, Zhu, Qiannan, Xu, Weitao, Chen, Jiehao, Ma, Chen
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2502.08685
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916611702652928
author Jia, Renqi
Zhang, Xiaokun
He, Bowei
Zhu, Qiannan
Xu, Weitao
Chen, Jiehao
Ma, Chen
author_facet Jia, Renqi
Zhang, Xiaokun
He, Bowei
Zhu, Qiannan
Xu, Weitao
Chen, Jiehao
Ma, Chen
contents User behavior records serve as the foundation for recommender systems. While the behavior data exhibits ease of acquisition, it often suffers from varying quality. Current methods employ data valuation to discern high-quality data from low-quality data. However, they tend to employ black-box design, lacking transparency and interpretability. Besides, they are typically tailored to specific evaluation metrics, leading to limited generality across various tasks. To overcome these issues, we propose an explainable and versatile framework DVR which can enhance the efficiency of data utilization tailored to any requirements of the model architectures and evaluation metrics. For explainable data valuation, a data valuator is presented to evaluate the data quality via calculating its Shapley value from the game-theoretic perspective, ensuring robust mathematical properties and reliability. In order to accommodate various evaluation metrics, including differentiable and non-differentiable ones, a metric adapter is devised based on reinforcement learning, where a metric is treated as the reinforcement reward that guides model optimization. Extensive experiments conducted on various benchmarks verify that our framework can improve the performance of current recommendation algorithms on various metrics including ranking accuracy, diversity, and fairness. Specifically, our framework achieves up to 34.7\% improvements over existing methods in terms of representative NDCG metric. The code is available at https://github.com/renqii/DVR.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08685
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Beyond Models! Explainable Data Valuation and Metric Adaption for Recommendation
Jia, Renqi
Zhang, Xiaokun
He, Bowei
Zhu, Qiannan
Xu, Weitao
Chen, Jiehao
Ma, Chen
Machine Learning
Artificial Intelligence
User behavior records serve as the foundation for recommender systems. While the behavior data exhibits ease of acquisition, it often suffers from varying quality. Current methods employ data valuation to discern high-quality data from low-quality data. However, they tend to employ black-box design, lacking transparency and interpretability. Besides, they are typically tailored to specific evaluation metrics, leading to limited generality across various tasks. To overcome these issues, we propose an explainable and versatile framework DVR which can enhance the efficiency of data utilization tailored to any requirements of the model architectures and evaluation metrics. For explainable data valuation, a data valuator is presented to evaluate the data quality via calculating its Shapley value from the game-theoretic perspective, ensuring robust mathematical properties and reliability. In order to accommodate various evaluation metrics, including differentiable and non-differentiable ones, a metric adapter is devised based on reinforcement learning, where a metric is treated as the reinforcement reward that guides model optimization. Extensive experiments conducted on various benchmarks verify that our framework can improve the performance of current recommendation algorithms on various metrics including ranking accuracy, diversity, and fairness. Specifically, our framework achieves up to 34.7\% improvements over existing methods in terms of representative NDCG metric. The code is available at https://github.com/renqii/DVR.
title Beyond Models! Explainable Data Valuation and Metric Adaption for Recommendation
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2502.08685