CSMF: Cascaded Selective Mask Fine-Tuning for Multi-Objective Embedding-Based Retrieval
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912333027082240 |
|---|---|
| author | Deng, Hao Xing, Haibo Matsuyama, Kanefumi Zhang, Moyu Hu, Jinxin Wen, Hong Zhang, Yu Zeng, Xiaoyi Zhang, Jing |
| author_facet | Deng, Hao Xing, Haibo Matsuyama, Kanefumi Zhang, Moyu Hu, Jinxin Wen, Hong Zhang, Yu Zeng, Xiaoyi Zhang, Jing |
| contents | Multi-objective embedding-based retrieval (EBR) has become increasingly critical due to the growing complexity of user behaviors and commercial objectives. While traditional approaches often suffer from data sparsity and limited information sharing between objectives, recent methods utilizing a shared network alongside dedicated sub-networks for each objective partially address these limitations. However, such methods significantly increase the model parameters, leading to an increased retrieval latency and a limited ability to model causal relationships between objectives. To address these challenges, we propose the Cascaded Selective Mask Fine-Tuning (CSMF), a novel method that enhances both retrieval efficiency and serving performance for multi-objective EBR. The CSMF framework selectively masks model parameters to free up independent learning space for each objective, leveraging the cascading relationships between objectives during the sequential fine-tuning. Without increasing network parameters or online retrieval overhead, CSMF computes a linearly weighted fusion score for multiple objective probabilities while supporting flexible adjustment of each objective's weight across various recommendation scenarios. Experimental results on real-world datasets demonstrate the superior performance of CSMF, and online experiments validate its significant practical value. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_12920 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | CSMF: Cascaded Selective Mask Fine-Tuning for Multi-Objective Embedding-Based Retrieval Deng, Hao Xing, Haibo Matsuyama, Kanefumi Zhang, Moyu Hu, Jinxin Wen, Hong Zhang, Yu Zeng, Xiaoyi Zhang, Jing Information Retrieval H.3.3 Multi-objective embedding-based retrieval (EBR) has become increasingly critical due to the growing complexity of user behaviors and commercial objectives. While traditional approaches often suffer from data sparsity and limited information sharing between objectives, recent methods utilizing a shared network alongside dedicated sub-networks for each objective partially address these limitations. However, such methods significantly increase the model parameters, leading to an increased retrieval latency and a limited ability to model causal relationships between objectives. To address these challenges, we propose the Cascaded Selective Mask Fine-Tuning (CSMF), a novel method that enhances both retrieval efficiency and serving performance for multi-objective EBR. The CSMF framework selectively masks model parameters to free up independent learning space for each objective, leveraging the cascading relationships between objectives during the sequential fine-tuning. Without increasing network parameters or online retrieval overhead, CSMF computes a linearly weighted fusion score for multiple objective probabilities while supporting flexible adjustment of each objective's weight across various recommendation scenarios. Experimental results on real-world datasets demonstrate the superior performance of CSMF, and online experiments validate its significant practical value. |
| title | CSMF: Cascaded Selective Mask Fine-Tuning for Multi-Objective Embedding-Based Retrieval |
| topic | Information Retrieval H.3.3 |
| url | https://arxiv.org/abs/2504.12920 |