DTN: Deep Multiple Task-specific Feature Interactions Network for Multi-Task Recommendation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909675211980800 |
|---|---|
| author | Bi, Yaowen Lian, Yuteng Cui, Jie Liu, Jun Wang, Peijian Li, Guanghui Chen, Xuejun Zhao, Jinglin Wen, Hao Zhang, Jing Zhang, Zhaoqi Song, Wenzhuo Sun, Yang Zhang, Weiwei Cai, Mingchen Dong, Jian Zhang, Guanxing |
| author_facet | Bi, Yaowen Lian, Yuteng Cui, Jie Liu, Jun Wang, Peijian Li, Guanghui Chen, Xuejun Zhao, Jinglin Wen, Hao Zhang, Jing Zhang, Zhaoqi Song, Wenzhuo Sun, Yang Zhang, Weiwei Cai, Mingchen Dong, Jian Zhang, Guanxing |
| contents | Neural-based multi-task learning (MTL) has been successfully applied to many recommendation applications. However, these MTL models (e.g., MMoE, PLE) did not consider feature interaction during the optimization, which is crucial for capturing complex high-order features and has been widely used in ranking models for real-world recommender systems. Moreover, through feature importance analysis across various tasks in MTL, we have observed an interesting divergence phenomenon that the same feature can have significantly different importance across different tasks in MTL. To address these issues, we propose Deep Multiple Task-specific Feature Interactions Network (DTN) with a novel model structure design. DTN introduces multiple diversified task-specific feature interaction methods and task-sensitive network in MTL networks, enabling the model to learn task-specific diversified feature interaction representations, which improves the efficiency of joint representation learning in a general setup. We applied DTN to our company's real-world E-commerce recommendation dataset, which consisted of over 6.3 billion samples, the results demonstrated that DTN significantly outperformed state-of-the-art MTL models. Moreover, during online evaluation of DTN in a large-scale E-commerce recommender system, we observed a 3.28% in clicks, a 3.10% increase in orders and a 2.70% increase in GMV (Gross Merchandise Value) compared to the state-of-the-art MTL models. Finally, extensive offline experiments conducted on public benchmark datasets demonstrate that DTN can be applied to various scenarios beyond recommendations, enhancing the performance of ranking models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_11611 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DTN: Deep Multiple Task-specific Feature Interactions Network for Multi-Task Recommendation Bi, Yaowen Lian, Yuteng Cui, Jie Liu, Jun Wang, Peijian Li, Guanghui Chen, Xuejun Zhao, Jinglin Wen, Hao Zhang, Jing Zhang, Zhaoqi Song, Wenzhuo Sun, Yang Zhang, Weiwei Cai, Mingchen Dong, Jian Zhang, Guanxing Information Retrieval Machine Learning Neural-based multi-task learning (MTL) has been successfully applied to many recommendation applications. However, these MTL models (e.g., MMoE, PLE) did not consider feature interaction during the optimization, which is crucial for capturing complex high-order features and has been widely used in ranking models for real-world recommender systems. Moreover, through feature importance analysis across various tasks in MTL, we have observed an interesting divergence phenomenon that the same feature can have significantly different importance across different tasks in MTL. To address these issues, we propose Deep Multiple Task-specific Feature Interactions Network (DTN) with a novel model structure design. DTN introduces multiple diversified task-specific feature interaction methods and task-sensitive network in MTL networks, enabling the model to learn task-specific diversified feature interaction representations, which improves the efficiency of joint representation learning in a general setup. We applied DTN to our company's real-world E-commerce recommendation dataset, which consisted of over 6.3 billion samples, the results demonstrated that DTN significantly outperformed state-of-the-art MTL models. Moreover, during online evaluation of DTN in a large-scale E-commerce recommender system, we observed a 3.28% in clicks, a 3.10% increase in orders and a 2.70% increase in GMV (Gross Merchandise Value) compared to the state-of-the-art MTL models. Finally, extensive offline experiments conducted on public benchmark datasets demonstrate that DTN can be applied to various scenarios beyond recommendations, enhancing the performance of ranking models. |
| title | DTN: Deep Multiple Task-specific Feature Interactions Network for Multi-Task Recommendation |
| topic | Information Retrieval Machine Learning |
| url | https://arxiv.org/abs/2408.11611 |