UniMixer: A Unified Architecture for Scaling Laws in Recommendation Systems
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912997518082048 |
|---|---|
| author | Ha, Mingming Wang, Guanchen Chen, Linxun Rao, Xuan Shi, Yuexin Ma, Tianbao Liu, Zhaojie Fan, Yunqian Lu, Zilong Niu, Yanan Li, Han Gai, Kun |
| author_facet | Ha, Mingming Wang, Guanchen Chen, Linxun Rao, Xuan Shi, Yuexin Ma, Tianbao Liu, Zhaojie Fan, Yunqian Lu, Zilong Niu, Yanan Li, Han Gai, Kun |
| contents | In recent years, the scaling laws of recommendation models have attracted increasing attention, which govern the relationship between performance and parameters/FLOPs of recommenders. Currently, there are three mainstream architectures for achieving scaling in recommendation models, namely attention-based, TokenMixer-based, and factorization-machine-based methods, which exhibit fundamental differences in both design philosophy and architectural structure. In this paper, we propose a unified scaling architecture for recommendation systems, namely \textbf{UniMixer}, to improve scaling efficiency and establish a unified theoretical framework that unifies the mainstream scaling blocks. By transforming the rule-based TokenMixer to an equivalent parameterized structure, we construct a generalized parameterized feature mixing module that allows the token mixing patterns to be optimized and learned during model training. Meanwhile, the generalized parameterized token mixing removes the constraint in TokenMixer that requires the number of heads to be equal to the number of tokens. Furthermore, we establish a unified scaling module design framework for recommender systems, which bridges the connections among attention-based, TokenMixer-based, and factorization-machine-based methods. To further boost scaling ROI, a lightweight UniMixing module is designed, \textbf{UniMixing-Lite}, which further compresses the model parameters and computational cost while significantly improve the model performance. The scaling curves are shown in the following figure. Extensive offline and online experiments are conducted to verify the superior scaling abilities of \textbf{UniMixer}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_00590 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | UniMixer: A Unified Architecture for Scaling Laws in Recommendation Systems Ha, Mingming Wang, Guanchen Chen, Linxun Rao, Xuan Shi, Yuexin Ma, Tianbao Liu, Zhaojie Fan, Yunqian Lu, Zilong Niu, Yanan Li, Han Gai, Kun Information Retrieval Artificial Intelligence In recent years, the scaling laws of recommendation models have attracted increasing attention, which govern the relationship between performance and parameters/FLOPs of recommenders. Currently, there are three mainstream architectures for achieving scaling in recommendation models, namely attention-based, TokenMixer-based, and factorization-machine-based methods, which exhibit fundamental differences in both design philosophy and architectural structure. In this paper, we propose a unified scaling architecture for recommendation systems, namely \textbf{UniMixer}, to improve scaling efficiency and establish a unified theoretical framework that unifies the mainstream scaling blocks. By transforming the rule-based TokenMixer to an equivalent parameterized structure, we construct a generalized parameterized feature mixing module that allows the token mixing patterns to be optimized and learned during model training. Meanwhile, the generalized parameterized token mixing removes the constraint in TokenMixer that requires the number of heads to be equal to the number of tokens. Furthermore, we establish a unified scaling module design framework for recommender systems, which bridges the connections among attention-based, TokenMixer-based, and factorization-machine-based methods. To further boost scaling ROI, a lightweight UniMixing module is designed, \textbf{UniMixing-Lite}, which further compresses the model parameters and computational cost while significantly improve the model performance. The scaling curves are shown in the following figure. Extensive offline and online experiments are conducted to verify the superior scaling abilities of \textbf{UniMixer}. |
| title | UniMixer: A Unified Architecture for Scaling Laws in Recommendation Systems |
| topic | Information Retrieval Artificial Intelligence |
| url | https://arxiv.org/abs/2604.00590 |