KMLP: A Scalable Hybrid Architecture for Web-Scale Tabular Data Modeling
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917295766372352 |
|---|---|
| author | Zhang, Mingming Shi, Pengfei Xiao, Zhiqing Zhao, Feng Sun, Guandong Kang, Yulin Gao, Ruizhe Wang, Ningtao Fu, Xing Wang, Weiqiang Zhao, Junbo |
| author_facet | Zhang, Mingming Shi, Pengfei Xiao, Zhiqing Zhao, Feng Sun, Guandong Kang, Yulin Gao, Ruizhe Wang, Ningtao Fu, Xing Wang, Weiqiang Zhao, Junbo |
| contents | Predictive modeling on web-scale tabular data with billions of instances and hundreds of heterogeneous numerical features faces significant scalability challenges. These features exhibit anisotropy, heavy-tailed distributions, and non-stationarity, creating bottlenecks for models like Gradient Boosting Decision Trees and requiring laborious manual feature engineering. We introduce KMLP, a hybrid deep architecture integrating a shallow Kolmogorov-Arnold Network (KAN) front-end with a Gated Multilayer Perceptron (gMLP) backbone. The KAN front-end uses learnable activation functions to automatically model complex non-linear transformations for each feature, while the gMLP backbone captures high-order interactions. Experiments on public benchmarks and an industrial dataset with billions of samples show KMLP achieves state-of-the-art performance, with advantages over baselines like GBDTs increasing at larger scales, validating KMLP as a scalable deep learning paradigm for large-scale web tabular data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_22777 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | KMLP: A Scalable Hybrid Architecture for Web-Scale Tabular Data Modeling Zhang, Mingming Shi, Pengfei Xiao, Zhiqing Zhao, Feng Sun, Guandong Kang, Yulin Gao, Ruizhe Wang, Ningtao Fu, Xing Wang, Weiqiang Zhao, Junbo Machine Learning Predictive modeling on web-scale tabular data with billions of instances and hundreds of heterogeneous numerical features faces significant scalability challenges. These features exhibit anisotropy, heavy-tailed distributions, and non-stationarity, creating bottlenecks for models like Gradient Boosting Decision Trees and requiring laborious manual feature engineering. We introduce KMLP, a hybrid deep architecture integrating a shallow Kolmogorov-Arnold Network (KAN) front-end with a Gated Multilayer Perceptron (gMLP) backbone. The KAN front-end uses learnable activation functions to automatically model complex non-linear transformations for each feature, while the gMLP backbone captures high-order interactions. Experiments on public benchmarks and an industrial dataset with billions of samples show KMLP achieves state-of-the-art performance, with advantages over baselines like GBDTs increasing at larger scales, validating KMLP as a scalable deep learning paradigm for large-scale web tabular data. |
| title | KMLP: A Scalable Hybrid Architecture for Web-Scale Tabular Data Modeling |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2602.22777 |