AgentSociety Challenge: Designing LLM Agents for User Modeling and Recommendation on Web Platforms
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917936522854400 |
|---|---|
| author | Yan, Yuwei Shang, Yu Zeng, Qingbin Li, Yu Zhao, Keyu Zheng, Zhiheng Ning, Xuefei Wu, Tianji Yan, Shengen Wang, Yu Xu, Fengli Li, Yong |
| author_facet | Yan, Yuwei Shang, Yu Zeng, Qingbin Li, Yu Zhao, Keyu Zheng, Zhiheng Ning, Xuefei Wu, Tianji Yan, Shengen Wang, Yu Xu, Fengli Li, Yong |
| contents | The AgentSociety Challenge is the first competition in the Web Conference that aims to explore the potential of Large Language Model (LLM) agents in modeling user behavior and enhancing recommender systems on web platforms. The Challenge consists of two tracks: the User Modeling Track and the Recommendation Track. Participants are tasked to utilize a combined dataset from Yelp, Amazon, and Goodreads, along with an interactive environment simulator, to develop innovative LLM agents. The Challenge has attracted 295 teams across the globe and received over 1,400 submissions in total over the course of 37 official competition days. The participants have achieved 21.9% and 20.3% performance improvement for Track 1 and Track 2 in the Development Phase, and 9.1% and 15.9% in the Final Phase, representing a significant accomplishment. This paper discusses the detailed designs of the Challenge, analyzes the outcomes, and highlights the most successful LLM agent designs. To support further research and development, we have open-sourced the benchmark environment at https://tsinghua-fib-lab.github.io/AgentSocietyChallenge. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_18754 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AgentSociety Challenge: Designing LLM Agents for User Modeling and Recommendation on Web Platforms Yan, Yuwei Shang, Yu Zeng, Qingbin Li, Yu Zhao, Keyu Zheng, Zhiheng Ning, Xuefei Wu, Tianji Yan, Shengen Wang, Yu Xu, Fengli Li, Yong Information Retrieval Artificial Intelligence The AgentSociety Challenge is the first competition in the Web Conference that aims to explore the potential of Large Language Model (LLM) agents in modeling user behavior and enhancing recommender systems on web platforms. The Challenge consists of two tracks: the User Modeling Track and the Recommendation Track. Participants are tasked to utilize a combined dataset from Yelp, Amazon, and Goodreads, along with an interactive environment simulator, to develop innovative LLM agents. The Challenge has attracted 295 teams across the globe and received over 1,400 submissions in total over the course of 37 official competition days. The participants have achieved 21.9% and 20.3% performance improvement for Track 1 and Track 2 in the Development Phase, and 9.1% and 15.9% in the Final Phase, representing a significant accomplishment. This paper discusses the detailed designs of the Challenge, analyzes the outcomes, and highlights the most successful LLM agent designs. To support further research and development, we have open-sourced the benchmark environment at https://tsinghua-fib-lab.github.io/AgentSocietyChallenge. |
| title | AgentSociety Challenge: Designing LLM Agents for User Modeling and Recommendation on Web Platforms |
| topic | Information Retrieval Artificial Intelligence |
| url | https://arxiv.org/abs/2502.18754 |