Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2411.14499 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915664289071104 |
|---|---|
| author | Ding, Jingtao Zhang, Yunke Shang, Yu Feng, Jie Zhang, Yuheng Zong, Zefang Yuan, Yuan Su, Hongyuan Li, Nian Piao, Jinghua Deng, Yucheng Sukiennik, Nicholas Gao, Chen Xu, Fengli Li, Yong |
| author_facet | Ding, Jingtao Zhang, Yunke Shang, Yu Feng, Jie Zhang, Yuheng Zong, Zefang Yuan, Yuan Su, Hongyuan Li, Nian Piao, Jinghua Deng, Yucheng Sukiennik, Nicholas Gao, Chen Xu, Fengli Li, Yong |
| contents | The concept of world models has garnered significant attention due to advancements in multimodal large language models such as GPT-4 and video generation models such as Sora, which are central to the pursuit of artificial general intelligence. This survey offers a comprehensive review of the literature on world models. Generally, world models are regarded as tools for either understanding the present state of the world or predicting its future dynamics. This review presents a systematic categorization of world models, emphasizing two primary functions: (1) constructing internal representations to understand the mechanisms of the world, and (2) predicting future states to simulate and guide decision-making. Initially, we examine the current progress in these two categories. We then explore the application of world models in key domains, including generative games, autonomous driving, robotics, and social simulacra, with a focus on how each domain utilizes these aspects. Finally, we outline key challenges and provide insights into potential future research directions. We summarize the representative papers along with their code repositories in https://github.com/tsinghua-fib-lab/World-Model. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_14499 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Understanding World or Predicting Future? A Comprehensive Survey of World Models Ding, Jingtao Zhang, Yunke Shang, Yu Feng, Jie Zhang, Yuheng Zong, Zefang Yuan, Yuan Su, Hongyuan Li, Nian Piao, Jinghua Deng, Yucheng Sukiennik, Nicholas Gao, Chen Xu, Fengli Li, Yong Computation and Language Artificial Intelligence Machine Learning The concept of world models has garnered significant attention due to advancements in multimodal large language models such as GPT-4 and video generation models such as Sora, which are central to the pursuit of artificial general intelligence. This survey offers a comprehensive review of the literature on world models. Generally, world models are regarded as tools for either understanding the present state of the world or predicting its future dynamics. This review presents a systematic categorization of world models, emphasizing two primary functions: (1) constructing internal representations to understand the mechanisms of the world, and (2) predicting future states to simulate and guide decision-making. Initially, we examine the current progress in these two categories. We then explore the application of world models in key domains, including generative games, autonomous driving, robotics, and social simulacra, with a focus on how each domain utilizes these aspects. Finally, we outline key challenges and provide insights into potential future research directions. We summarize the representative papers along with their code repositories in https://github.com/tsinghua-fib-lab/World-Model. |
| title | Understanding World or Predicting Future? A Comprehensive Survey of World Models |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2411.14499 |