Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.05615 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918495014354944 |
|---|---|
| author | Nguyen, Thong Bin, Yi Xiao, Junbin Qu, Leigang Li, Yicong Wu, Jay Zhangjie Nguyen, Cong-Duy Ng, See-Kiong Tuan, Luu Anh |
| author_facet | Nguyen, Thong Bin, Yi Xiao, Junbin Qu, Leigang Li, Yicong Wu, Jay Zhangjie Nguyen, Cong-Duy Ng, See-Kiong Tuan, Luu Anh |
| contents | Humans use multiple senses to comprehend the environment. Vision and language are two of the most vital senses since they allow us to easily communicate our thoughts and perceive the world around us. There has been a lot of interest in creating video-language understanding systems with human-like senses since a video-language pair can mimic both our linguistic medium and visual environment with temporal dynamics. In this survey, we review the key tasks of these systems and highlight the associated challenges. Based on the challenges, we summarize their methods from model architecture, model training, and data perspectives. We also conduct performance comparison among the methods, and discuss promising directions for future research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_05615 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives Nguyen, Thong Bin, Yi Xiao, Junbin Qu, Leigang Li, Yicong Wu, Jay Zhangjie Nguyen, Cong-Duy Ng, See-Kiong Tuan, Luu Anh Computation and Language Humans use multiple senses to comprehend the environment. Vision and language are two of the most vital senses since they allow us to easily communicate our thoughts and perceive the world around us. There has been a lot of interest in creating video-language understanding systems with human-like senses since a video-language pair can mimic both our linguistic medium and visual environment with temporal dynamics. In this survey, we review the key tasks of these systems and highlight the associated challenges. Based on the challenges, we summarize their methods from model architecture, model training, and data perspectives. We also conduct performance comparison among the methods, and discuss promising directions for future research. |
| title | Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.05615 |