Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2404.14687 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914765758005248 |
|---|---|
| author | Jung, Raehyuk Go, Hyojun Yi, Jaehyuk Jang, Jiho Kim, Daniel Suh, Jay Lee, Aiden Han, Cooper Lee, Jae Kim, Jeff Kim, Jin-Young Kim, Junwan Park, Kyle Lee, Lucas Ha, Mars Seo, Minjoon Jo, Abraham Park, Ed Kianinejad, Hassan Kim, SJ Moon, Tony Jeong, Wade Popescu, Andrei Kim, Esther Yoon, EK Heo, Genie Choi, Henry Kang, Jenna Han, Kevin Seo, Noah Nguyen, Sunny Won, Ryan Park, Yeonhoo Giuliani, Anthony Chung, Dave Yoon, Hans Le, James Ahn, Jenny Lee, June Saini, Maninder Sanders, Meredith Lee, Soyoung Kim, Sue Couture, Travis |
| author_facet | Jung, Raehyuk Go, Hyojun Yi, Jaehyuk Jang, Jiho Kim, Daniel Suh, Jay Lee, Aiden Han, Cooper Lee, Jae Kim, Jeff Kim, Jin-Young Kim, Junwan Park, Kyle Lee, Lucas Ha, Mars Seo, Minjoon Jo, Abraham Park, Ed Kianinejad, Hassan Kim, SJ Moon, Tony Jeong, Wade Popescu, Andrei Kim, Esther Yoon, EK Heo, Genie Choi, Henry Kang, Jenna Han, Kevin Seo, Noah Nguyen, Sunny Won, Ryan Park, Yeonhoo Giuliani, Anthony Chung, Dave Yoon, Hans Le, James Ahn, Jenny Lee, June Saini, Maninder Sanders, Meredith Lee, Soyoung Kim, Sue Couture, Travis |
| contents | This technical report introduces Pegasus-1, a multimodal language model specialized in video content understanding and interaction through natural language. Pegasus-1 is designed to address the unique challenges posed by video data, such as interpreting spatiotemporal information, to offer nuanced video content comprehension across various lengths. This technical report overviews Pegasus-1's architecture, training strategies, and its performance in benchmarks on video conversation, zero-shot video question answering, and video summarization. We also explore qualitative characteristics of Pegasus-1 , demonstrating its capabilities as well as its limitations, in order to provide readers a balanced view of its current state and its future direction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_14687 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Pegasus-v1 Technical Report Jung, Raehyuk Go, Hyojun Yi, Jaehyuk Jang, Jiho Kim, Daniel Suh, Jay Lee, Aiden Han, Cooper Lee, Jae Kim, Jeff Kim, Jin-Young Kim, Junwan Park, Kyle Lee, Lucas Ha, Mars Seo, Minjoon Jo, Abraham Park, Ed Kianinejad, Hassan Kim, SJ Moon, Tony Jeong, Wade Popescu, Andrei Kim, Esther Yoon, EK Heo, Genie Choi, Henry Kang, Jenna Han, Kevin Seo, Noah Nguyen, Sunny Won, Ryan Park, Yeonhoo Giuliani, Anthony Chung, Dave Yoon, Hans Le, James Ahn, Jenny Lee, June Saini, Maninder Sanders, Meredith Lee, Soyoung Kim, Sue Couture, Travis Multimedia Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition This technical report introduces Pegasus-1, a multimodal language model specialized in video content understanding and interaction through natural language. Pegasus-1 is designed to address the unique challenges posed by video data, such as interpreting spatiotemporal information, to offer nuanced video content comprehension across various lengths. This technical report overviews Pegasus-1's architecture, training strategies, and its performance in benchmarks on video conversation, zero-shot video question answering, and video summarization. We also explore qualitative characteristics of Pegasus-1 , demonstrating its capabilities as well as its limitations, in order to provide readers a balanced view of its current state and its future direction. |
| title | Pegasus-v1 Technical Report |
| topic | Multimedia Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.14687 |