VKIE: The Application of Key Information Extraction on Video Text
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929203431079936 |
|---|---|
| author | An, Siyu Liu, Ye Peng, Haoyuan Yin, Di |
| author_facet | An, Siyu Liu, Ye Peng, Haoyuan Yin, Di |
| contents | Extracting structured information from videos is critical for numerous downstream applications in the industry. In this paper, we define a significant task of extracting hierarchical key information from visual texts on videos. To fulfill this task, we decouple it into four subtasks and introduce two implementation solutions called PipVKIE and UniVKIE. PipVKIE sequentially completes the four subtasks in continuous stages, while UniVKIE is improved by unifying all the subtasks into one backbone. Both PipVKIE and UniVKIE leverage multimodal information from vision, text, and coordinates for feature representation. Extensive experiments on one well-defined dataset demonstrate that our solutions can achieve remarkable performance and efficient inference speed. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_11650 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | VKIE: The Application of Key Information Extraction on Video Text An, Siyu Liu, Ye Peng, Haoyuan Yin, Di Information Retrieval Computer Vision and Pattern Recognition Multimedia Extracting structured information from videos is critical for numerous downstream applications in the industry. In this paper, we define a significant task of extracting hierarchical key information from visual texts on videos. To fulfill this task, we decouple it into four subtasks and introduce two implementation solutions called PipVKIE and UniVKIE. PipVKIE sequentially completes the four subtasks in continuous stages, while UniVKIE is improved by unifying all the subtasks into one backbone. Both PipVKIE and UniVKIE leverage multimodal information from vision, text, and coordinates for feature representation. Extensive experiments on one well-defined dataset demonstrate that our solutions can achieve remarkable performance and efficient inference speed. |
| title | VKIE: The Application of Key Information Extraction on Video Text |
| topic | Information Retrieval Computer Vision and Pattern Recognition Multimedia |
| url | https://arxiv.org/abs/2310.11650 |