Large Language Models for Video Surveillance Applications
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917884749414400 |
|---|---|
| author | De Silva, Ulindu Fernando, Leon Lik, Billy Lau Pik Koh, Zann Joyce, Sam Conrad Yuen, Belinda Yuen, Chau |
| author_facet | De Silva, Ulindu Fernando, Leon Lik, Billy Lau Pik Koh, Zann Joyce, Sam Conrad Yuen, Belinda Yuen, Chau |
| contents | The rapid increase in video content production has resulted in enormous data volumes, creating significant challenges for efficient analysis and resource management. To address this, robust video analysis tools are essential. This paper presents an innovative proof of concept using Generative Artificial Intelligence (GenAI) in the form of Vision Language Models to enhance the downstream video analysis process. Our tool generates customized textual summaries based on user-defined queries, providing focused insights within extensive video datasets. Unlike traditional methods that offer generic summaries or limited action recognition, our approach utilizes Vision Language Models to extract relevant information, improving analysis precision and efficiency. The proposed method produces textual summaries from extensive CCTV footage, which can then be stored for an indefinite time in a very small storage space compared to videos, allowing users to quickly navigate and verify significant events without exhaustive manual review. Qualitative evaluations result in 80% and 70% accuracy in temporal and spatial quality and consistency of the pipeline respectively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_02850 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Large Language Models for Video Surveillance Applications De Silva, Ulindu Fernando, Leon Lik, Billy Lau Pik Koh, Zann Joyce, Sam Conrad Yuen, Belinda Yuen, Chau Computer Vision and Pattern Recognition The rapid increase in video content production has resulted in enormous data volumes, creating significant challenges for efficient analysis and resource management. To address this, robust video analysis tools are essential. This paper presents an innovative proof of concept using Generative Artificial Intelligence (GenAI) in the form of Vision Language Models to enhance the downstream video analysis process. Our tool generates customized textual summaries based on user-defined queries, providing focused insights within extensive video datasets. Unlike traditional methods that offer generic summaries or limited action recognition, our approach utilizes Vision Language Models to extract relevant information, improving analysis precision and efficiency. The proposed method produces textual summaries from extensive CCTV footage, which can then be stored for an indefinite time in a very small storage space compared to videos, allowing users to quickly navigate and verify significant events without exhaustive manual review. Qualitative evaluations result in 80% and 70% accuracy in temporal and spatial quality and consistency of the pipeline respectively. |
| title | Large Language Models for Video Surveillance Applications |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2501.02850 |