TRACES: Temporal Recall with Contextual Embeddings for Real-Time Video Anomaly Detection
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915591967735808 |
|---|---|
| author | Siddiqui, Yousuf Ahmed Usmani, Sufiyaan Tariq, Umer Shamsi, Jawwad Ahmed Khan, Muhammad Burhan |
| author_facet | Siddiqui, Yousuf Ahmed Usmani, Sufiyaan Tariq, Umer Shamsi, Jawwad Ahmed Khan, Muhammad Burhan |
| contents | Video anomalies often depend on contextual information available and temporal evolution. Non-anomalous action in one context can be anomalous in some other context. Most anomaly detectors, however, do not notice this type of context, which seriously limits their capability to generalize to new, real-life situations. Our work addresses the context-aware zero-shot anomaly detection challenge, in which systems need to learn adaptively to detect new events by correlating temporal and appearance features with textual traces of memory in real time. Our approach defines a memory-augmented pipeline, correlating temporal signals with visual embeddings using cross-attention, and real-time zero-shot anomaly classification by contextual similarity scoring. We achieve 90.4\% AUC on UCF-Crime and 83.67\% AP on XD-Violence, a new state-of-the-art among zero-shot models. Our model achieves real-time inference with high precision and explainability for deployment. We show that, by fusing cross-attention temporal fusion and contextual memory, we achieve high fidelity anomaly detection, a step towards the applicability of zero-shot models in real-world surveillance and infrastructure monitoring. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_00580 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | TRACES: Temporal Recall with Contextual Embeddings for Real-Time Video Anomaly Detection Siddiqui, Yousuf Ahmed Usmani, Sufiyaan Tariq, Umer Shamsi, Jawwad Ahmed Khan, Muhammad Burhan Computer Vision and Pattern Recognition Artificial Intelligence 68T07, 68T45, 68U10 I.2.10; I.5.4; I.4.8; C.3 Video anomalies often depend on contextual information available and temporal evolution. Non-anomalous action in one context can be anomalous in some other context. Most anomaly detectors, however, do not notice this type of context, which seriously limits their capability to generalize to new, real-life situations. Our work addresses the context-aware zero-shot anomaly detection challenge, in which systems need to learn adaptively to detect new events by correlating temporal and appearance features with textual traces of memory in real time. Our approach defines a memory-augmented pipeline, correlating temporal signals with visual embeddings using cross-attention, and real-time zero-shot anomaly classification by contextual similarity scoring. We achieve 90.4\% AUC on UCF-Crime and 83.67\% AP on XD-Violence, a new state-of-the-art among zero-shot models. Our model achieves real-time inference with high precision and explainability for deployment. We show that, by fusing cross-attention temporal fusion and contextual memory, we achieve high fidelity anomaly detection, a step towards the applicability of zero-shot models in real-world surveillance and infrastructure monitoring. |
| title | TRACES: Temporal Recall with Contextual Embeddings for Real-Time Video Anomaly Detection |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence 68T07, 68T45, 68U10 I.2.10; I.5.4; I.4.8; C.3 |
| url | https://arxiv.org/abs/2511.00580 |