Embedding Aggregation for Forensic Facial Comparison
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915111059324928 |
|---|---|
| author | Ribeiro, Rafael Oliveira Neves, João C. R. Ruifrok, Arnout C. C. Vidal, Flavio de Barros |
| author_facet | Ribeiro, Rafael Oliveira Neves, João C. R. Ruifrok, Arnout C. C. Vidal, Flavio de Barros |
| contents | In forensic facial comparison, questioned-source images are usually captured in uncontrolled environments, with non-uniform lighting, and from non-cooperative subjects. The poor quality of such material usually compromises their value as evidence in legal matters. On the other hand, in forensic casework, multiple images of the person of interest are usually available. In this paper, we propose to aggregate deep neural network embeddings from various images of the same person to improve performance in facial verification. We observe significant performance improvements, especially for very low-quality images. Further improvements are obtained by aggregating embeddings of more images and by applying quality-weighted aggregation. We demonstrate the benefits of this approach in forensic evaluation settings with the development and validation of score-based likelihood ratio systems and report improvements in Cllr of up to 95% (from 0.249 to 0.012) for CCTV images and of up to 96% (from 0.083 to 0.003) for social media images. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_00352 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Embedding Aggregation for Forensic Facial Comparison Ribeiro, Rafael Oliveira Neves, João C. R. Ruifrok, Arnout C. C. Vidal, Flavio de Barros Computer Vision and Pattern Recognition Applications I.4; I.5 In forensic facial comparison, questioned-source images are usually captured in uncontrolled environments, with non-uniform lighting, and from non-cooperative subjects. The poor quality of such material usually compromises their value as evidence in legal matters. On the other hand, in forensic casework, multiple images of the person of interest are usually available. In this paper, we propose to aggregate deep neural network embeddings from various images of the same person to improve performance in facial verification. We observe significant performance improvements, especially for very low-quality images. Further improvements are obtained by aggregating embeddings of more images and by applying quality-weighted aggregation. We demonstrate the benefits of this approach in forensic evaluation settings with the development and validation of score-based likelihood ratio systems and report improvements in Cllr of up to 95% (from 0.249 to 0.012) for CCTV images and of up to 96% (from 0.083 to 0.003) for social media images. |
| title | Embedding Aggregation for Forensic Facial Comparison |
| topic | Computer Vision and Pattern Recognition Applications I.4; I.5 |
| url | https://arxiv.org/abs/2305.00352 |