Obfuscation Based Privacy Preserving Representations are Recoverable Using Neighborhood Information

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chelani, Kunal, Benbihi, Assia, Kahl, Fredrik, Sattler, Torsten, Kukelova, Zuzana
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917918200037376
author Chelani, Kunal
Benbihi, Assia
Kahl, Fredrik
Sattler, Torsten
Kukelova, Zuzana
author_facet Chelani, Kunal
Benbihi, Assia
Kahl, Fredrik
Sattler, Torsten
Kukelova, Zuzana
contents Rapid growth in the popularity of AR/VR/MR applications and cloud-based visual localization systems has given rise to an increased focus on the privacy of user content in the localization process. This privacy concern has been further escalated by the ability of deep neural networks to recover detailed images of a scene from a sparse set of 3D or 2D points and their descriptors - the so-called inversion attacks. Research on privacy-preserving localization has therefore focused on preventing these inversion attacks on both the query image keypoints and the 3D points of the scene map. To this end, several geometry obfuscation techniques that lift points to higher-dimensional spaces, i.e., lines or planes, or that swap coordinates between points % have been proposed. In this paper, we point to a common weakness of these obfuscations that allows to recover approximations of the original point positions under the assumption of known neighborhoods. We further show that these neighborhoods can be computed by learning to identify descriptors that co-occur in neighborhoods. Extensive experiments show that our approach for point recovery is practically applicable to all existing geometric obfuscation schemes. Our results show that these schemes should not be considered privacy-preserving, even though they are claimed to be privacy-preserving. Code will be available at https://github.com/kunalchelani/RecoverPointsNeighborhood.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11536
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Obfuscation Based Privacy Preserving Representations are Recoverable Using Neighborhood Information
Chelani, Kunal
Benbihi, Assia
Kahl, Fredrik
Sattler, Torsten
Kukelova, Zuzana
Computer Vision and Pattern Recognition
Rapid growth in the popularity of AR/VR/MR applications and cloud-based visual localization systems has given rise to an increased focus on the privacy of user content in the localization process. This privacy concern has been further escalated by the ability of deep neural networks to recover detailed images of a scene from a sparse set of 3D or 2D points and their descriptors - the so-called inversion attacks. Research on privacy-preserving localization has therefore focused on preventing these inversion attacks on both the query image keypoints and the 3D points of the scene map. To this end, several geometry obfuscation techniques that lift points to higher-dimensional spaces, i.e., lines or planes, or that swap coordinates between points % have been proposed. In this paper, we point to a common weakness of these obfuscations that allows to recover approximations of the original point positions under the assumption of known neighborhoods. We further show that these neighborhoods can be computed by learning to identify descriptors that co-occur in neighborhoods. Extensive experiments show that our approach for point recovery is practically applicable to all existing geometric obfuscation schemes. Our results show that these schemes should not be considered privacy-preserving, even though they are claimed to be privacy-preserving. Code will be available at https://github.com/kunalchelani/RecoverPointsNeighborhood.
title Obfuscation Based Privacy Preserving Representations are Recoverable Using Neighborhood Information
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.11536