Learning Privacy from Visual Entities

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xompero, Alessio, Cavallaro, Andrea
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913738685153280
author Xompero, Alessio
Cavallaro, Andrea
author_facet Xompero, Alessio
Cavallaro, Andrea
contents Subjective interpretation and content diversity make predicting whether an image is private or public a challenging task. Graph neural networks combined with convolutional neural networks (CNNs), which consist of 14,000 to 500 millions parameters, generate features for visual entities (e.g., scene and object types) and identify the entities that contribute to the decision. In this paper, we show that using a simpler combination of transfer learning and a CNN to relate privacy with scene types optimises only 732 parameters while achieving comparable performance to that of graph-based methods. On the contrary, end-to-end training of graph-based methods can mask the contribution of individual components to the classification performance. Furthermore, we show that a high-dimensional feature vector, extracted with CNNs for each visual entity, is unnecessary and complexifies the model. The graph component has also negligible impact on performance, which is driven by fine-tuning the CNN to optimise image features for privacy nodes.
format Preprint
id arxiv_https___arxiv_org_abs_2503_12464
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning Privacy from Visual Entities
Xompero, Alessio
Cavallaro, Andrea
Computer Vision and Pattern Recognition
Machine Learning
Subjective interpretation and content diversity make predicting whether an image is private or public a challenging task. Graph neural networks combined with convolutional neural networks (CNNs), which consist of 14,000 to 500 millions parameters, generate features for visual entities (e.g., scene and object types) and identify the entities that contribute to the decision. In this paper, we show that using a simpler combination of transfer learning and a CNN to relate privacy with scene types optimises only 732 parameters while achieving comparable performance to that of graph-based methods. On the contrary, end-to-end training of graph-based methods can mask the contribution of individual components to the classification performance. Furthermore, we show that a high-dimensional feature vector, extracted with CNNs for each visual entity, is unnecessary and complexifies the model. The graph component has also negligible impact on performance, which is driven by fine-tuning the CNN to optimise image features for privacy nodes.
title Learning Privacy from Visual Entities
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2503.12464