Null Space Properties of Neural Networks with Applications to Image Steganography

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Li, Xiang, Short, Kevin M.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911760740515840
author Li, Xiang
Short, Kevin M.
author_facet Li, Xiang
Short, Kevin M.
contents This paper explores the null space properties of neural networks. We extend the null space definition from linear to nonlinear maps and discuss the presence of a null space in neural networks. The null space of a given neural network can tell us the part of the input data that makes no contribution to the final prediction so that we can use it to trick the neural network. This reveals an inherent weakness in neural networks that can be exploited. One application described here leads to a method of image steganography. Through experiments on image datasets such as MNIST, we show that we can use null space components to force the neural network to choose a selected hidden image class, even though the overall image can be made to look like a completely different image. We conclude by showing comparisons between what a human viewer would see, and the part of the image that the neural network is actually using to make predictions and, hence, show that what the neural network ``sees'' is completely different than what we would expect.
format Preprint
id arxiv_https___arxiv_org_abs_2401_10262
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Null Space Properties of Neural Networks with Applications to Image Steganography
Li, Xiang
Short, Kevin M.
Computer Vision and Pattern Recognition
Artificial Intelligence
Cryptography and Security
Machine Learning
This paper explores the null space properties of neural networks. We extend the null space definition from linear to nonlinear maps and discuss the presence of a null space in neural networks. The null space of a given neural network can tell us the part of the input data that makes no contribution to the final prediction so that we can use it to trick the neural network. This reveals an inherent weakness in neural networks that can be exploited. One application described here leads to a method of image steganography. Through experiments on image datasets such as MNIST, we show that we can use null space components to force the neural network to choose a selected hidden image class, even though the overall image can be made to look like a completely different image. We conclude by showing comparisons between what a human viewer would see, and the part of the image that the neural network is actually using to make predictions and, hence, show that what the neural network ``sees'' is completely different than what we would expect.
title Null Space Properties of Neural Networks with Applications to Image Steganography
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2401.10262