Saved in:
Bibliographic Details
Main Authors: Qiu, Tianming, Sonis, Christos, Shen, Hao
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.23181
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Weight Space Learning (WSL), which frames neural network weights as a data modality, is an emerging field with potential for tasks like meta-learning or transfer learning. Particularly, Implicit Neural Representations (INRs) provide a convenient testbed, where each set of weights determines the corresponding individual data sample as a mapping from coordinates to contextual values. So far, a precise theoretical explanation for the mechanism of encoding semantics of data into network weights is still missing. In this work, we deploy the Implicit Function Theorem (IFT) to establish a rigorous mapping between the data space and its latent weight representation space. We analyze a framework that maps instance-specific embeddings to INR weights via a shared hypernetwork, achieving performance competitive with existing baselines on downstream classification tasks across 2D and 3D datasets. These findings offer a theoretical lens for future investigations into network weights.