Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910624129220608 |
|---|---|
| author | Goldfeder, Judah Roets, Quinten Guo, Gabe Wright, John Lipson, Hod |
| author_facet | Goldfeder, Judah Roets, Quinten Guo, Gabe Wright, John Lipson, Hod |
| contents | Inferring the exact parameters of a neural network with only query access is an NP-Hard problem, with few practical existing algorithms. Solutions would have major implications for security, verification, interpretability, and understanding biological networks. The key challenges are the massive parameter space, and complex non-linear relationships between neurons. We resolve these challenges using two insights. First, we observe that almost all networks used in practice are produced by random initialization and first order optimization, an inductive bias that drastically reduces the practical parameter space. Second, we present a novel query generation algorithm that produces maximally informative samples, letting us untangle the non-linear relationships efficiently. We demonstrate reconstruction of a hidden network containing over 1.5 million parameters, and of one 7 layers deep, the largest and deepest reconstructions to date, with max parameter difference less than 0.0001, and illustrate robustness and scalability across a variety of architectures, datasets, and training procedures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_19138 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks Goldfeder, Judah Roets, Quinten Guo, Gabe Wright, John Lipson, Hod Machine Learning Artificial Intelligence Cryptography and Security Information Theory Neural and Evolutionary Computing Inferring the exact parameters of a neural network with only query access is an NP-Hard problem, with few practical existing algorithms. Solutions would have major implications for security, verification, interpretability, and understanding biological networks. The key challenges are the massive parameter space, and complex non-linear relationships between neurons. We resolve these challenges using two insights. First, we observe that almost all networks used in practice are produced by random initialization and first order optimization, an inductive bias that drastically reduces the practical parameter space. Second, we present a novel query generation algorithm that produces maximally informative samples, letting us untangle the non-linear relationships efficiently. We demonstrate reconstruction of a hidden network containing over 1.5 million parameters, and of one 7 layers deep, the largest and deepest reconstructions to date, with max parameter difference less than 0.0001, and illustrate robustness and scalability across a variety of architectures, datasets, and training procedures. |
| title | Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks |
| topic | Machine Learning Artificial Intelligence Cryptography and Security Information Theory Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2409.19138 |