Contracting Neural Networks: Sharp LMI Conditions with Applications to Integral Control and Deep Learning
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914435802595328 |
|---|---|
| author | Gokhale, Anand Proskurnikov, Anton V. Kawano, Yu Bullo, Francesco |
| author_facet | Gokhale, Anand Proskurnikov, Anton V. Kawano, Yu Bullo, Francesco |
| contents | This paper studies contractivity of firing-rate and Hopfield recurrent neural networks. We derive sharp LMI conditions on the synaptic matrices that characterize contractivity of both architectures, for activation functions that are either non-expansive or monotone non-expansive, in both continuous and discrete time. We establish structural relationships among these conditions, including connections to Schur diagonal stability and the recovery of optimal contraction rates for symmetric synaptic matrices. We demonstrate the utility of these results through two applications. First, we develop an LMI-based design procedure for low-gain integral controllers enabling reference tracking in contracting firing rate networks. Second, we provide an exact parameterization of weight matrices that guarantee contraction and use it to improve the expressivity of Implicit Neural Networks, achieving competitive performance on image classification benchmarks with fewer parameters. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_00119 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Contracting Neural Networks: Sharp LMI Conditions with Applications to Integral Control and Deep Learning Gokhale, Anand Proskurnikov, Anton V. Kawano, Yu Bullo, Francesco Systems and Control Optimization and Control This paper studies contractivity of firing-rate and Hopfield recurrent neural networks. We derive sharp LMI conditions on the synaptic matrices that characterize contractivity of both architectures, for activation functions that are either non-expansive or monotone non-expansive, in both continuous and discrete time. We establish structural relationships among these conditions, including connections to Schur diagonal stability and the recovery of optimal contraction rates for symmetric synaptic matrices. We demonstrate the utility of these results through two applications. First, we develop an LMI-based design procedure for low-gain integral controllers enabling reference tracking in contracting firing rate networks. Second, we provide an exact parameterization of weight matrices that guarantee contraction and use it to improve the expressivity of Implicit Neural Networks, achieving competitive performance on image classification benchmarks with fewer parameters. |
| title | Contracting Neural Networks: Sharp LMI Conditions with Applications to Integral Control and Deep Learning |
| topic | Systems and Control Optimization and Control |
| url | https://arxiv.org/abs/2604.00119 |