Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Ishikawa, Satoki, Yokota, Rio, Karakida, Ryo |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width
par: Ishikawa, Satoki, et autres
Publié: (2023)
par: Ishikawa, Satoki, et autres
Publié: (2023)
Recurrent Self-Attention Dynamics: An Energy-Agnostic Perspective from Jacobians
par: Tomihari, Akiyoshi, et autres
Publié: (2025)
par: Tomihari, Akiyoshi, et autres
Publié: (2025)
On the Infinite Width and Depth Limits of Predictive Coding Networks
par: Innocenti, Francesco, et autres
Publié: (2026)
par: Innocenti, Francesco, et autres
Publié: (2026)
Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking
par: Karakida, Ryo, et autres
Publié: (2024)
par: Karakida, Ryo, et autres
Publié: (2024)
Evolutionary Context Search for Automated Skill Acquisition
par: Sun, Qi, et autres
Publié: (2026)
par: Sun, Qi, et autres
Publié: (2026)
A Unified Physics-Informed Neural Network for Modeling Coupled Electro- and Elastodynamic Wave Propagation Using Three-Stage Loss Optimization
par: Bharadwaj, Suhas Suresh, et autres
Publié: (2026)
par: Bharadwaj, Suhas Suresh, et autres
Publié: (2026)
Efficient Online Learning with Predictive Coding Networks: Exploiting Temporal Correlations
par: Zadeh-Jousdani, Darius Masoum, et autres
Publié: (2025)
par: Zadeh-Jousdani, Darius Masoum, et autres
Publié: (2025)
Scaling Equilibrium Propagation to Deeper Neural Network Architectures
par: Elayedam, Sankar Vinayak, et autres
Publié: (2025)
par: Elayedam, Sankar Vinayak, et autres
Publié: (2025)
Recurrent Joint Embedding Predictive Architecture with Recurrent Forward Propagation Learning
par: Velarde, Osvaldo M, et autres
Publié: (2024)
par: Velarde, Osvaldo M, et autres
Publié: (2024)
A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks
par: Salvatori, Tommaso, et autres
Publié: (2022)
par: Salvatori, Tommaso, et autres
Publié: (2022)
A Consolidated Volatility Prediction with Back Propagation Neural Network and Genetic Algorithm
par: Ke, Zong, et autres
Publié: (2024)
par: Ke, Zong, et autres
Publié: (2024)
EchoSpike Predictive Plasticity: An Online Local Learning Rule for Spiking Neural Networks
par: Graf, Lars, et autres
Publié: (2024)
par: Graf, Lars, et autres
Publié: (2024)
($\boldsymbolθ_l, \boldsymbolθ_u$)-Parametric Multi-Task Optimization: Joint Search in Solution and Infinite Task Spaces
par: Wei, Tingyang, et autres
Publié: (2025)
par: Wei, Tingyang, et autres
Publié: (2025)
Traces Propagation: Memory-Efficient and Scalable Forward-Only Learning in Spiking Neural Networks
par: Pes, Lorenzo, et autres
Publié: (2025)
par: Pes, Lorenzo, et autres
Publié: (2025)
The Enduring Dominance of Deep Neural Networks: A Critical Analysis of the Fundamental Limitations of Quantum Machine Learning and Spiking Neural Networks
par: Ishikawa, Takehiro
Publié: (2025)
par: Ishikawa, Takehiro
Publié: (2025)
Active Sensing with Predictive Coding and Uncertainty Minimization
par: Sharafeldin, Abdelrahman, et autres
Publié: (2023)
par: Sharafeldin, Abdelrahman, et autres
Publié: (2023)
Equilibrium Propagation Without Limits
par: Litman, Elon
Publié: (2025)
par: Litman, Elon
Publié: (2025)
Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues
par: Orvieto, Antonio, et autres
Publié: (2023)
par: Orvieto, Antonio, et autres
Publié: (2023)
Sensitivity-Aware Mixed-Precision Quantization and Width Optimization of Deep Neural Networks Through Cluster-Based Tree-Structured Parzen Estimation
par: Azizi, Seyedarmin, et autres
Publié: (2023)
par: Azizi, Seyedarmin, et autres
Publié: (2023)
GRASP: GRouped Activation Shared Parameterization for Parameter-Efficient Fine-Tuning and Robust Inference of Transformers
par: Bal, Malyaban, et autres
Publié: (2025)
par: Bal, Malyaban, et autres
Publié: (2025)
Introduction to Predictive Coding Networks for Machine Learning
par: Stenlund, Mikko
Publié: (2025)
par: Stenlund, Mikko
Publié: (2025)
Incremental Affinity Propagation based on Cluster Consolidation and Stratification
par: Castano, Silvana, et autres
Publié: (2024)
par: Castano, Silvana, et autres
Publié: (2024)
Rethinking Recurrent Neural Networks for Time Series Forecasting: A Reinforced Recurrent Encoder with Prediction-Oriented Proximal Policy Optimization
par: Lai, Xin, et autres
Publié: (2026)
par: Lai, Xin, et autres
Publié: (2026)
Nature-Inspired Local Propagation
par: Betti, Alessandro, et autres
Publié: (2024)
par: Betti, Alessandro, et autres
Publié: (2024)
JPC: Flexible Inference for Predictive Coding Networks in JAX
par: Innocenti, Francesco, et autres
Publié: (2024)
par: Innocenti, Francesco, et autres
Publié: (2024)
Proxy Target: Bridging the Gap Between Discrete Spiking Neural Networks and Continuous Control
par: Xu, Zijie, et autres
Publié: (2025)
par: Xu, Zijie, et autres
Publié: (2025)
Repair Brain Damage: Real-Numbered Error Correction Code for Neural Network
par: Li, Ziqing, et autres
Publié: (2026)
par: Li, Ziqing, et autres
Publié: (2026)
Stochastic Quantum Spiking Neural Networks with Quantum Memory and Local Learning
par: Chen, Jiechen, et autres
Publié: (2025)
par: Chen, Jiechen, et autres
Publié: (2025)
Unsupervised Sparse Coding-based Spiking Neural Network for Real-time Spike Sorting
par: Melot, Alexis, et autres
Publié: (2025)
par: Melot, Alexis, et autres
Publié: (2025)
Dataset Optimization for Chronic Disease Prediction with Bio-Inspired Feature Selection
par: Dyoub, Abeer, et autres
Publié: (2023)
par: Dyoub, Abeer, et autres
Publié: (2023)
S-TLLR: STDP-inspired Temporal Local Learning Rule for Spiking Neural Networks
par: Apolinario, Marco Paul E., et autres
Publié: (2023)
par: Apolinario, Marco Paul E., et autres
Publié: (2023)
Evolving Multi-Channel Confidence-Aware Activation Functions for Missing Data with Channel Propagation
par: Sani, Naeem Shahabi, et autres
Publié: (2026)
par: Sani, Naeem Shahabi, et autres
Publié: (2026)
Leveraging Latent Evolutionary Optimization for Targeted Molecule Generation
par: N, Siddartha Reddy, et autres
Publié: (2024)
par: N, Siddartha Reddy, et autres
Publié: (2024)
Effective Regularization Through Loss-Function Metalearning
par: Gonzalez, Santiago, et autres
Publié: (2020)
par: Gonzalez, Santiago, et autres
Publié: (2020)
Optimizing Neural Network Performance and Interpretability with Diophantine Equation Encoding
par: Katende, Ronald
Publié: (2024)
par: Katende, Ronald
Publié: (2024)
Self-Motivated Growing Neural Network for Adaptive Architecture via Local Structural Plasticity
par: Jia, Yiyang, et autres
Publié: (2025)
par: Jia, Yiyang, et autres
Publié: (2025)
Supervised Spike Agreement Dependent Plasticity for Fast Local Learning in Spiking Neural Networks
par: S, Gouri Lakshmi, et autres
Publié: (2026)
par: S, Gouri Lakshmi, et autres
Publié: (2026)
DGDNN: Decoupled Graph Diffusion Neural Network for Stock Movement Prediction
par: You, Zinuo, et autres
Publié: (2024)
par: You, Zinuo, et autres
Publié: (2024)
Gradient-Based Neuroplastic Adaptation for Concurrent Optimization of Neuro-Fuzzy Networks
par: Hostetter, John Wesley, et autres
Publié: (2025)
par: Hostetter, John Wesley, et autres
Publié: (2025)
Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning
par: Raymond, Christian, et autres
Publié: (2022)
par: Raymond, Christian, et autres
Publié: (2022)
Documents similaires
-
On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width
par: Ishikawa, Satoki, et autres
Publié: (2023) -
Recurrent Self-Attention Dynamics: An Energy-Agnostic Perspective from Jacobians
par: Tomihari, Akiyoshi, et autres
Publié: (2025) -
On the Infinite Width and Depth Limits of Predictive Coding Networks
par: Innocenti, Francesco, et autres
Publié: (2026) -
Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking
par: Karakida, Ryo, et autres
Publié: (2024) -
Evolutionary Context Search for Automated Skill Acquisition
par: Sun, Qi, et autres
Publié: (2026)