Brain-inspired Computational Intelligence via Predictive Coding
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911237590220800 |
|---|---|
| author | Salvatori, Tommaso Mali, Ankur Buckley, Christopher L. Lukasiewicz, Thomas Rao, Rajesh P. N. Friston, Karl Ororbia, Alexander |
| author_facet | Salvatori, Tommaso Mali, Ankur Buckley, Christopher L. Lukasiewicz, Thomas Rao, Rajesh P. N. Friston, Karl Ororbia, Alexander |
| contents | Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The majority of results in AI thus far have been achieved using deep neural networks trained with a learning algorithm called error backpropagation, always considered biologically implausible. To this end, recent works have studied learning algorithms for deep neural networks inspired by the neurosciences. One such theory, called predictive coding (PC), has shown promising properties that make it potentially valuable for the machine learning community: it can model information processing in different areas of the brain, can be used in control and robotics, has a solid mathematical foundation in variational inference, and performs its computations asynchronously. Inspired by such properties, works that propose novel PC-like algorithms are starting to be present in multiple sub-fields of machine learning and AI at large. Here, we survey such efforts by first providing a broad overview of the history of PC to provide common ground for the understanding of the recent developments, then by describing current efforts and results, and concluding with a large discussion of possible implications and ways forward. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2308_07870 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Brain-inspired Computational Intelligence via Predictive Coding Salvatori, Tommaso Mali, Ankur Buckley, Christopher L. Lukasiewicz, Thomas Rao, Rajesh P. N. Friston, Karl Ororbia, Alexander Artificial Intelligence Machine Learning Neural and Evolutionary Computing Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The majority of results in AI thus far have been achieved using deep neural networks trained with a learning algorithm called error backpropagation, always considered biologically implausible. To this end, recent works have studied learning algorithms for deep neural networks inspired by the neurosciences. One such theory, called predictive coding (PC), has shown promising properties that make it potentially valuable for the machine learning community: it can model information processing in different areas of the brain, can be used in control and robotics, has a solid mathematical foundation in variational inference, and performs its computations asynchronously. Inspired by such properties, works that propose novel PC-like algorithms are starting to be present in multiple sub-fields of machine learning and AI at large. Here, we survey such efforts by first providing a broad overview of the history of PC to provide common ground for the understanding of the recent developments, then by describing current efforts and results, and concluding with a large discussion of possible implications and ways forward. |
| title | Brain-inspired Computational Intelligence via Predictive Coding |
| topic | Artificial Intelligence Machine Learning Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2308.07870 |