Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fil, Jakub, Sandamirskaya, Yulia, Gonzalez, Hector, Azzalin, Loïc, Glüge, Stefan, Friedenstab, Lukas, Wolf, Friedrich, Rosmeisl, Tim, Lohrmann, Matthias, Akl, Mahmoud, Khan, Khaleel, Wolf, Leonie, Richter, Kristin, Puder, Holm, Bari, Mazhar Ali, Choo, Xuan, Alharthi, Noha, Hopkins, Michael, Mayr, Mansoor Hanif Christian, Struckmeier, Jens, Furber, Steve
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2601.09755
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909990748422144
author Fil, Jakub
Sandamirskaya, Yulia
Gonzalez, Hector
Azzalin, Loïc
Glüge, Stefan
Friedenstab, Lukas
Wolf, Friedrich
Rosmeisl, Tim
Lohrmann, Matthias
Akl, Mahmoud
Khan, Khaleel
Wolf, Leonie
Richter, Kristin
Puder, Holm
Bari, Mazhar Ali
Choo, Xuan
Alharthi, Noha
Hopkins, Michael
Mayr, Mansoor Hanif Christian
Struckmeier, Jens
Furber, Steve
author_facet Fil, Jakub
Sandamirskaya, Yulia
Gonzalez, Hector
Azzalin, Loïc
Glüge, Stefan
Friedenstab, Lukas
Wolf, Friedrich
Rosmeisl, Tim
Lohrmann, Matthias
Akl, Mahmoud
Khan, Khaleel
Wolf, Leonie
Richter, Kristin
Puder, Holm
Bari, Mazhar Ali
Choo, Xuan
Alharthi, Noha
Hopkins, Michael
Mayr, Mansoor Hanif Christian
Struckmeier, Jens
Furber, Steve
contents After Industry 4.0 has embraced tight integration between machinery (OT), software (IT), and the Internet, creating a web of sensors, data, and algorithms in service of efficient and reliable production, a new concept of Society 5.0 is emerging, in which infrastructure of a city will be instrumented to increase reliability, efficiency, and safety. Robotics will play a pivotal role in enabling this vision that is pioneered by the NEOM initiative - a smart city, co-inhabited by humans and robots. In this paper we explore the computing platform that will be required to enable this vision. We show how we can combine neuromorphic computing hardware, exemplified by the Loihi2 processor used in conjunction with event-based cameras, for sensing and real-time perception and interaction with a local AI compute cluster (GPUs) for high-level language processing, cognition, and task planning. We demonstrate the use of this hybrid computing architecture in an interactive task, in which a humanoid robot plays a musical instrument with a human. Central to our design is the efficient and seamless integration of disparate components, ensuring that the synergy between software and hardware maximizes overall performance and responsiveness. Our proposed system architecture underscores the potential of heterogeneous computing architectures in advancing robotic autonomy and interactive intelligence, pointing toward a future where such integrated systems become the norm in complex, real-time applications.
format Preprint
id arxiv_https___arxiv_org_abs_2601_09755
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Heterogeneous computing platform for real-time robotics
Fil, Jakub
Sandamirskaya, Yulia
Gonzalez, Hector
Azzalin, Loïc
Glüge, Stefan
Friedenstab, Lukas
Wolf, Friedrich
Rosmeisl, Tim
Lohrmann, Matthias
Akl, Mahmoud
Khan, Khaleel
Wolf, Leonie
Richter, Kristin
Puder, Holm
Bari, Mazhar Ali
Choo, Xuan
Alharthi, Noha
Hopkins, Michael
Mayr, Mansoor Hanif Christian
Struckmeier, Jens
Furber, Steve
Neural and Evolutionary Computing
Artificial Intelligence
Robotics
After Industry 4.0 has embraced tight integration between machinery (OT), software (IT), and the Internet, creating a web of sensors, data, and algorithms in service of efficient and reliable production, a new concept of Society 5.0 is emerging, in which infrastructure of a city will be instrumented to increase reliability, efficiency, and safety. Robotics will play a pivotal role in enabling this vision that is pioneered by the NEOM initiative - a smart city, co-inhabited by humans and robots. In this paper we explore the computing platform that will be required to enable this vision. We show how we can combine neuromorphic computing hardware, exemplified by the Loihi2 processor used in conjunction with event-based cameras, for sensing and real-time perception and interaction with a local AI compute cluster (GPUs) for high-level language processing, cognition, and task planning. We demonstrate the use of this hybrid computing architecture in an interactive task, in which a humanoid robot plays a musical instrument with a human. Central to our design is the efficient and seamless integration of disparate components, ensuring that the synergy between software and hardware maximizes overall performance and responsiveness. Our proposed system architecture underscores the potential of heterogeneous computing architectures in advancing robotic autonomy and interactive intelligence, pointing toward a future where such integrated systems become the norm in complex, real-time applications.
title Heterogeneous computing platform for real-time robotics
topic Neural and Evolutionary Computing
Artificial Intelligence
Robotics
url https://arxiv.org/abs/2601.09755