Mitigating Challenges of the Space Environment for Onboard Artificial Intelligence: Design Overview of the Imaging Payload on SpIRIT
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910407562625024 |
|---|---|
| author | del Castillo, Miguel Ortiz Morgan, Jonathan McRobbie, Jack Therakam, Clint Joukhadar, Zaher Mearns, Robert Barraclough, Simon Sinnott, Richard Woods, Andrew Bayliss, Chris Ehinger, Kris Rubinstein, Ben Bailey, James Chapman, Airlie Trenti, Michele |
| author_facet | del Castillo, Miguel Ortiz Morgan, Jonathan McRobbie, Jack Therakam, Clint Joukhadar, Zaher Mearns, Robert Barraclough, Simon Sinnott, Richard Woods, Andrew Bayliss, Chris Ehinger, Kris Rubinstein, Ben Bailey, James Chapman, Airlie Trenti, Michele |
| contents | Artificial intelligence (AI) and autonomous edge computing in space are emerging areas of interest to augment capabilities of nanosatellites, where modern sensors generate orders of magnitude more data than can typically be transmitted to mission control. Here, we present the hardware and software design of an onboard AI subsystem hosted on SpIRIT. The system is optimised for on-board computer vision experiments based on visible light and long wave infrared cameras. This paper highlights the key design choices made to maximise the robustness of the system in harsh space conditions, and their motivation relative to key mission requirements, such as limited compute resources, resilience to cosmic radiation, extreme temperature variations, distribution shifts, and very low transmission bandwidths. The payload, called Loris, consists of six visible light cameras, three infrared cameras, a camera control board and a Graphics Processing Unit (GPU) system-on-module. Loris enables the execution of AI models with on-orbit fine-tuning as well as a next-generation image compression algorithm, including progressive coding. This innovative approach not only enhances the data processing capabilities of nanosatellites but also lays the groundwork for broader applications to remote sensing from space. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_08399 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Mitigating Challenges of the Space Environment for Onboard Artificial Intelligence: Design Overview of the Imaging Payload on SpIRIT del Castillo, Miguel Ortiz Morgan, Jonathan McRobbie, Jack Therakam, Clint Joukhadar, Zaher Mearns, Robert Barraclough, Simon Sinnott, Richard Woods, Andrew Bayliss, Chris Ehinger, Kris Rubinstein, Ben Bailey, James Chapman, Airlie Trenti, Michele Computer Vision and Pattern Recognition Artificial intelligence (AI) and autonomous edge computing in space are emerging areas of interest to augment capabilities of nanosatellites, where modern sensors generate orders of magnitude more data than can typically be transmitted to mission control. Here, we present the hardware and software design of an onboard AI subsystem hosted on SpIRIT. The system is optimised for on-board computer vision experiments based on visible light and long wave infrared cameras. This paper highlights the key design choices made to maximise the robustness of the system in harsh space conditions, and their motivation relative to key mission requirements, such as limited compute resources, resilience to cosmic radiation, extreme temperature variations, distribution shifts, and very low transmission bandwidths. The payload, called Loris, consists of six visible light cameras, three infrared cameras, a camera control board and a Graphics Processing Unit (GPU) system-on-module. Loris enables the execution of AI models with on-orbit fine-tuning as well as a next-generation image compression algorithm, including progressive coding. This innovative approach not only enhances the data processing capabilities of nanosatellites but also lays the groundwork for broader applications to remote sensing from space. |
| title | Mitigating Challenges of the Space Environment for Onboard Artificial Intelligence: Design Overview of the Imaging Payload on SpIRIT |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.08399 |