AdaptiveCoPilot: Design and Testing of a NeuroAdaptive LLM Cockpit Guidance System in both Novice and Expert Pilots
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909451072569344 |
|---|---|
| author | Wen, Shaoyue Middleton, Michael Ping, Songming Chawla, Nayan N Wu, Guande Feest, Bradley S Nadri, Chihab Liu, Yunmei Kaber, David Zahabi, Maryam McMahan, Ryan P. Castelo, Sonia Mckendrick, Ryan Qian, Jing Silva, Claudio |
| author_facet | Wen, Shaoyue Middleton, Michael Ping, Songming Chawla, Nayan N Wu, Guande Feest, Bradley S Nadri, Chihab Liu, Yunmei Kaber, David Zahabi, Maryam McMahan, Ryan P. Castelo, Sonia Mckendrick, Ryan Qian, Jing Silva, Claudio |
| contents | Pilots operating modern cockpits often face high cognitive demands due to complex interfaces and multitasking requirements, which can lead to overload and decreased performance. This study introduces AdaptiveCoPilot, a neuroadaptive guidance system that adapts visual, auditory, and textual cues in real time based on the pilot's cognitive workload, measured via functional Near-Infrared Spectroscopy (fNIRS). A formative study with expert pilots (N=3) identified adaptive rules for modality switching and information load adjustments during preflight tasks. These insights informed the design of AdaptiveCoPilot, which integrates cognitive state assessments, behavioral data, and adaptive strategies within a context-aware Large Language Model (LLM). The system was evaluated in a virtual reality (VR) simulated cockpit with licensed pilots (N=8), comparing its performance against baseline and random feedback conditions. The results indicate that the pilots using AdaptiveCoPilot exhibited higher rates of optimal cognitive load states on the facets of working memory and perception, along with reduced task completion times. Based on the formative study, experimental findings, qualitative interviews, we propose a set of strategies for future development of neuroadaptive pilot guidance systems and highlight the potential of neuroadaptive systems to enhance pilot performance and safety in aviation environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_04156 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AdaptiveCoPilot: Design and Testing of a NeuroAdaptive LLM Cockpit Guidance System in both Novice and Expert Pilots Wen, Shaoyue Middleton, Michael Ping, Songming Chawla, Nayan N Wu, Guande Feest, Bradley S Nadri, Chihab Liu, Yunmei Kaber, David Zahabi, Maryam McMahan, Ryan P. Castelo, Sonia Mckendrick, Ryan Qian, Jing Silva, Claudio Human-Computer Interaction H.1.2; I.2.1; I.2.7 Pilots operating modern cockpits often face high cognitive demands due to complex interfaces and multitasking requirements, which can lead to overload and decreased performance. This study introduces AdaptiveCoPilot, a neuroadaptive guidance system that adapts visual, auditory, and textual cues in real time based on the pilot's cognitive workload, measured via functional Near-Infrared Spectroscopy (fNIRS). A formative study with expert pilots (N=3) identified adaptive rules for modality switching and information load adjustments during preflight tasks. These insights informed the design of AdaptiveCoPilot, which integrates cognitive state assessments, behavioral data, and adaptive strategies within a context-aware Large Language Model (LLM). The system was evaluated in a virtual reality (VR) simulated cockpit with licensed pilots (N=8), comparing its performance against baseline and random feedback conditions. The results indicate that the pilots using AdaptiveCoPilot exhibited higher rates of optimal cognitive load states on the facets of working memory and perception, along with reduced task completion times. Based on the formative study, experimental findings, qualitative interviews, we propose a set of strategies for future development of neuroadaptive pilot guidance systems and highlight the potential of neuroadaptive systems to enhance pilot performance and safety in aviation environments. |
| title | AdaptiveCoPilot: Design and Testing of a NeuroAdaptive LLM Cockpit Guidance System in both Novice and Expert Pilots |
| topic | Human-Computer Interaction H.1.2; I.2.1; I.2.7 |
| url | https://arxiv.org/abs/2501.04156 |