MIRAGE: Enabling Real-Time Automotive Mediated Reality

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jansen, Pascal, Britten, Julian, Colley, Mark, Sasalovici, Markus, Rukzio, Enrico
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911402394910720
author Jansen, Pascal
Britten, Julian
Colley, Mark
Sasalovici, Markus
Rukzio, Enrico
author_facet Jansen, Pascal
Britten, Julian
Colley, Mark
Sasalovici, Markus
Rukzio, Enrico
contents Traffic is inherently dangerous, with around 1.19 million fatalities annually. Automotive Mediated Reality (AMR) can enhance driving safety by overlaying critical information (e.g., outlines, icons, text) on key objects to improve awareness, altering objects' appearance to simplify traffic situations, and diminishing their appearance to minimize distractions. However, real-world AMR evaluation remains limited due to technical challenges. To fill this sim-to-real gap, we present MIRAGE, an open-source tool that enables real-time AMR in real vehicles. MIRAGE implements 15 effects across the AMR spectrum of augmented, diminished, and modified reality using state-of-the-art computational models for object detection and segmentation, depth estimation, and inpainting. In an on-road expert user study (N=9) of MIRAGE, participants enjoyed the AMR experience while pointing out technical limitations and identifying use cases for AMR. We discuss these results in relation to prior work and outline implications for AMR ethics and interaction design.
format Preprint
id arxiv_https___arxiv_org_abs_2601_19385
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MIRAGE: Enabling Real-Time Automotive Mediated Reality
Jansen, Pascal
Britten, Julian
Colley, Mark
Sasalovici, Markus
Rukzio, Enrico
Human-Computer Interaction
Traffic is inherently dangerous, with around 1.19 million fatalities annually. Automotive Mediated Reality (AMR) can enhance driving safety by overlaying critical information (e.g., outlines, icons, text) on key objects to improve awareness, altering objects' appearance to simplify traffic situations, and diminishing their appearance to minimize distractions. However, real-world AMR evaluation remains limited due to technical challenges. To fill this sim-to-real gap, we present MIRAGE, an open-source tool that enables real-time AMR in real vehicles. MIRAGE implements 15 effects across the AMR spectrum of augmented, diminished, and modified reality using state-of-the-art computational models for object detection and segmentation, depth estimation, and inpainting. In an on-road expert user study (N=9) of MIRAGE, participants enjoyed the AMR experience while pointing out technical limitations and identifying use cases for AMR. We discuss these results in relation to prior work and outline implications for AMR ethics and interaction design.
title MIRAGE: Enabling Real-Time Automotive Mediated Reality
topic Human-Computer Interaction
url https://arxiv.org/abs/2601.19385