Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2602.17481 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915807739510784 |
|---|---|
| author | Mei, Yanni Wendt, Samuel Mueller, Florian Gugenheimer, Jan |
| author_facet | Mei, Yanni Wendt, Samuel Mueller, Florian Gugenheimer, Jan |
| contents | Augmented Reality (AR) can simulate various visual perceptions, such as how individuals with colorblindness see the world. However, these simulations require developers to predefine each visual effect, limiting flexibility. We present ShadAR, an AR application enabling real-time transformation of visual perception through shader generation using large language models (LLMs). ShadAR allows users to express their visual intent via natural language, which is interpreted by an LLM to generate corresponding shader code. This shader is then compiled real-time to modify the AR headset viewport. We present our LLM-driven shader generation pipeline and demonstrate its ability to transform visual perception for inclusiveness and creativity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_17481 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | ShadAR: LLM-driven shader generation to transform visual perception in Augmented Reality Mei, Yanni Wendt, Samuel Mueller, Florian Gugenheimer, Jan Human-Computer Interaction Augmented Reality (AR) can simulate various visual perceptions, such as how individuals with colorblindness see the world. However, these simulations require developers to predefine each visual effect, limiting flexibility. We present ShadAR, an AR application enabling real-time transformation of visual perception through shader generation using large language models (LLMs). ShadAR allows users to express their visual intent via natural language, which is interpreted by an LLM to generate corresponding shader code. This shader is then compiled real-time to modify the AR headset viewport. We present our LLM-driven shader generation pipeline and demonstrate its ability to transform visual perception for inclusiveness and creativity. |
| title | ShadAR: LLM-driven shader generation to transform visual perception in Augmented Reality |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2602.17481 |