Connecting Dreams with Visual Brainstorming Instruction
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913467836923904 |
|---|---|
| author | Sun, Yasheng Li, Bohan Zhuge, Mingchen Fan, Deng-Ping Khan, Salman Khan, Fahad Shahbaz Koike, Hideki |
| author_facet | Sun, Yasheng Li, Bohan Zhuge, Mingchen Fan, Deng-Ping Khan, Salman Khan, Fahad Shahbaz Koike, Hideki |
| contents | Recent breakthroughs in understanding the human brain have revealed its impressive ability to efficiently process and interpret human thoughts, opening up possibilities for intervening in brain signals. In this paper, we aim to develop a straightforward framework that uses other modalities, such as natural language, to translate the original dreamland. We present DreamConnect, employing a dual-stream diffusion framework to manipulate visually stimulated brain signals. By integrating an asynchronous diffusion strategy, our framework establishes an effective interface with human dreams, progressively refining their final imagery synthesis. Through extensive experiments, we demonstrate the method ability to accurately instruct human brain signals with high fidelity. Our project will be publicly available on https://github.com/Sys-Nexus/DreamConnect |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_07317 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Connecting Dreams with Visual Brainstorming Instruction Sun, Yasheng Li, Bohan Zhuge, Mingchen Fan, Deng-Ping Khan, Salman Khan, Fahad Shahbaz Koike, Hideki Human-Computer Interaction Recent breakthroughs in understanding the human brain have revealed its impressive ability to efficiently process and interpret human thoughts, opening up possibilities for intervening in brain signals. In this paper, we aim to develop a straightforward framework that uses other modalities, such as natural language, to translate the original dreamland. We present DreamConnect, employing a dual-stream diffusion framework to manipulate visually stimulated brain signals. By integrating an asynchronous diffusion strategy, our framework establishes an effective interface with human dreams, progressively refining their final imagery synthesis. Through extensive experiments, we demonstrate the method ability to accurately instruct human brain signals with high fidelity. Our project will be publicly available on https://github.com/Sys-Nexus/DreamConnect |
| title | Connecting Dreams with Visual Brainstorming Instruction |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2408.07317 |