Advancing credibility and transparency in brain-to-image reconstruction research: Reanalysis of Koide-Majima, Nishimoto, and Majima (Neural Networks, 2024)
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908644002496512 |
|---|---|
| author | Shirakawa, Ken Nagano, Yoshihiro Tanaka, Misato Cheng, Fan L. Kamitani, Yukiyasu |
| author_facet | Shirakawa, Ken Nagano, Yoshihiro Tanaka, Misato Cheng, Fan L. Kamitani, Yukiyasu |
| contents | A recent high-profile study by Koide-Majima et al. (2024) claimed a major advance in reconstructing visual imagery from brain activity using a novel variant of a generative AI-based method. However, our independent reanalysis reveals multiple methodological concerns that raise questions about the validity of their conclusions. Specifically, our evaluation demonstrates that: (1) the reconstruction results are biased by selective reporting of only the best-performing examples at multiple levels; (2) performance is artificially inflated by circular metrics that fail to reflect perceptual accuracy; (3) fair baseline comparisons reveal no discernible advantages of the study's key innovations over existing techniques; (4) the central "Bayesian" sampling component is functionally inert, producing outcomes identical to the standard optimization result; and (5) even if the component were successfully implemented, the claims of Bayesian novelty are unsubstantiated, as the proposed method does not leverage the principles of a proper Bayesian framework. These systemic issues necessitate a critical reassessment of the study's contributions. This commentary dissects these deficiencies to underscore the need for greater credibility and transparency in the rapidly advancing field of brain decoding. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_07960 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Advancing credibility and transparency in brain-to-image reconstruction research: Reanalysis of Koide-Majima, Nishimoto, and Majima (Neural Networks, 2024) Shirakawa, Ken Nagano, Yoshihiro Tanaka, Misato Cheng, Fan L. Kamitani, Yukiyasu Neurons and Cognition A recent high-profile study by Koide-Majima et al. (2024) claimed a major advance in reconstructing visual imagery from brain activity using a novel variant of a generative AI-based method. However, our independent reanalysis reveals multiple methodological concerns that raise questions about the validity of their conclusions. Specifically, our evaluation demonstrates that: (1) the reconstruction results are biased by selective reporting of only the best-performing examples at multiple levels; (2) performance is artificially inflated by circular metrics that fail to reflect perceptual accuracy; (3) fair baseline comparisons reveal no discernible advantages of the study's key innovations over existing techniques; (4) the central "Bayesian" sampling component is functionally inert, producing outcomes identical to the standard optimization result; and (5) even if the component were successfully implemented, the claims of Bayesian novelty are unsubstantiated, as the proposed method does not leverage the principles of a proper Bayesian framework. These systemic issues necessitate a critical reassessment of the study's contributions. This commentary dissects these deficiencies to underscore the need for greater credibility and transparency in the rapidly advancing field of brain decoding. |
| title | Advancing credibility and transparency in brain-to-image reconstruction research: Reanalysis of Koide-Majima, Nishimoto, and Majima (Neural Networks, 2024) |
| topic | Neurons and Cognition |
| url | https://arxiv.org/abs/2511.07960 |