Interactive Multimodal Integral Field Spectroscopy

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Riber, Adrián García, García-Benito, Rubén, Serradilla, Francisco
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929609337995264
author Riber, Adrián García
García-Benito, Rubén
Serradilla, Francisco
author_facet Riber, Adrián García
García-Benito, Rubén
Serradilla, Francisco
contents Using sonification on scientific data analysis provides additional dimensions to visualization, potentially increasing researchers' analytical capabilities and fostering inclusion and accessibility. This research explores the potential of multimodal Integral Field Spectroscopy (IFS) applied to galaxy analysis through the development and evaluation of a tool that complements the visualization of datacubes with sound. The proposed application, \textit{ViewCube}, provides interactive visualizations and sonifications of spectral information across a two-dimensional field-of-view, and its architecture is designed to incorporate future sonification approaches. The first sonification implementation described in this article uses a deep learning module to generate binaural unsupervised auditory representations. The work includes a qualitative and quantitative user study based on an online questionnaire, aimed at both specialized and non-specialized participants, focusing on the case study of datacubes of galaxies from the Calar Alto Integral Field Spectroscopy Area (CALIFA) survey. Out of 67 participants who completed the questionnaire, 42 had the opportunity to test the application in person prior to filling out the online survey. 81\% of these 42 participants expressed the good interactive response of the tool, 79.1\% of the complete sample found the application "Useful", and 58.2\% rated its aesthetics as "Good". The quantitative results suggest that all participants were able to retrieve information from the sonifications, pointing to previous experience in the analysis of sound events as more helpful than previous knowledge of the data for the proposed tasks, and highlighting the importance of training and attention to detail for the understanding of complex auditory information.
format Preprint
id arxiv_https___arxiv_org_abs_2412_00185
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Interactive Multimodal Integral Field Spectroscopy
Riber, Adrián García
García-Benito, Rubén
Serradilla, Francisco
Instrumentation and Methods for Astrophysics
Astrophysics of Galaxies
Using sonification on scientific data analysis provides additional dimensions to visualization, potentially increasing researchers' analytical capabilities and fostering inclusion and accessibility. This research explores the potential of multimodal Integral Field Spectroscopy (IFS) applied to galaxy analysis through the development and evaluation of a tool that complements the visualization of datacubes with sound. The proposed application, \textit{ViewCube}, provides interactive visualizations and sonifications of spectral information across a two-dimensional field-of-view, and its architecture is designed to incorporate future sonification approaches. The first sonification implementation described in this article uses a deep learning module to generate binaural unsupervised auditory representations. The work includes a qualitative and quantitative user study based on an online questionnaire, aimed at both specialized and non-specialized participants, focusing on the case study of datacubes of galaxies from the Calar Alto Integral Field Spectroscopy Area (CALIFA) survey. Out of 67 participants who completed the questionnaire, 42 had the opportunity to test the application in person prior to filling out the online survey. 81\% of these 42 participants expressed the good interactive response of the tool, 79.1\% of the complete sample found the application "Useful", and 58.2\% rated its aesthetics as "Good". The quantitative results suggest that all participants were able to retrieve information from the sonifications, pointing to previous experience in the analysis of sound events as more helpful than previous knowledge of the data for the proposed tasks, and highlighting the importance of training and attention to detail for the understanding of complex auditory information.
title Interactive Multimodal Integral Field Spectroscopy
topic Instrumentation and Methods for Astrophysics
Astrophysics of Galaxies
url https://arxiv.org/abs/2412.00185