AI-Supported Mini-Labs: Combining Smartphone-Based Experiments and Multimodal AI

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kuhn, Jochen, Rakestraw, David J., Küchemann, Stefan, Vogt, Patrik
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911116665290752
author Kuhn, Jochen
Rakestraw, David J.
Küchemann, Stefan
Vogt, Patrik
author_facet Kuhn, Jochen
Rakestraw, David J.
Küchemann, Stefan
Vogt, Patrik
contents This paper presents the concept of AI-supported Mini-Labs, combining smartphone-based experiments with multimodal large language models (MLLMs). Smartphones, with their integrated sensors and computational power, function as versatile mobile laboratories for physics education. While they enable the collection of rich experimental data, the analysis of complex everyday phenomena has often been limited in the classroom. Advances in MLLMs now allow learners to process multimodal data, text, images, audio, and video, and receive support in experiment design, data analysis, and scientific interpretation. Three case studies highlight the approach: determining a vehicle drag coefficient from accelerometer data, measuring the ionospheric reflection height from lightning-generated signals analyzed as audio spectrograms, and real-time spectroscopy of blood volume dynamics using smartphone video. The results show clear advantages over conventional methods, including time savings, high-quality visualizations, and individualized guidance. Beyond simplifying data analysis, AI-augmented pocket labs foster representational competence, critical thinking, and 21st-century skills. This hybrid approach offers a promising pathway for individualized and inquiry-based science education, though further studies are needed to assess long-term learning effects and potential risks.
format Preprint
id arxiv_https___arxiv_org_abs_2508_16320
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AI-Supported Mini-Labs: Combining Smartphone-Based Experiments and Multimodal AI
Kuhn, Jochen
Rakestraw, David J.
Küchemann, Stefan
Vogt, Patrik
Physics Education
This paper presents the concept of AI-supported Mini-Labs, combining smartphone-based experiments with multimodal large language models (MLLMs). Smartphones, with their integrated sensors and computational power, function as versatile mobile laboratories for physics education. While they enable the collection of rich experimental data, the analysis of complex everyday phenomena has often been limited in the classroom. Advances in MLLMs now allow learners to process multimodal data, text, images, audio, and video, and receive support in experiment design, data analysis, and scientific interpretation. Three case studies highlight the approach: determining a vehicle drag coefficient from accelerometer data, measuring the ionospheric reflection height from lightning-generated signals analyzed as audio spectrograms, and real-time spectroscopy of blood volume dynamics using smartphone video. The results show clear advantages over conventional methods, including time savings, high-quality visualizations, and individualized guidance. Beyond simplifying data analysis, AI-augmented pocket labs foster representational competence, critical thinking, and 21st-century skills. This hybrid approach offers a promising pathway for individualized and inquiry-based science education, though further studies are needed to assess long-term learning effects and potential risks.
title AI-Supported Mini-Labs: Combining Smartphone-Based Experiments and Multimodal AI
topic Physics Education
url https://arxiv.org/abs/2508.16320