Pedagogical Alignment for Vision-Language-Action Models: A Comprehensive Framework for Data, Architecture, and Evaluation in Education
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912834776989696 |
|---|---|
| author | Lee, Unggi Jeong, Jahyun Shin, Sunyoung Park, Haeun Moon, Jeongsu Song, Youngchang Shim, Jaechang Lee, JaeHwan Noh, Yunju Choi, Seungwon Kim, Ahhyun Kim, TaeHyeon Joo, Kyungtae Kim, Taeyeong Lee, Gyeonggeon |
| author_facet | Lee, Unggi Jeong, Jahyun Shin, Sunyoung Park, Haeun Moon, Jeongsu Song, Youngchang Shim, Jaechang Lee, JaeHwan Noh, Yunju Choi, Seungwon Kim, Ahhyun Kim, TaeHyeon Joo, Kyungtae Kim, Taeyeong Lee, Gyeonggeon |
| contents | Science demonstrations are important for effective STEM education, yet teachers face challenges in conducting them safely and consistently across multiple occasions, where robotics can be helpful. However, current Vision-Language-Action (VLA) models require substantial computational resources and sacrifice language generation capabilities to maximize efficiency, making them unsuitable for resource-constrained educational settings that require interpretable, explanation-generating systems. We present \textit{Pedagogical VLA Framework}, a framework that applies pedagogical alignment to lightweight VLA models through four components: text healing to restore language generation capabilities, large language model (LLM) distillation to transfer pedagogical knowledge, safety training for educational environments, and pedagogical evaluation adjusted to science education contexts. We evaluate Pedagogical VLA Framework across five science demonstrations spanning physics, chemistry, biology, and earth science, using an evaluation framework developed in collaboration with science education experts. Our evaluation assesses both task performance (success rate, protocol compliance, efficiency, safety) and pedagogical quality through teacher surveys and LLM-as-Judge assessment. We additionally provide qualitative analysis of generated texts. Experimental results demonstrate that Pedagogical VLA Framework achieves comparable task performance to baseline models while producing contextually appropriate educational explanations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_13876 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Pedagogical Alignment for Vision-Language-Action Models: A Comprehensive Framework for Data, Architecture, and Evaluation in Education Lee, Unggi Jeong, Jahyun Shin, Sunyoung Park, Haeun Moon, Jeongsu Song, Youngchang Shim, Jaechang Lee, JaeHwan Noh, Yunju Choi, Seungwon Kim, Ahhyun Kim, TaeHyeon Joo, Kyungtae Kim, Taeyeong Lee, Gyeonggeon Computation and Language Science demonstrations are important for effective STEM education, yet teachers face challenges in conducting them safely and consistently across multiple occasions, where robotics can be helpful. However, current Vision-Language-Action (VLA) models require substantial computational resources and sacrifice language generation capabilities to maximize efficiency, making them unsuitable for resource-constrained educational settings that require interpretable, explanation-generating systems. We present \textit{Pedagogical VLA Framework}, a framework that applies pedagogical alignment to lightweight VLA models through four components: text healing to restore language generation capabilities, large language model (LLM) distillation to transfer pedagogical knowledge, safety training for educational environments, and pedagogical evaluation adjusted to science education contexts. We evaluate Pedagogical VLA Framework across five science demonstrations spanning physics, chemistry, biology, and earth science, using an evaluation framework developed in collaboration with science education experts. Our evaluation assesses both task performance (success rate, protocol compliance, efficiency, safety) and pedagogical quality through teacher surveys and LLM-as-Judge assessment. We additionally provide qualitative analysis of generated texts. Experimental results demonstrate that Pedagogical VLA Framework achieves comparable task performance to baseline models while producing contextually appropriate educational explanations. |
| title | Pedagogical Alignment for Vision-Language-Action Models: A Comprehensive Framework for Data, Architecture, and Evaluation in Education |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2601.13876 |