Using Large Language Models to Detect Socially Shared Regulation of Collaborative Learning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909984374128640 |
|---|---|
| author | Zhang, Jiayi Borchers, Conrad Cohn, Clayton Srivastava, Namrata Snyder, Caitlin Guo, Siyuan S, Ashwin T Mohammed, Naveeduddin Noh, Haley Biswas, Gautam |
| author_facet | Zhang, Jiayi Borchers, Conrad Cohn, Clayton Srivastava, Namrata Snyder, Caitlin Guo, Siyuan S, Ashwin T Mohammed, Naveeduddin Noh, Haley Biswas, Gautam |
| contents | The field of learning analytics has made notable strides in automating the detection of complex learning processes in multimodal data. However, most advancements have focused on individualized problem-solving instead of collaborative, open-ended problem-solving, which may offer both affordances (richer data) and challenges (low cohesion) to behavioral prediction. Here, we extend predictive models to automatically detect socially shared regulation of learning (SSRL) behaviors in collaborative computational modeling environments using embedding-based approaches. We leverage large language models (LLMs) as summarization tools to generate task-aware representations of student dialogue aligned with system logs. These summaries, combined with text-only embeddings, context-enriched embeddings, and log-derived features, were used to train predictive models. Results show that text-only embeddings often achieve stronger performance in detecting SSRL behaviors related to enactment or group dynamics (e.g., off-task behavior or requesting assistance). In contrast, contextual and multimodal features provide complementary benefits for constructs such as planning and reflection. Overall, our findings highlight the promise of embedding-based models for extending learning analytics by enabling scalable detection of SSRL behaviors, ultimately supporting real-time feedback and adaptive scaffolding in collaborative learning environments that teachers value. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_04458 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Using Large Language Models to Detect Socially Shared Regulation of Collaborative Learning Zhang, Jiayi Borchers, Conrad Cohn, Clayton Srivastava, Namrata Snyder, Caitlin Guo, Siyuan S, Ashwin T Mohammed, Naveeduddin Noh, Haley Biswas, Gautam Machine Learning The field of learning analytics has made notable strides in automating the detection of complex learning processes in multimodal data. However, most advancements have focused on individualized problem-solving instead of collaborative, open-ended problem-solving, which may offer both affordances (richer data) and challenges (low cohesion) to behavioral prediction. Here, we extend predictive models to automatically detect socially shared regulation of learning (SSRL) behaviors in collaborative computational modeling environments using embedding-based approaches. We leverage large language models (LLMs) as summarization tools to generate task-aware representations of student dialogue aligned with system logs. These summaries, combined with text-only embeddings, context-enriched embeddings, and log-derived features, were used to train predictive models. Results show that text-only embeddings often achieve stronger performance in detecting SSRL behaviors related to enactment or group dynamics (e.g., off-task behavior or requesting assistance). In contrast, contextual and multimodal features provide complementary benefits for constructs such as planning and reflection. Overall, our findings highlight the promise of embedding-based models for extending learning analytics by enabling scalable detection of SSRL behaviors, ultimately supporting real-time feedback and adaptive scaffolding in collaborative learning environments that teachers value. |
| title | Using Large Language Models to Detect Socially Shared Regulation of Collaborative Learning |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2601.04458 |