Can Generic LLMs Help Analyze Child-adult Interactions Involving Children with Autism in Clinical Observation?
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912120932663296 |
|---|---|
| author | Feng, Tiantian Xu, Anfeng Lahiri, Rimita Tager-Flusberg, Helen Kim, So Hyun Bishop, Somer Lord, Catherine Narayanan, Shrikanth |
| author_facet | Feng, Tiantian Xu, Anfeng Lahiri, Rimita Tager-Flusberg, Helen Kim, So Hyun Bishop, Somer Lord, Catherine Narayanan, Shrikanth |
| contents | Large Language Models (LLMs) have shown significant potential in understanding human communication and interaction. However, their performance in the domain of child-inclusive interactions, including in clinical settings, remains less explored. In this work, we evaluate generic LLMs' ability to analyze child-adult dyadic interactions in a clinically relevant context involving children with ASD. Specifically, we explore LLMs in performing four tasks: classifying child-adult utterances, predicting engaged activities, recognizing language skills and understanding traits that are clinically relevant. Our evaluation shows that generic LLMs are highly capable of analyzing long and complex conversations in clinical observation sessions, often surpassing the performance of non-expert human evaluators. The results show their potential to segment interactions of interest, assist in language skills evaluation, identify engaged activities, and offer clinical-relevant context for assessments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_10761 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Can Generic LLMs Help Analyze Child-adult Interactions Involving Children with Autism in Clinical Observation? Feng, Tiantian Xu, Anfeng Lahiri, Rimita Tager-Flusberg, Helen Kim, So Hyun Bishop, Somer Lord, Catherine Narayanan, Shrikanth Computation and Language Large Language Models (LLMs) have shown significant potential in understanding human communication and interaction. However, their performance in the domain of child-inclusive interactions, including in clinical settings, remains less explored. In this work, we evaluate generic LLMs' ability to analyze child-adult dyadic interactions in a clinically relevant context involving children with ASD. Specifically, we explore LLMs in performing four tasks: classifying child-adult utterances, predicting engaged activities, recognizing language skills and understanding traits that are clinically relevant. Our evaluation shows that generic LLMs are highly capable of analyzing long and complex conversations in clinical observation sessions, often surpassing the performance of non-expert human evaluators. The results show their potential to segment interactions of interest, assist in language skills evaluation, identify engaged activities, and offer clinical-relevant context for assessments. |
| title | Can Generic LLMs Help Analyze Child-adult Interactions Involving Children with Autism in Clinical Observation? |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2411.10761 |