Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916513093517312 |
|---|---|
| author | Palmer, Derek Zhu, Yifan Lai, Kenneth VanderHoeven, Hannah Bradford, Mariah Khebour, Ibrahim Mabrey, Carlos Fitzgerald, Jack Krishnaswamy, Nikhil Palmer, Martha Pustejovsky, James |
| author_facet | Palmer, Derek Zhu, Yifan Lai, Kenneth VanderHoeven, Hannah Bradford, Mariah Khebour, Ibrahim Mabrey, Carlos Fitzgerald, Jack Krishnaswamy, Nikhil Palmer, Martha Pustejovsky, James |
| contents | Our goal is to develop an AI Partner that can provide support for group problem solving and social dynamics. In multi-party working group environments, multimodal analytics is crucial for identifying non-verbal interactions of group members. In conjunction with their verbal participation, this creates an holistic understanding of collaboration and engagement that provides necessary context for the AI Partner. In this demo, we illustrate our present capabilities at detecting and tracking nonverbal behavior in student task-oriented interactions in the classroom, and the implications for tracking common ground and engagement. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_05797 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement Palmer, Derek Zhu, Yifan Lai, Kenneth VanderHoeven, Hannah Bradford, Mariah Khebour, Ibrahim Mabrey, Carlos Fitzgerald, Jack Krishnaswamy, Nikhil Palmer, Martha Pustejovsky, James Computation and Language Artificial Intelligence Our goal is to develop an AI Partner that can provide support for group problem solving and social dynamics. In multi-party working group environments, multimodal analytics is crucial for identifying non-verbal interactions of group members. In conjunction with their verbal participation, this creates an holistic understanding of collaboration and engagement that provides necessary context for the AI Partner. In this demo, we illustrate our present capabilities at detecting and tracking nonverbal behavior in student task-oriented interactions in the classroom, and the implications for tracking common ground and engagement. |
| title | Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2412.05797 |