Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ghosh, Shreya, Cai, Zhixi, Gupta, Parul, Sharma, Garima, Dhall, Abhinav, Hayat, Munawar, Gedeon, Tom
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913458965970944
author Ghosh, Shreya
Cai, Zhixi
Gupta, Parul
Sharma, Garima
Dhall, Abhinav
Hayat, Munawar
Gedeon, Tom
author_facet Ghosh, Shreya
Cai, Zhixi
Gupta, Parul
Sharma, Garima
Dhall, Abhinav
Hayat, Munawar
Gedeon, Tom
contents Automatic group emotion recognition plays an important role in understanding complex human-human interaction. This paper introduces, Emolysis, a Python-based, standalone open-source group emotion analysis toolkit for use in different social situations upon getting consent from the users. Given any input video, Emolysis processes synchronized multimodal input and maps it to group level emotion, valence and arousal. Additionally, the toolkit supports major mobile and desktop platforms (Android, iOS, Windows). The Emolysis platform also comes with an intuitive graphical user interface that allows users to select different modalities and target persons for more fine-grained emotion analysis. Emolysis is freely available for academic research and encourages application developers to extend it to application specific environments on top of the existing system. We believe that the extension mechanism is quite straightforward. Our code models and interface are available at https://github.com/ControlNet/emolysis.
format Preprint
id arxiv_https___arxiv_org_abs_2305_05255
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit
Ghosh, Shreya
Cai, Zhixi
Gupta, Parul
Sharma, Garima
Dhall, Abhinav
Hayat, Munawar
Gedeon, Tom
Human-Computer Interaction
Automatic group emotion recognition plays an important role in understanding complex human-human interaction. This paper introduces, Emolysis, a Python-based, standalone open-source group emotion analysis toolkit for use in different social situations upon getting consent from the users. Given any input video, Emolysis processes synchronized multimodal input and maps it to group level emotion, valence and arousal. Additionally, the toolkit supports major mobile and desktop platforms (Android, iOS, Windows). The Emolysis platform also comes with an intuitive graphical user interface that allows users to select different modalities and target persons for more fine-grained emotion analysis. Emolysis is freely available for academic research and encourages application developers to extend it to application specific environments on top of the existing system. We believe that the extension mechanism is quite straightforward. Our code models and interface are available at https://github.com/ControlNet/emolysis.
title Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit
topic Human-Computer Interaction
url https://arxiv.org/abs/2305.05255