AVR: Synergizing Foundation Models for Audio-Visual Humor Detection
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913391942041600 |
|---|---|
| author | Sharma, Sarthak Phukan, Orchid Chetia Singh, Drishti Buduru, Arun Balaji Sharma, Rajesh |
| author_facet | Sharma, Sarthak Phukan, Orchid Chetia Singh, Drishti Buduru, Arun Balaji Sharma, Rajesh |
| contents | In this work, we present, AVR application for audio-visual humor detection. While humor detection has traditionally centered around textual analysis, recent advancements have spotlighted multimodal approaches. However, these methods lean on textual cues as a modality, necessitating the use of ASR systems for transcribing the audio-data. This heavy reliance on ASR accuracy can pose challenges in real-world applications. To address this bottleneck, we propose an innovative audio-visual humor detection system that circumvents textual reliance, eliminating the need for ASR models. Instead, the proposed approach hinges on the intricate interplay between audio and visual content for effective humor detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_10448 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AVR: Synergizing Foundation Models for Audio-Visual Humor Detection Sharma, Sarthak Phukan, Orchid Chetia Singh, Drishti Buduru, Arun Balaji Sharma, Rajesh Audio and Speech Processing Sound In this work, we present, AVR application for audio-visual humor detection. While humor detection has traditionally centered around textual analysis, recent advancements have spotlighted multimodal approaches. However, these methods lean on textual cues as a modality, necessitating the use of ASR systems for transcribing the audio-data. This heavy reliance on ASR accuracy can pose challenges in real-world applications. To address this bottleneck, we propose an innovative audio-visual humor detection system that circumvents textual reliance, eliminating the need for ASR models. Instead, the proposed approach hinges on the intricate interplay between audio and visual content for effective humor detection. |
| title | AVR: Synergizing Foundation Models for Audio-Visual Humor Detection |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2406.10448 |