Image de couverture de livre

Strong Alone, Stronger Together: Synergizing Modality-Binding Foundation Models with Optimal Transport for Non-Verbal Emotion Recognition

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Phukan, Orchid Chetia, Akhtar, Mohd Mujtaba, Girish, Behera, Swarup Ranjan, Kalita, Sishir, Buduru, Arun Balaji, Sharma, Rajesh, Prasanna, S. R Mahadeva
Format:	Preprint
Publié:	2024
Sujets:	Audio and Speech Processing Sound 68T45 I.2.7
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Beyond Speech and More: Investigating the Emergent Ability of Speech Foundation Models for Classifying Physiological Time-Series Signals
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Representation Loss Minimization with Randomized Selection Strategy for Efficient Environmental Fake Audio Detection
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

PARROT: Synergizing Mamba and Attention-based SSL Pre-Trained Models via Parallel Branch Hadamard Optimal Transport for Speech Emotion Recognition
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Enhancing In-Domain and Out-Domain EmoFake Detection via Cooperative Multilingual Speech Foundation Models
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Indic-CodecFake meets SATYAM: Towards Detecting Neural Audio Codec Synthesized Speech Deepfakes in Indic Languages
par: Girish, et autres
Publié: (2026)

Towards Neural Audio Codec Source Parsing
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Are Mamba-based Audio Foundation Models the Best Fit for Non-Verbal Emotion Recognition?
par: Akhtar, Mohd Mujtaba, et autres
Publié: (2025)

Investigating the Reasonable Effectiveness of Speaker Pre-Trained Models and their Synergistic Power for SingMOS Prediction
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

HYFuse: Aligning Heterogeneous Speech Pre-Trained Representations in Hyperbolic Space for Speech Emotion Recognition
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Models
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Towards Fusion of Neural Audio Codec-based Representations with Spectral for Heart Murmur Classification via Bandit-based Cross-Attention Mechanism
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Rethinking Cross-Corpus Speech Emotion Recognition Benchmarking: Are Paralinguistic Pre-Trained Representations Sufficient?
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Towards Source Attribution of Singing Voice Deepfake with Multimodal Foundation Models
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Source Tracing of Synthetic Speech Systems Through Paralinguistic Pre-Trained Representations
par: Girish, et autres
Publié: (2025)

Towards Machine Unlearning for Paralinguistic Speech Processing
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Investigating Prosodic Signatures via Speech Pre-Trained Models for Audio Deepfake Source Attribution
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Multi-View Multi-Task Modeling with Speech Foundation Models for Speech Forensic Tasks
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

SeQuiFi: Mitigating Catastrophic Forgetting in Speech Emotion Recognition with Sequential Class-Finetuning
par: Jain, Sarthak, et autres
Publié: (2024)

SONIC: Synergizing VisiON Foundation Models for Stress RecogNItion from ECG signals
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Avengers Assemble: Amalgamation of Non-Semantic Features for Depression Detection
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Investigating Polyglot Speech Foundation Models for Learning Collective Emotion from Crowds
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

Are Multimodal Foundation Models All That Is Needed for Emofake Detection?
par: Akhtar, Mohd Mujtaba, et autres
Publié: (2025)

AVR: Synergizing Foundation Models for Audio-Visual Humor Detection
par: Sharma, Sarthak, et autres
Publié: (2024)

Towards Multilingual Audio-Visual Question Answering
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Modality-Order Matters! A Novel Hierarchical Feature Fusion Method for CoSAm: A Code-Switched Autism Corpus
par: Akhtar, Mohd Mujtaba, et autres
Publié: (2024)

NeuRO: An Application for Code-Switched Autism Detection in Children
par: Akhtar, Mohd Mujtaba, et autres
Publié: (2024)

The Reasonable Effectiveness of Speaker Embeddings for Violence Detection
par: Jain, Sarthak, et autres
Publié: (2024)

CoLLAB: A Collaborative Approach for Multilingual Abuse Detection
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Are Paralinguistic Representations all that is needed for Speech Emotion Recognition?
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfake
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer
par: Phukan, Orchid Chetia, et autres
Publié: (2025)

PERSONA: An Application for Emotion Recognition, Gender Recognition and Age Estimation
par: Koshal, Devyani, et autres
Publié: (2024)

A Lightweight Feature Fusion Architecture For Resource-Constrained Crowd Counting
par: Chaudhuri, Yashwardhan, et autres
Publié: (2024)

ComFeAT: Combination of Neural and Spectral Features for Improved Depression Detection
par: Phukan, Orchid Chetia, et autres
Publié: (2024)

VoxMed: One-Step Respiratory Disease Classifier using Digital Stethoscope Sounds
par: Mundra, Paridhi, et autres
Publié: (2024)

FOCA: Multimodal Malware Classification via Hyperbolic Cross-Attention
par: Choudhury, Nitin, et autres
Publié: (2026)

ASGIR: Audio Spectrogram Transformer Guided Classification And Information Retrieval For Birds
par: Chaudhuri, Yashwardhan, et autres
Publié: (2024)

Prosody as Supervision: Bridging the Non-Verbal--Verbal for Multilingual Speech Emotion Recognition
par: Girish, et autres
Publié: (2026)

Exploring rhythm formant analysis for Indic language classification
par: Gogoi, Parismita, et autres
Publié: (2024)

RoboKA: KAN Informed Multimodal Learning for RoboCall Surveillance System
par: Choudhury, Nitin, et autres
Publié: (2026)