Cover Image

Leveraging Embedding Techniques in Multimodal Machine Learning for Mental Illness Assessment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hassan, Abdelrahaman A., Ali, Abdelrahman A., Fouda, Aya E., Hanafy, Radwa J., Fouda, Mohammed E.
Format:	Preprint
Published:	2025
Subjects:	Audio and Speech Processing Artificial Intelligence Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Leveraging Audio and Text Modalities in Mental Health: A Study of LLMs Performance
by: Ali, Abdelrahman A., et al.
Published: (2024)

Automated Multi-Label Annotation for Mental Health Illnesses Using Large Language Models
by: Hassan, Abdelrahaman A., et al.
Published: (2024)

A Comprehensive Evaluation of Large Language Models on Mental Illnesses in Arabic Context
by: Zahran, Noureldin, et al.
Published: (2025)

EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning
by: Xing, Zhenghao, et al.
Published: (2025)

PSM: Learning Probabilistic Embeddings for Multi-scale Zero-Shot Soundscape Mapping
by: Khanal, Subash, et al.
Published: (2024)

Multimodal Fusion Method with Spatiotemporal Sequences and Relationship Learning for Valence-Arousal Estimation
by: Yu, Jun, et al.
Published: (2024)

A Comprehensive Evaluation of Large Language Models on Mental Illnesses
by: Hanafi, Abdelrahman, et al.
Published: (2024)

M&M: Multimodal-Multitask Model Integrating Audiovisual Cues in Cognitive Load Assessment
by: Nguyen-Phuoc, Long, et al.
Published: (2024)

SONNET: Enhancing Time Delay Estimation by Leveraging Simulated Audio
by: Tegler, Erik, et al.
Published: (2024)

AGAV-Rater: Adapting Large Multimodal Model for AI-Generated Audio-Visual Quality Assessment
by: Cao, Yuqin, et al.
Published: (2025)

A-JEPA: Joint-Embedding Predictive Architecture Can Listen
by: Fei, Zhengcong, et al.
Published: (2023)

Training-Free Deepfake Voice Recognition by Leveraging Large-Scale Pre-Trained Models
by: Pianese, Alessandro, et al.
Published: (2024)

CoLM-DSR: Leveraging Neural Codec Language Modeling for Multi-Modal Dysarthric Speech Reconstruction
by: Chen, Xueyuan, et al.
Published: (2024)

Leveraging Large Language Models in Visual Speech Recognition: Model Scaling, Context-Aware Decoding, and Iterative Polishing
by: Liu, Zehua, et al.
Published: (2025)

An Exploratory Study of Multimodal Physiological Data in Jazz Improvisation Using Basic Machine Learning Techniques
by: Zhang, Yawen
Published: (2024)

Few-shot Acoustic Synthesis with Multimodal Flow Matching
by: Brunetto, Amandine
Published: (2026)

Hearing Health in Home Healthcare: Leveraging LLMs for Illness Scoring and ALMs for Vocal Biomarker Extraction
by: Chen, Yu-Wen, et al.
Published: (2025)

Multimodal Emotion Recognition and Sentiment Analysis in Multi-Party Conversation Contexts
by: Farhadipour, Aref, et al.
Published: (2025)

Comparison of Tiny Machine Learning Techniques for Embedded Acoustic Emission Analysis
by: Muthumala, Uditha, et al.
Published: (2024)

Multimodal Assessment of Speech Impairment in ALS Using Audio-Visual and Machine Learning Approaches
by: Pierotti, Francesco, et al.
Published: (2025)

Design and Development of Laughter Recognition System Based on Multimodal Fusion and Deep Learning
by: Zhao, Fuzheng, et al.
Published: (2024)

Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognition
by: Praveen, R. Gnana, et al.
Published: (2024)

Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Models
by: Cappellazzo, Umberto, et al.
Published: (2025)

Speech Intelligibility Assessment with Uncertainty-Aware Whisper Embeddings and sLSTM
by: Zezario, Ryandhimas E., et al.
Published: (2025)

How Would It Sound? Material-Controlled Multimodal Acoustic Profile Generation for Indoor Scenes
by: Saad, Mahnoor Fatima, et al.
Published: (2025)

Can You Hear, Localize, and Segment Continually? An Exemplar-Free Continual Learning Benchmark for Audio-Visual Segmentation
by: Raghavan, Siddeshwar, et al.
Published: (2026)

A Critical Assessment of Visual Sound Source Localization Models Including Negative Audio
by: Juanola, Xavier, et al.
Published: (2024)

HunyuanVideo-Foley: Multimodal Diffusion with Representation Alignment for High-Fidelity Foley Audio Generation
by: Shan, Sizhe, et al.
Published: (2025)

ThinkSound: Chain-of-Thought Reasoning in Multimodal Large Language Models for Audio Generation and Editing
by: Liu, Huadai, et al.
Published: (2025)

Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis
by: Yang, Qi, et al.
Published: (2024)

Open-Source Manually Annotated Vocal Tract Database for Automatic Segmentation from 3D MRI Using Deep Learning: Benchmarking 2D and 3D Convolutional and Transformer Networks
by: Erattakulangara, Subin, et al.
Published: (2025)

PsychiatryBench: A Multi-Task Benchmark for LLMs in Psychiatry
by: Fouda, Aya E., et al.
Published: (2025)

Robust Persian Digit Recognition in Noisy Environments Using Hybrid CNN-BiGRU Model
by: Nasr-Esfahani, Ali, et al.
Published: (2024)

Leveraging LLMs for Scalable Non-intrusive Speech Quality Assessment
by: Cumlin, Fredrik, et al.
Published: (2025)

Benchmarking Machine Learning Methods for Distributed Acoustic Sensing
by: Shi, Shuaikai, et al.
Published: (2025)

Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation
by: Wang, Baisen, et al.
Published: (2024)

MCDubber: Multimodal Context-Aware Expressive Video Dubbing
by: Zhao, Yuan, et al.
Published: (2024)

Video-Guided Foley Sound Generation with Multimodal Controls
by: Chen, Ziyang, et al.
Published: (2024)

Digit Recognition using Multimodal Spiking Neural Networks
by: Bjorndahl, William, et al.
Published: (2024)

Learning to Highlight Audio by Watching Movies
by: Huang, Chao, et al.
Published: (2025)