Social-MAE: A Transformer-Based Multimodal Autoencoder for Face and Voice

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bohy, Hugo, Tran, Minh, Haddad, Kevin El, Dutoit, Thierry, Soleymani, Mohammad
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A New Perspective on Smiling and Laughter Detection: Intensity Levels Matter
by: Bohy, Hugo, et al.
Published: (2024)

Dyadic Interaction Modeling for Social Behavior Generation
by: Tran, Minh, et al.
Published: (2024)

Discrete Facial Encoding: : A Framework for Data-driven Facial Display Discovery
by: Tran, Minh, et al.
Published: (2025)

MU-MAE: Multimodal Masked Autoencoders-Based One-Shot Learning
by: Liu, Rex, et al.
Published: (2024)

MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition
by: Xiang, Peihao, et al.
Published: (2024)

Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learning
by: Ehsanpour, Mahsa, et al.
Published: (2024)

Fus-MAE: A cross-attention-based data fusion approach for Masked Autoencoders in remote sensing
by: Chan-To-Hing, Hugo, et al.
Published: (2024)

R-MAE: Regions Meet Masked Autoencoders
by: Nguyen, Duy-Kien, et al.
Published: (2023)

i-MAE: Are Latent Representations in Masked Autoencoders Linearly Separable?
by: Zhang, Kevin, et al.
Published: (2022)

PCP-MAE: Learning to Predict Centers for Point Masked Autoencoders
by: Zhang, Xiangdong, et al.
Published: (2024)

MV2MAE: Multi-View Video Masked Autoencoders
by: Shah, Ketul, et al.
Published: (2024)

T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learning
by: Wei, Weijie, et al.
Published: (2023)

Self-Avatar Animation in Virtual Reality: Impact of Motion Signals Artifacts on the Full-Body Pose Reconstruction
by: Maiorca, Antoine, et al.
Published: (2024)

Periodic-MAE: Periodic Video Masked Autoencoder for rPPG Estimation
by: Choi, Jiho, et al.
Published: (2025)

Towards Agentic AI for Multimodal-Guided Video Object Segmentation
by: Tran, Tuyen, et al.
Published: (2025)

Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuning
by: Chaubey, Ashutosh, et al.
Published: (2025)

LV-MAE: Learning Long Video Representations through Masked-Embedding Autoencoders
by: Naiman, Ilan, et al.
Published: (2025)

$\mathsf{CSMAE~}$:~Cataract Surgical Masked Autoencoder (MAE) based Pre-training
by: Shah, Nisarg A., et al.
Published: (2025)

Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation
by: Liu, Jiaming, et al.
Published: (2023)

HFBRI-MAE: Handcrafted Feature Based Rotation-Invariant Masked Autoencoder for 3D Point Cloud Analysis
by: Yin, Xuanhua, et al.
Published: (2025)

DuGI-MAE: Improving Infrared Mask Autoencoders via Dual-Domain Guidance
by: Xing, Yinghui, et al.
Published: (2025)

CrossVideoMAE: Self-Supervised Image-Video Representation Learning with Masked Autoencoders
by: Ahamed, Shihab Aaqil, et al.
Published: (2025)

SupMAE: Supervised Masked Autoencoders Are Efficient Vision Learners
by: Liang, Feng, et al.
Published: (2022)

DailyMAE: Towards Pretraining Masked Autoencoders in One Day
by: Wu, Jiantao, et al.
Published: (2024)

Fuse after Align: Improving Face-Voice Association Learning via Multimodal Encoder
by: Peng, Chong, et al.
Published: (2024)

CryoMAE: Few-Shot Cryo-EM Particle Picking with Masked Autoencoders
by: Xu, Chentianye, et al.
Published: (2024)

DAP-MAE: Domain-Adaptive Point Cloud Masked Autoencoder for Effective Cross-Domain Learning
by: Gao, Ziqi, et al.
Published: (2025)

MultiMAE for Brain MRIs: Robustness to Missing Inputs Using Multi-Modal Masked Autoencoder
by: Erdur, Ayhan Can, et al.
Published: (2025)

MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoders
by: Jiang, Xueying, et al.
Published: (2024)

AU-vMAE: Knowledge-Guide Action Units Detection via Video Masked Autoencoder
by: Jin, Qiaoqiao, et al.
Published: (2024)

CL-MAE: Curriculum-Learned Masked Autoencoders
by: Madan, Neelu, et al.
Published: (2023)

Autoencoder Based Face Verification System
by: Solomon, Enoch, et al.
Published: (2023)

NeighborMAE: Exploiting Spatial Dependencies between Neighboring Earth Observation Images in Masked Autoencoders Pretraining
by: Zeng, Liang, et al.
Published: (2026)

DropMAE: Learning Representations via Masked Autoencoders with Spatial-Attention Dropout for Temporal Matching Tasks
by: Wu, Qiangqiang, et al.
Published: (2023)

SenPa-MAE: Sensor Parameter Aware Masked Autoencoder for Multi-Satellite Self-Supervised Pretraining
by: Prexl, Jonathan, et al.
Published: (2024)

ViC-MAE: Self-Supervised Representation Learning from Images and Video with Contrastive Masked Autoencoders
by: Hernandez, Jefferson, et al.
Published: (2023)

Transformer with Leveraged Masked Autoencoder for video-based Pain Assessment
by: Nguyen, Minh-Duc, et al.
Published: (2024)

BEV-MAE: Bird's Eye View Masked Autoencoders for Point Cloud Pre-training in Autonomous Driving Scenarios
by: Lin, Zhiwei, et al.
Published: (2022)

SatSwinMAE: Efficient Autoencoding for Multiscale Time-series Satellite Imagery
by: Nakayama, Yohei, et al.
Published: (2024)

PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder
by: Liu, Yancheng, et al.
Published: (2026)