Cover Image

Smile on the Face, Sadness in the Eyes: Bridging the Emotion Gap with a Multimodal Dataset of Eye and Facial Behaviors

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Kejun, Liu, Yuanyuan, Wei, Lin, Tang, Chang, Zhan, Yibing, Chen, Zijing, Chen, Zhe
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Smile upon the Face but Sadness in the Eyes: Emotion Recognition based on Facial Expressions and Eye Behaviors
by: Liu, Yuanyuan, et al.
Published: (2024)

Open-Set Video-based Facial Expression Recognition with Human Expression-sensitive Prompting
by: Liu, Yuanyuan, et al.
Published: (2024)

DIG-FACE: De-biased Learning for Generalized Facial Expression Category Discovery
by: Luo, Tingzhang, et al.
Published: (2024)

Eye Motion Matters for 3D Face Reconstruction
by: Wang, Xuan, et al.
Published: (2024)

Through BrokenEyes: How Eye Disorders Impact Face Detection?
by: Adhikary, Prottay Kumar
Published: (2026)

Bridging the Gaps: Utilizing Unlabeled Face Recognition Datasets to Boost Semi-Supervised Facial Expression Recognition
by: Song, Jie, et al.
Published: (2024)

BirdsEye-RU: A Dataset For Detecting Faces from Overhead Images
by: Khan, Md. Ahanaf Arif, et al.
Published: (2026)

When Words Smile: Generating Diverse Emotional Facial Expressions from Text
by: Xu, Haidong, et al.
Published: (2024)

Dialogue Director: Bridging the Gap in Dialogue Visualization for Multimodal Storytelling
by: Zhang, Min, et al.
Published: (2024)

Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition
by: Tsangko, Iosif, et al.
Published: (2025)

Modelling the Interplay of Eye-Tracking Temporal Dynamics and Personality for Emotion Detection in Face-to-Face Settings
by: Seikavandi, Meisam J., et al.
Published: (2025)

CLUENet: Cluster Attention Makes Neural Networks Have Eyes
by: Song, Xiangshuai, et al.
Published: (2025)

FLORA: Formal Language Model Enables Robust Training-free Zero-shot Object Referring Analysis
by: Chen, Zhe, et al.
Published: (2025)

BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentation
by: Kim, Beomjun, et al.
Published: (2025)

UEVAVD: A Dataset for Developing UAV's Eye View Active Object Detection
by: Jiang, Xinhua, et al.
Published: (2024)

The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face?
by: Pham, Dinh Nam, et al.
Published: (2025)

EmoFace: Audio-driven Emotional 3D Face Animation
by: Liu, Chang, et al.
Published: (2024)

Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Method
by: Zou, Mian, et al.
Published: (2024)

Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
by: Tong, Shengbang, et al.
Published: (2024)

Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text Transformation
by: Gou, Yunhao, et al.
Published: (2024)

Detecting Driver Fatigue With Eye Blink Behavior
by: Akin, Ali, et al.
Published: (2024)

PixelSmile: Toward Fine-Grained Facial Expression Editing
by: Hua, Jiabin, et al.
Published: (2026)

Eye Sclera for Fair Face Image Quality Assessment
by: Kabbani, Wassim, et al.
Published: (2025)

EyeFound: A Multimodal Generalist Foundation Model for Ophthalmic Imaging
by: Shi, Danli, et al.
Published: (2024)

MEDTalk: Multimodal Controlled 3D Facial Animation with Dynamic Emotions by Disentangled Embedding
by: Liu, Chang, et al.
Published: (2025)

myEye2Wheeler: A Two-Wheeler Indian Driver Real-World Eye-Tracking Dataset
by: Kumar, Bhaiya Vaibhaw, et al.
Published: (2025)

TalkingEyes: Pluralistic Speech-Driven 3D Eye Gaze Animation
by: Zhuang, Yixiang, et al.
Published: (2025)

15M Multimodal Facial Image-Text Dataset
by: Dai, Dawei, et al.
Published: (2024)

Self-Supervised Learning for Detecting AI-Generated Faces as Anomalies
by: Zou, Mian, et al.
Published: (2025)

The Constant Eye: Benchmarking and Bridging Appearance Robustness in Autonomous Driving
by: Wang, Jiabao, et al.
Published: (2026)

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation
by: Zhu, Junyu, et al.
Published: (2023)

Exploring Thermography Technology: A Comprehensive Facial Dataset for Face Detection, Recognition, and Emotion
by: Abuhussein, Mohamed Fawzi Abdelshafie, et al.
Published: (2024)

Evaluating Image-Based Face and Eye Tracking with Event Cameras
by: Iddrisu, Khadija, et al.
Published: (2024)

Towards Unsupervised Eye-Region Segmentation for Eye Tracking
by: Deng, Jiangfan, et al.
Published: (2024)

Eye on the Target: Eye Tracking Meets Rodent Tracking
by: Mededovic, Emil, et al.
Published: (2025)

Kalib: Easy Hand-Eye Calibration with Reference Point Tracking
by: Tang, Tutian, et al.
Published: (2024)

Learning Semantic Facial Descriptors for Accurate Face Animation
by: Zhu, Lei, et al.
Published: (2025)

DeepEyesV2: Toward Agentic Multimodal Model
by: Hong, Jack, et al.
Published: (2025)

FaceBench: A Multi-View Multi-Level Facial Attribute VQA Dataset for Benchmarking Face Perception MLLMs
by: Wang, Xiaoqin, et al.
Published: (2025)

Investigating Domain Gaps for Indoor 3D Object Detection
by: Zhao, Zijing, et al.
Published: (2025)