Cover Image

Bridging the behavior-neural gap: A multimodal AI reveals the brain's geometry of emotion more accurately than human self-reports

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Du, Changde, Lu, Yizhuo, Huang, Zhongyu, Sun, Yi, Zhou, Zisen, Qin, Shaozheng, He, Huiguang
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction Artificial Intelligence Computation and Language Computers and Society Multimedia
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reverse the auditory processing pathway: Coarse-to-fine audio reconstruction from fMRI
by: Liu, Che, et al.
Published: (2024)

The perceptual gap between video see-through displays and natural human vision
by: Wang, Jialin, et al.
Published: (2026)

EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models
by: Du, Mengfei, et al.
Published: (2024)

SoMeLVLM: A Large Vision Language Model for Social Media Processing
by: Zhang, Xinnong, et al.
Published: (2024)

Versatile Framework with Semantic and Structural guidance for Image Reconstruction from Brain Activity
by: Lu, Yizhuo, et al.
Published: (2026)

Leveraging multimodal explanatory annotations for video interpretation with Modality Specific Dataset
by: Ancarani, Elisa, et al.
Published: (2025)

Priority prediction of Asian Hornet sighting report using machine learning methods
by: Liu, Yixin, et al.
Published: (2021)

SONIA: an immersive customizable virtual reality system for the education and exploration of brain networks
by: Hellum, Owen, et al.
Published: (2023)

Identifying the Hierarchical Emotional Areas in the Human Brain Through Information Fusion
by: Huang, Zhongyu, et al.
Published: (2024)

The shortcomings of video conferencing technology, methods for revealing them, and emerging XR solutions
by: Hove, Dani Paul, et al.
Published: (2025)

Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?
by: Papadopoulos, Stefanos-Iordanis, et al.
Published: (2024)

Thief of Truth: VR comics about the relationship between AI and humans
by: Bae, Joonhyung
Published: (2025)

ChartEditor: A Reinforcement Learning Framework for Robust Chart Editing
by: Chen, Liangyu, et al.
Published: (2025)

SpeechCraft: A Fine-grained Expressive Speech Dataset with Natural Language Description
by: Jin, Zeyu, et al.
Published: (2024)

MSMF: Multi-Scale Multi-Modal Fusion for Enhanced Stock Market Prediction
by: Qin, Jiahao
Published: (2024)

Shorter Is Different: Characterizing the Dynamics of Short-Form Video Platforms
by: Chen, Zhilong, et al.
Published: (2024)

MAC-SLU: Multi-Intent Automotive Cabin Spoken Language Understanding Benchmark
by: Peng, Yuezhang, et al.
Published: (2025)

MAGE: Multimodal Alignment and Generation Enhancement via Bridging Visual and Semantic Spaces
by: E, Shaojun, et al.
Published: (2025)

Bridging Your Imagination with Audio-Video Generation via a Unified Director
by: Zhang, Jiaxu, et al.
Published: (2025)

Bridging the Gap: Sketch-Aware Interpolation Network for High-Quality Animation Sketch Inbetweening
by: Shen, Jiaming, et al.
Published: (2023)

Deep learning for 3D human pose estimation and mesh recovery: A survey
by: Liu, Yang, et al.
Published: (2024)

ASAP: Advancing Semantic Alignment Promotes Multi-Modal Manipulation Detecting and Grounding
by: Zhang, Zhenxing, et al.
Published: (2024)

Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search
by: Xie, Zequn, et al.
Published: (2026)

Movie101v2: Improved Movie Narration Benchmark
by: Yue, Zihao, et al.
Published: (2024)

SSTFormer: Bridging Spiking Neural Network and Memory Support Transformer for Frame-Event based Recognition
by: Wang, Xiao, et al.
Published: (2023)

Sound Clouds: Exploring ambient intelligence in public spaces to elicit deep human experience of awe, wonder, and beauty
by: Zhang, Chengzhi, et al.
Published: (2025)

Bridging the Data Provenance Gap Across Text, Speech and Video
by: Longpre, Shayne, et al.
Published: (2024)

Hue4U: Real-Time Personalized Color Correction in Augmented Reality
by: Qin, Jingwen, et al.
Published: (2025)

BP-GPT: Auditory Neural Decoding Using fMRI-prompted LLM
by: Chen, Xiaoyu, et al.
Published: (2025)

Open-vocabulary Auditory Neural Decoding Using fMRI-prompted LLM
by: Chen, Xiaoyu, et al.
Published: (2024)

BRIDGE: Bridging Gaps in Image Captioning Evaluation with Stronger Visual Cues
by: Sarto, Sara, et al.
Published: (2024)

musicolors: Bridging Sound and Visuals For Synesthetic Creative Musical Experience
by: Lee, ChungHa, et al.
Published: (2025)

Connecting Giants: Synergistic Knowledge Transfer of Large Multimodal Models for Few-Shot Learning
by: Tang, Hao, et al.
Published: (2025)

How to Bridge the Gap between Modalities: Survey on Multimodal Large Language Model
by: Song, Shezheng, et al.
Published: (2023)

CASR: Refining Action Segmentation via Marginalizing Frame-levle Causal Relationships
by: Du, Keqing, et al.
Published: (2023)

More than Memes: A Multimodal Topic Modeling Approach to Conspiracy Theories on Telegram
by: Steffen, Elisabeth
Published: (2024)

Visual Set Program Synthesizer
by: Cheng, Zehua, et al.
Published: (2026)

Can Prompting LLMs Unlock Hate Speech Detection across Languages? A Zero-shot and Few-shot Study
by: Ghorbanpour, Faeze, et al.
Published: (2025)

Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data
by: Ghorbanpour, Faeze, et al.
Published: (2025)

AV-DTEC: Self-Supervised Audio-Visual Fusion for Drone Trajectory Estimation and Classification
by: Xiao, Zhenyuan, et al.
Published: (2024)