Self-Supervised Learning-Based Multimodal Prediction on Prosocial Behavior Intentions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Naini, Abinay Reddy, Zheng, Zhaobo K., Misu, Teruhisa, Akash, Kumar
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918088859975680
author Naini, Abinay Reddy
Zheng, Zhaobo K.
Misu, Teruhisa
Akash, Kumar
author_facet Naini, Abinay Reddy
Zheng, Zhaobo K.
Misu, Teruhisa
Akash, Kumar
contents Human state detection and behavior prediction have seen significant advancements with the rise of machine learning and multimodal sensing technologies. However, predicting prosocial behavior intentions in mobility scenarios, such as helping others on the road, is an underexplored area. Current research faces a major limitation. There are no large, labeled datasets available for prosocial behavior, and small-scale datasets make it difficult to train deep-learning models effectively. To overcome this, we propose a self-supervised learning approach that harnesses multi-modal data from existing physiological and behavioral datasets. By pre-training our model on diverse tasks and fine-tuning it with a smaller, manually labeled prosocial behavior dataset, we significantly enhance its performance. This method addresses the data scarcity issue, providing a more effective benchmark for prosocial behavior prediction, and offering valuable insights for improving intelligent vehicle systems and human-machine interaction.
format Preprint
id arxiv_https___arxiv_org_abs_2507_08238
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Self-Supervised Learning-Based Multimodal Prediction on Prosocial Behavior Intentions
Naini, Abinay Reddy
Zheng, Zhaobo K.
Misu, Teruhisa
Akash, Kumar
Machine Learning
Human state detection and behavior prediction have seen significant advancements with the rise of machine learning and multimodal sensing technologies. However, predicting prosocial behavior intentions in mobility scenarios, such as helping others on the road, is an underexplored area. Current research faces a major limitation. There are no large, labeled datasets available for prosocial behavior, and small-scale datasets make it difficult to train deep-learning models effectively. To overcome this, we propose a self-supervised learning approach that harnesses multi-modal data from existing physiological and behavioral datasets. By pre-training our model on diverse tasks and fine-tuning it with a smaller, manually labeled prosocial behavior dataset, we significantly enhance its performance. This method addresses the data scarcity issue, providing a more effective benchmark for prosocial behavior prediction, and offering valuable insights for improving intelligent vehicle systems and human-machine interaction.
title Self-Supervised Learning-Based Multimodal Prediction on Prosocial Behavior Intentions
topic Machine Learning
url https://arxiv.org/abs/2507.08238