Shifting Attention to You: Personalized Brain-Inspired AI Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhao, Stephen Chong, Hu, Yang, Lee, Jason, Bender, Andrew, Mazumdar, Trisha, Wallace, Mark, Tovar, David A.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908327873609728
author Zhao, Stephen Chong
Hu, Yang
Lee, Jason
Bender, Andrew
Mazumdar, Trisha
Wallace, Mark
Tovar, David A.
author_facet Zhao, Stephen Chong
Hu, Yang
Lee, Jason
Bender, Andrew
Mazumdar, Trisha
Wallace, Mark
Tovar, David A.
contents The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI integration, current AI models are largely trained on massive datasets, optimized for population-level performance, lacking mechanisms to align their computations with individual users' perceptual semantics and neural dynamics. Here we show that integrating human behavioral insights and millisecond scale neural data within a fine tuned CLIP based model not only captures generalized and individualized aspects of perception but also over doubles behavioral performance compared to the unmodified CLIP baseline. By embedding human inductive biases and mirroring dynamic neural processes during training, personalized neural fine tuning improves predictions of human similarity judgments and tracks the temporal evolution of individual neural responses. Our work establishes a novel, interpretable framework for designing adaptive AI systems, with broad implications for neuroscience, personalized medicine, and human-computer interaction.
format Preprint
id arxiv_https___arxiv_org_abs_2502_04658
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Shifting Attention to You: Personalized Brain-Inspired AI Models
Zhao, Stephen Chong
Hu, Yang
Lee, Jason
Bender, Andrew
Mazumdar, Trisha
Wallace, Mark
Tovar, David A.
Neurons and Cognition
Artificial Intelligence
The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI integration, current AI models are largely trained on massive datasets, optimized for population-level performance, lacking mechanisms to align their computations with individual users' perceptual semantics and neural dynamics. Here we show that integrating human behavioral insights and millisecond scale neural data within a fine tuned CLIP based model not only captures generalized and individualized aspects of perception but also over doubles behavioral performance compared to the unmodified CLIP baseline. By embedding human inductive biases and mirroring dynamic neural processes during training, personalized neural fine tuning improves predictions of human similarity judgments and tracks the temporal evolution of individual neural responses. Our work establishes a novel, interpretable framework for designing adaptive AI systems, with broad implications for neuroscience, personalized medicine, and human-computer interaction.
title Shifting Attention to You: Personalized Brain-Inspired AI Models
topic Neurons and Cognition
Artificial Intelligence
url https://arxiv.org/abs/2502.04658