Saved in:
Bibliographic Details
Main Authors: Ahmed, Syed, Ganesh, Bharathi Vokkaliga, P, Jagadish Babu, Selvaraj, Karthick, Talluri, Praneeth, Hingne, Sanket, Kumar, Anubhav, Yadav, Anushka, Verma, Pratham Kumar, Janardhan, Kiranmayee, N, Mandanna A
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.02217
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912999418101760
author Ahmed, Syed
Ganesh, Bharathi Vokkaliga
P, Jagadish Babu
Selvaraj, Karthick
Talluri, Praneeth
Hingne, Sanket
Kumar, Anubhav
Yadav, Anushka
Verma, Pratham Kumar
Janardhan, Kiranmayee
N, Mandanna A
author_facet Ahmed, Syed
Ganesh, Bharathi Vokkaliga
P, Jagadish Babu
Selvaraj, Karthick
Talluri, Praneeth
Hingne, Sanket
Kumar, Anubhav
Yadav, Anushka
Verma, Pratham Kumar
Janardhan, Kiranmayee
N, Mandanna A
contents Understanding how Large Language Models (LLMs) process information from prompts remains a significant challenge. To shed light on this "black box," attention visualization techniques have been developed to capture neuron-level perceptions and interpret how models focus on different parts of input data. However, many existing techniques are tailored to specific model architectures, particularly within the Transformer family, and often require backpropagation, resulting in nearly double the GPU memory usage and increased computational cost. A lightweight, model-agnostic approach for attention visualization remains lacking. In this paper, we introduce a model-agnostic token importance visualization technique to better understand how generative AI systems perceive and prioritize information from input text, without incurring additional computational cost. Our method leverages perturbation-based strategies combined with a three-matrix analytical framework to generate relevance maps that illustrate token-level contributions to model predictions. The framework comprises: (1) the Angular Deviation Matrix, which captures shifts in semantic direction; (2) the Magnitude Deviation Matrix, which measures changes in semantic intensity; and (3) the Dimensional Importance Matrix, which evaluates contributions across individual vector dimensions. By systematically removing each token and measuring the resulting impact across these three complementary dimensions, we derive a composite importance score that provides a nuanced and mathematically grounded measure of token significance. To support reproducibility and foster wider adoption, we provide open-source implementations of all proposed and utilized explainability techniques, with code and resources publicly available at https://github.com/Infosys/Infosys-Responsible-AI-Toolkit
format Preprint
id arxiv_https___arxiv_org_abs_2604_02217
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle VISTA: Visualization of Token Attribution via Efficient Analysis
Ahmed, Syed
Ganesh, Bharathi Vokkaliga
P, Jagadish Babu
Selvaraj, Karthick
Talluri, Praneeth
Hingne, Sanket
Kumar, Anubhav
Yadav, Anushka
Verma, Pratham Kumar
Janardhan, Kiranmayee
N, Mandanna A
Artificial Intelligence
Computation and Language
Understanding how Large Language Models (LLMs) process information from prompts remains a significant challenge. To shed light on this "black box," attention visualization techniques have been developed to capture neuron-level perceptions and interpret how models focus on different parts of input data. However, many existing techniques are tailored to specific model architectures, particularly within the Transformer family, and often require backpropagation, resulting in nearly double the GPU memory usage and increased computational cost. A lightweight, model-agnostic approach for attention visualization remains lacking. In this paper, we introduce a model-agnostic token importance visualization technique to better understand how generative AI systems perceive and prioritize information from input text, without incurring additional computational cost. Our method leverages perturbation-based strategies combined with a three-matrix analytical framework to generate relevance maps that illustrate token-level contributions to model predictions. The framework comprises: (1) the Angular Deviation Matrix, which captures shifts in semantic direction; (2) the Magnitude Deviation Matrix, which measures changes in semantic intensity; and (3) the Dimensional Importance Matrix, which evaluates contributions across individual vector dimensions. By systematically removing each token and measuring the resulting impact across these three complementary dimensions, we derive a composite importance score that provides a nuanced and mathematically grounded measure of token significance. To support reproducibility and foster wider adoption, we provide open-source implementations of all proposed and utilized explainability techniques, with code and resources publicly available at https://github.com/Infosys/Infosys-Responsible-AI-Toolkit
title VISTA: Visualization of Token Attribution via Efficient Analysis
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2604.02217