Copertina

Mechanistic Interpretability of Fine-Tuned Vision Transformers on Distorted Images: Decoding Attention Head Behavior for Transparent and Trustworthy AI

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Bahador, Nooshin
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Localized Definitions and Distributed Reasoning: A Proof-of-Concept Mechanistic Interpretability Study via Activation Patching
di: Bahador, Nooshin
Pubblicazione: (2025)

Chirp Localization via Fine-Tuned Transformer Model: A Proof-of-Concept Study
di: Bahador, Nooshin, et al.
Pubblicazione: (2025)

Semi-Supervised Anomaly Detection Pipeline for SOZ Localization Using Ictal-Related Chirp
di: Bahador, Nooshin, et al.
Pubblicazione: (2025)

Transparent, Evaluable, and Accessible Data Agents: A Proof-of-Concept Framework
di: Bahador, Nooshin
Pubblicazione: (2025)

Vision Transformers Exhibit Human-Like Biases: Evidence of Orientation and Color Selectivity, Categorical Perception, and Phase Transitions
di: Bahador, Nooshin
Pubblicazione: (2025)

Faithful and Stable Neuron Explanations for Trustworthy Mechanistic Interpretability
di: Yan, Ge, et al.
Pubblicazione: (2025)

Towards Mechanistic Interpretability of Graph Transformers via Attention Graphs
di: El, Batu, et al.
Pubblicazione: (2025)

Even Heads Fix Odd Errors: Mechanistic Discovery and Surgical Repair in Transformer Attention
di: Sandoval, Gustavo
Pubblicazione: (2025)

Panoptic Pairwise Distortion Graph
di: Janjua, Muhammad Kamran, et al.
Pubblicazione: (2026)

nnterp: A Standardized Interface for Mechanistic Interpretability of Transformers
di: Dumas, Clément
Pubblicazione: (2025)

Mechanistic Interpretability for Transformer-based Time Series Classification
di: Kalnāre, Matīss, et al.
Pubblicazione: (2025)

Interpreting Attention Heads for Image-to-Text Information Flow in Large Vision-Language Models
di: Kim, Jinyeong, et al.
Pubblicazione: (2025)

Towards Unified Attribution in Explainable AI, Data-Centric AI, and Mechanistic Interpretability
di: Zhang, Shichang, et al.
Pubblicazione: (2025)

Transparent AI: The Case for Interpretability and Explainability
di: Ramachandram, Dhanesh, et al.
Pubblicazione: (2025)

Ravan: Multi-Head Low-Rank Adaptation for Federated Fine-Tuning
di: Raje, Arian, et al.
Pubblicazione: (2025)

Decoding Style: Efficient Fine-Tuning of LLMs for Image-Guided Outfit Recommendation with Preference
di: Forouzandehmehr, Najmeh, et al.
Pubblicazione: (2024)

Massive Activations in Graph Neural Networks: Decoding Attention for Domain-Dependent Interpretability
di: Bini, Lorenzo, et al.
Pubblicazione: (2024)

Challenges in Mechanistically Interpreting Model Representations
di: Golechha, Satvik, et al.
Pubblicazione: (2024)

Graph Attention Network for Lane-Wise and Topology-Invariant Intersection Traffic Simulation
di: Yousefzadeh, Nooshin, et al.
Pubblicazione: (2024)

Adaptive Circuit Behavior and Generalization in Mechanistic Interpretability
di: Nainani, Jatin, et al.
Pubblicazione: (2024)

Meta-Models: An Architecture for Decoding LLM Behaviors Through Interpreted Embeddings and Natural Language
di: Costarelli, Anthony, et al.
Pubblicazione: (2024)

MINAR: Mechanistic Interpretability for Neural Algorithmic Reasoning
di: He, Jesse, et al.
Pubblicazione: (2026)

Classifying Clinical Outcome of Epilepsy Patients with Ictal Chirp Embeddings
di: Bahador, Nooshin, et al.
Pubblicazione: (2025)

Distilling Linearized Behavior into Non-Linear Fine-Tuning for Effective Task Arithmetic
di: Sommariva, Thomas, et al.
Pubblicazione: (2026)

The Anxiety of Influence: Bloom Filters in Transformer Attention Heads
di: Balogh, Peter
Pubblicazione: (2026)

Trustworthy AI Must Account for Interactions
di: Cresswell, Jesse C.
Pubblicazione: (2025)

Eliciting Fine-Tuned Transformer Capabilities via Inference-Time Techniques
di: Sharma, Asankhaya
Pubblicazione: (2025)

Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detection
di: Lai, Zhixin, et al.
Pubblicazione: (2024)

Dispatch-Aware Ragged Attention for Pruned Vision Transformers
di: Abdellatif, Seifeldin, et al.
Pubblicazione: (2026)

Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learning
di: Brouwer, Eric, et al.
Pubblicazione: (2024)

Tuning for Trustworthiness -- Balancing Performance and Explanation Consistency in Neural Network Optimization
di: Hinterleitner, Alexander, et al.
Pubblicazione: (2025)

HeadQ: Model-Visible Distortion and Score-Space Correction for KV-Cache Quantization
di: Williams, Jorge L. Ruiz
Pubblicazione: (2026)

AttenGluco: Multimodal Transformer-Based Blood Glucose Forecasting on AI-READI Dataset
di: Farahmand, Ebrahim, et al.
Pubblicazione: (2025)

RecurFormer: Not All Transformer Heads Need Self-Attention
di: Yan, Ruiqing, et al.
Pubblicazione: (2024)

DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion
di: Chen, Yilong, et al.
Pubblicazione: (2024)

QFlash: Bridging Quantization and Memory Efficiency in Vision Transformer Attention
di: Oh, Sehyeon, et al.
Pubblicazione: (2026)

Prisma: An Open Source Toolkit for Mechanistic Interpretability in Vision and Video
di: Joseph, Sonia, et al.
Pubblicazione: (2025)

Self-Tuning Sparse Attention: Multi-Fidelity Hyperparameter Optimization for Transformer Acceleration
di: Dev, Arundhathi, et al.
Pubblicazione: (2026)

RPO: Fine-Tuning Visual Generative Models via Rich Vision-Language Preferences
di: Zhao, Hanyang, et al.
Pubblicazione: (2025)

A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models
di: Lin, Zihao, et al.
Pubblicazione: (2025)