Copertina

SteerVLM: Robust Model Control through Lightweight Activation Steering for Vision Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sivakumar, Anushka, Zhang, Andrew, Hakim, Zaber, Thomas, Chris
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computer Vision and Pattern Recognition Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Steering to Say No: Configurable Refusal via Activation Steering in Vision Language Models
di: Yang, Jiaxi, et al.
Pubblicazione: (2026)

Maximal Matching Matters: Preventing Representation Collapse for Robust Cross-Modal Retrieval
di: Alomari, Hani, et al.
Pubblicazione: (2025)

Flexible-length Text Infilling for Discrete Diffusion Models
di: Zhang, Andrew, et al.
Pubblicazione: (2025)

Exploring Attention Mechanisms in Integration of Multi-Modal Information for Sign Language Recognition and Translation
di: Hakim, Zaber Ibn Abdul, et al.
Pubblicazione: (2023)

Steering Rectified Flow Models in the Vector Field for Controlled Image Generation
di: Patel, Maitreya, et al.
Pubblicazione: (2024)

VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision
di: Xu, Yi, et al.
Pubblicazione: (2024)

Reducing Hallucinations in Vision-Language Models via Latent Space Steering
di: Liu, Sheng, et al.
Pubblicazione: (2024)

SAVeS: Steering Safety Judgments in Vision-Language Models via Semantic Cues
di: Hinojosa, Carlos, et al.
Pubblicazione: (2026)

Image Inpainting via Tractable Steering of Diffusion Models
di: Liu, Anji, et al.
Pubblicazione: (2023)

Steering Guidance for Personalized Text-to-Image Diffusion Models
di: Park, Sunghyun, et al.
Pubblicazione: (2025)

Test-Time Spectrum-Aware Latent Steering for Zero-Shot Generalization in Vision-Language Models
di: Dafnis, Konstantinos M., et al.
Pubblicazione: (2025)

The Hidden Life of Tokens: Reducing Hallucination of Large Vision-Language Models via Visual Information Steering
di: Li, Zhuowei, et al.
Pubblicazione: (2025)

GraphVLM: Benchmarking Vision Language Models for Multimodal Graph Learning
di: Liu, Jiajin, et al.
Pubblicazione: (2026)

HandsOnVLM: Vision-Language Models for Hand-Object Interaction Prediction
di: Bao, Chen, et al.
Pubblicazione: (2024)

Steer Away From Mode Collisions: Improving Composition In Diffusion Models
di: Dutta, Debottam, et al.
Pubblicazione: (2025)

BendVLM: Test-Time Debiasing of Vision-Language Embeddings
di: Gerych, Walter, et al.
Pubblicazione: (2024)

Beyond ImageNet: Understanding Cross-Dataset Robustness of Lightweight Vision Models
di: Zhang, Weidong, et al.
Pubblicazione: (2025)

Textual Steering Vectors Can Improve Visual Understanding in Multimodal Large Language Models
di: Gan, Woody Haosheng, et al.
Pubblicazione: (2025)

FastVLM: Efficient Vision Encoding for Vision Language Models
di: Vasu, Pavan Kumar Anasosalu, et al.
Pubblicazione: (2024)

A Lightweight Large Vision-language Model for Multimodal Medical Images
di: Alsinglawi, Belal, et al.
Pubblicazione: (2025)

Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting
di: Zhong, Siru, et al.
Pubblicazione: (2025)

StressDream: Steering Video World Models for Robust Policy Evaluation and Improvement
di: Seo, Junwon, et al.
Pubblicazione: (2026)

Learning to Steer: Input-dependent Steering for Multimodal LLMs
di: Parekh, Jayneel, et al.
Pubblicazione: (2025)

A General Framework for Inference-time Scaling and Steering of Diffusion Models
di: Singhal, Raghav, et al.
Pubblicazione: (2025)

Steering Sparse Autoencoder Latents to Control Dynamic Head Pruning in Vision Transformers (Student Abstract)
di: Lee, Yousung, et al.
Pubblicazione: (2026)

Evi-Steer: Learning to Steer Biomedical Vision-Language Models through Efficient and Generalizable Evidential Tuning
di: Koleilat, Taha, et al.
Pubblicazione: (2026)

LAMP: Learning Universal Adversarial Perturbations for Multi-Image Tasks via Pre-trained Models
di: Ishmam, Alvi Md, et al.
Pubblicazione: (2026)

SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities
di: Chen, Boyuan, et al.
Pubblicazione: (2024)

Controlling Steering Angle for Cooperative Self-driving Vehicles utilizing CNN and LSTM-based Deep Networks
di: Valiente, Rodolfo, et al.
Pubblicazione: (2019)

Debias your Large Multi-Modal Model at Test-Time via Non-Contrastive Visual Attribute Steering
di: Ratzlaff, Neale, et al.
Pubblicazione: (2024)

Model Steering: Learning with a Reference Model Improves Generalization Bounds and Scaling Laws
di: Wei, Xiyuan, et al.
Pubblicazione: (2025)

Anatomy-VLM: A Fine-grained Vision-Language Model for Medical Interpretation
di: Gu, Difei, et al.
Pubblicazione: (2025)

ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Area
di: Li, Junxian, et al.
Pubblicazione: (2024)

ATHENA: Adaptive Test-Time Steering for Improving Count Fidelity in Diffusion Models
di: Sepehri, Mohammad Shahab, et al.
Pubblicazione: (2026)

Beyond Prompt Engineering: Robust Behavior Control in LLMs via Steering Target Atoms
di: Wang, Mengru, et al.
Pubblicazione: (2025)

Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts
di: Golovanevsky, Michal, et al.
Pubblicazione: (2025)

Dynamic Multimodal Activation Steering for Hallucination Mitigation in Large Vision-Language Models
di: Yin, Jianghao, et al.
Pubblicazione: (2026)

FREE: Fast and Robust Vision Language Models with Early Exits
di: Bajpai, Divya Jyoti, et al.
Pubblicazione: (2025)

SteeringDiffusion: A Bottlenecked Activation Control Interface for Diffusion Models
di: Wu, Fangzheng, et al.
Pubblicazione: (2026)

Lightweight Unsupervised Federated Learning with Pretrained Vision Language Model
di: Yan, Hao, et al.
Pubblicazione: (2024)