Evaluating the Efficacy of Prompt-Engineered Large Multimodal Models Versus Fine-Tuned Vision Transformers in Image-Based Security Applications
Fuente:
arXiv
Guardado en:
| Autores principales: | Trad, Fouad, Chehab, Ali |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Retrieval-Augmented Few-Shot Prompting Versus Fine-Tuning for Code Vulnerability Detection
por: Trad, Fouad, et al.
Publicado: (2025)
por: Trad, Fouad, et al.
Publicado: (2025)
Large Multimodal Agents for Accurate Phishing Detection with Enhanced Token Optimization and Cost Reduction
por: Trad, Fouad, et al.
Publicado: (2024)
por: Trad, Fouad, et al.
Publicado: (2024)
CLASP: Cost-Optimized LLM-based Agentic System for Phishing Detection
por: Trad, Fouad, et al.
Publicado: (2025)
por: Trad, Fouad, et al.
Publicado: (2025)
Detecting Quishing Attacks with Machine Learning Techniques Through QR Code Analysis
por: Trad, Fouad, et al.
Publicado: (2025)
por: Trad, Fouad, et al.
Publicado: (2025)
Effective Fine-Tuning of Vision Transformers with Low-Rank Adaptation for Privacy-Preserving Image Classification
por: Lin, Haiwei, et al.
Publicado: (2025)
por: Lin, Haiwei, et al.
Publicado: (2025)
Unbridled Icarus: A Survey of the Potential Perils of Image Inputs in Multimodal Large Language Model Security
por: Fan, Yihe, et al.
Publicado: (2024)
por: Fan, Yihe, et al.
Publicado: (2024)
A Cross-Modal Prompt Injection Attack against Large Vision-Language Models with Image-Only Perturbation
por: Yang, Hao, et al.
Publicado: (2026)
por: Yang, Hao, et al.
Publicado: (2026)
DLOVE: A new Security Evaluation Tool for Deep Learning Based Watermarking Techniques
por: Padhi, Sudev Kumar, et al.
Publicado: (2024)
por: Padhi, Sudev Kumar, et al.
Publicado: (2024)
Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
por: Ding, Yi, et al.
Publicado: (2025)
por: Ding, Yi, et al.
Publicado: (2025)
Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers
por: Yang, Sheng, et al.
Publicado: (2024)
por: Yang, Sheng, et al.
Publicado: (2024)
SecureT2I: No More Unauthorized Manipulation on AI Generated Images from Prompts
por: Wu, Xiaodong, et al.
Publicado: (2025)
por: Wu, Xiaodong, et al.
Publicado: (2025)
DAVSP: Safety Alignment for Large Vision-Language Models via Deep Aligned Visual Safety Prompt
por: Zhang, Yitong, et al.
Publicado: (2025)
por: Zhang, Yitong, et al.
Publicado: (2025)
PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning
por: Hussein, Noor, et al.
Publicado: (2024)
por: Hussein, Noor, et al.
Publicado: (2024)
Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Images
por: Naseh, Ali, et al.
Publicado: (2024)
por: Naseh, Ali, et al.
Publicado: (2024)
Lazy Layers to Make Fine-Tuned Diffusion Models More Traceable
por: Liu, Haozhe, et al.
Publicado: (2024)
por: Liu, Haozhe, et al.
Publicado: (2024)
A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluations
por: Ye, Mang, et al.
Publicado: (2025)
por: Ye, Mang, et al.
Publicado: (2025)
Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images
por: Gao, Kuofeng, et al.
Publicado: (2024)
por: Gao, Kuofeng, et al.
Publicado: (2024)
Image-Based Geolocation Using Large Vision-Language Models
por: Liu, Yi, et al.
Publicado: (2024)
por: Liu, Yi, et al.
Publicado: (2024)
Image Corruption-Inspired Membership Inference Attacks against Large Vision-Language Models
por: Wu, Zongyu, et al.
Publicado: (2025)
por: Wu, Zongyu, et al.
Publicado: (2025)
Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt
por: Ying, Zonghao, et al.
Publicado: (2024)
por: Ying, Zonghao, et al.
Publicado: (2024)
InverTune: Removing Backdoors from Multimodal Contrastive Learning Models via Trigger Inversion and Activation Tuning
por: Sun, Mengyuan, et al.
Publicado: (2025)
por: Sun, Mengyuan, et al.
Publicado: (2025)
Backdoor Mitigation in Object Detection via Adversarial Fine-Tuning
por: Dunnett, Kealan, et al.
Publicado: (2026)
por: Dunnett, Kealan, et al.
Publicado: (2026)
Are You Copying My Prompt? Protecting the Copyright of Vision Prompt for VPaaS via Watermark
por: Ren, Huali, et al.
Publicado: (2024)
por: Ren, Huali, et al.
Publicado: (2024)
R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuning
por: Sheng, Lijun, et al.
Publicado: (2025)
por: Sheng, Lijun, et al.
Publicado: (2025)
To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Model
por: Zhao, Chengshuai, et al.
Publicado: (2026)
por: Zhao, Chengshuai, et al.
Publicado: (2026)
Probabilistic Modeling of Jailbreak on Multimodal LLMs: From Quantification to Application
por: Xu, Wenzhuo, et al.
Publicado: (2025)
por: Xu, Wenzhuo, et al.
Publicado: (2025)
Backdoor Directions in Vision Transformers
por: Karayalcin, Sengim, et al.
Publicado: (2026)
por: Karayalcin, Sengim, et al.
Publicado: (2026)
Decomposing Private Image Generation via Coarse-to-Fine Wavelet Modeling
por: Bayrooti, Jasmine, et al.
Publicado: (2026)
por: Bayrooti, Jasmine, et al.
Publicado: (2026)
Revisiting Data Auditing in Large Vision-Language Models
por: Zhu, Hongyu, et al.
Publicado: (2025)
por: Zhu, Hongyu, et al.
Publicado: (2025)
Differentially Private Fine-Tuning of Diffusion Models
por: Tsai, Yu-Lin, et al.
Publicado: (2024)
por: Tsai, Yu-Lin, et al.
Publicado: (2024)
SurrogatePrompt: Bypassing the Safety Filter of Text-to-Image Models via Substitution
por: Ba, Zhongjie, et al.
Publicado: (2023)
por: Ba, Zhongjie, et al.
Publicado: (2023)
Proactive Adversarial Defense: Harnessing Prompt Tuning in Vision-Language Models to Detect Unseen Backdoored Images
por: Stein, Kyle, et al.
Publicado: (2024)
por: Stein, Kyle, et al.
Publicado: (2024)
VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Models
por: Yin, Ziyi, et al.
Publicado: (2023)
por: Yin, Ziyi, et al.
Publicado: (2023)
Toward Reliable, Safe, and Secure LLMs for Scientific Applications
por: Chaturvedi, Saket Sanjeev, et al.
Publicado: (2026)
por: Chaturvedi, Saket Sanjeev, et al.
Publicado: (2026)
Landscape More Secure Than Portrait? Zooming Into the Directionality of Digital Images With Security Implications
por: Lorch, Benedikt, et al.
Publicado: (2024)
por: Lorch, Benedikt, et al.
Publicado: (2024)
ViT-EnsembleAttack: Augmenting Ensemble Models for Stronger Adversarial Transferability in Vision Transformers
por: Cao, Hanwen, et al.
Publicado: (2025)
por: Cao, Hanwen, et al.
Publicado: (2025)
FIDAVL: Fake Image Detection and Attribution using Vision-Language Model
por: Keita, Mamadou, et al.
Publicado: (2024)
por: Keita, Mamadou, et al.
Publicado: (2024)
Test-Time Attention Purification for Backdoored Large Vision Language Models
por: Zhang, Zhifang, et al.
Publicado: (2026)
por: Zhang, Zhifang, et al.
Publicado: (2026)
SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agents
por: Ying, Zonghao, et al.
Publicado: (2025)
por: Ying, Zonghao, et al.
Publicado: (2025)
FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models
por: Cui, Yingqian, et al.
Publicado: (2023)
por: Cui, Yingqian, et al.
Publicado: (2023)
Ejemplares similares
-
Retrieval-Augmented Few-Shot Prompting Versus Fine-Tuning for Code Vulnerability Detection
por: Trad, Fouad, et al.
Publicado: (2025) -
Large Multimodal Agents for Accurate Phishing Detection with Enhanced Token Optimization and Cost Reduction
por: Trad, Fouad, et al.
Publicado: (2024) -
CLASP: Cost-Optimized LLM-based Agentic System for Phishing Detection
por: Trad, Fouad, et al.
Publicado: (2025) -
Detecting Quishing Attacks with Machine Learning Techniques Through QR Code Analysis
por: Trad, Fouad, et al.
Publicado: (2025) -
Effective Fine-Tuning of Vision Transformers with Low-Rank Adaptation for Privacy-Preserving Image Classification
por: Lin, Haiwei, et al.
Publicado: (2025)