Copertina

The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhao, Qinyu, Xu, Ming, Gupta, Kartik, Asthana, Akshay, Zheng, Liang, Gould, Stephen
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Can We Predict Performance of Large Models across Vision-Language Tasks?
di: Zhao, Qinyu, et al.
Pubblicazione: (2024)

Towards Optimal Feature-Shaping Methods for Out-of-Distribution Detection
di: Zhao, Qinyu, et al.
Pubblicazione: (2024)

DiSA: Diffusion Step Annealing in Autoregressive Image Generation
di: Zhao, Qinyu, et al.
Pubblicazione: (2025)

Gromov Wasserstein Optimal Transport for Semantic Correspondences
di: Snelgar, Francis, et al.
Pubblicazione: (2026)

Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models
di: Snelgar, Francis, et al.
Pubblicazione: (2026)

Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Models
di: Liu, Jiaxiang, et al.
Pubblicazione: (2025)

ARINAR: Bi-Level Autoregressive Feature-by-Feature Generative Models
di: Zhao, Qinyu, et al.
Pubblicazione: (2025)

HiddenDetect: Detecting Jailbreak Attacks against Large Vision-Language Models via Monitoring Hidden States
di: Jiang, Yilei, et al.
Pubblicazione: (2025)

Do Large Language Models Know How Much They Know?
di: Prato, Gabriele, et al.
Pubblicazione: (2025)

The First Token Knows: Single-Decode Confidence for Hallucination Detection
di: Gabriel, Mina
Pubblicazione: (2026)

SmartTrim: Adaptive Tokens and Attention Pruning for Efficient Vision-Language Models
di: Wang, Zekun, et al.
Pubblicazione: (2023)

How Tokenization Limits Phonological Knowledge Representation in Language Models and How to Improve Them
di: Liao, Disen, et al.
Pubblicazione: (2026)

Problematic Tokens: Tokenizer Bias in Large Language Models
di: Yang, Jin, et al.
Pubblicazione: (2024)

Fine-Tuning Qwen 2.5 3B for Realistic Movie Dialogue Generation
di: Gupta, Kartik
Pubblicazione: (2025)

Iterative Auto-Annotation for Scientific Named Entity Recognition Using BERT-Based Models
di: Gupta, Kartik
Pubblicazione: (2025)

Vision-centric Token Compression in Large Language Model
di: Xing, Ling, et al.
Pubblicazione: (2025)

SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
di: Feng, Kehua, et al.
Pubblicazione: (2024)

Toward Informal Language Processing: Knowledge of Slang in Large Language Models
di: Sun, Zhewei, et al.
Pubblicazione: (2024)

Know More, Know Clearer: A Meta-Cognitive Framework for Knowledge Augmentation in Large Language Models
di: Chen, Hao, et al.
Pubblicazione: (2026)

Expanding the Boundaries of Vision Prior Knowledge in Multi-modal Large Language Models
di: Liang, Qiao, et al.
Pubblicazione: (2025)

KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Models
di: Zhang, Ruizhe, et al.
Pubblicazione: (2024)

KnowGPT: Knowledge Graph based Prompting for Large Language Models
di: Zhang, Qinggang, et al.
Pubblicazione: (2023)

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models
di: Lyu, Yougang, et al.
Pubblicazione: (2024)

Efficient Knowledge Probing of Large Language Models by Adapting Pre-trained Embeddings
di: Sharma, Kartik, et al.
Pubblicazione: (2025)

CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis
di: Xu, Xinzhe, et al.
Pubblicazione: (2025)

KnowShiftQA: How Robust are RAG Systems when Textbook Knowledge Shifts in K-12 Education?
di: Zheng, Tianshi, et al.
Pubblicazione: (2024)

Jailbreaking Large Language Diffusion Models: Revealing Hidden Safety Flaws in Diffusion-Based Text Generation
di: Zhang, Yuanhe, et al.
Pubblicazione: (2025)

Dynamic Token Reweighting for Robust Vision-Language Models
di: Jiang, Tanqiu, et al.
Pubblicazione: (2025)

HIVE: Hidden-Evidence Verification for Hallucination Detection in Diffusion Large Language Models
di: Zhao, Guoshenghui, et al.
Pubblicazione: (2026)

Do We Know What LLMs Don't Know? A Study of Consistency in Knowledge Probing
di: Zhao, Raoyuan, et al.
Pubblicazione: (2025)

Estimating Knowledge in Large Language Models Without Generating a Single Token
di: Gottesman, Daniela, et al.
Pubblicazione: (2024)

How Confident Is the First Token? An Uncertainty-Calibrated Prompt Optimization Framework for Large Language Model Classification and Understanding
di: Chen, Wei, et al.
Pubblicazione: (2026)

What Models Know, How Well They Know It: Knowledge-Weighted Fine-Tuning for Learning When to Say "I Don't Know"
di: Lee, Joosung, et al.
Pubblicazione: (2026)

Mechanistic Circuit-Based Knowledge Editing in Large Language Models
di: Zhao, Tianyi, et al.
Pubblicazione: (2026)

Saying the Unsaid: Revealing the Hidden Language of Multimodal Systems Through Telephone Games
di: Zhao, Juntu, et al.
Pubblicazione: (2025)

Revealing Behavioral Plasticity in Large Language Models: A Token-Conditional Perspective
di: Mao, Liyuan, et al.
Pubblicazione: (2026)

Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models
di: Xu, Derong, et al.
Pubblicazione: (2024)

Know Your Limits: A Survey of Abstention in Large Language Models
di: Wen, Bingbing, et al.
Pubblicazione: (2024)

Fusing Large Language Models with Temporal Transformers for Time Series Forecasting
di: Su, Chen, et al.
Pubblicazione: (2025)

A Survey on Knowledge Distillation of Large Language Models
di: Xu, Xiaohan, et al.
Pubblicazione: (2024)