Image de couverture de livre

Do LLMs Know They Are Being Tested? Evaluation Awareness and Incentive-Sensitive Failures in GPT-OSS-20B

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ahmed, Nisar, Zaman, Muhammad Imran, Saleem, Gulshan, Hassan, Ali
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Deep Learning-Based Age Estimation and Gender Deep Learning-Based Age Estimation and Gender Classification for Targeted Advertisement
par: Zaman, Muhammad Imran, et autres
Publié: (2025)

MetaQAP - A Meta-Learning Approach for Quality-Aware Pretraining in Image Quality Assessment
par: Ahmed, Nisar, et autres
Publié: (2025)

Learning to Reason: Training LLMs with GPT-OSS or DeepSeek R1 Reasoning Traces
par: Shmidman, Shaltiel, et autres
Publié: (2025)

A Robust Deep Networks based Multi-Object MultiCamera Tracking System for City Scale Traffic
par: Zaman, Muhammad Imran, et autres
Publié: (2025)

Do We Know What LLMs Don't Know? A Study of Consistency in Knowledge Probing
par: Zhao, Raoyuan, et autres
Publié: (2025)

OpenAI's GPT-OSS-20B Model and Safety Alignment Issues in a Low-Resource Language
par: Inuwa-Dutse, Isa
Publié: (2025)

Is GPT-OSS Good? A Comprehensive Evaluation of OpenAI's Latest Open Source Models
par: Bi, Ziqian, et autres
Publié: (2025)

Improving Arabic Multi-Label Emotion Classification using Stacked Embeddings and Hybrid Loss Function
par: Aslam, Muhammad Azeem, et autres
Publié: (2024)

LLMs Learn Constructions That Humans Do Not Know
par: Dunn, Jonathan, et autres
Publié: (2025)

Do LLMs Know to Respect Copyright Notice?
par: Xu, Jialiang, et autres
Publié: (2024)

Knowing But Not Doing: Convergent Morality and Divergent Action in LLMs
par: Huang, Jen-tse, et autres
Publié: (2026)

Hallucination as Commitment Failure: Larger LLMs Misfire Despite Knowing the Answer
par: Yeom, Jewon, et autres
Publié: (2026)

LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked
par: Phute, Mansi, et autres
Publié: (2023)

Evaluating Compositional Approaches for Focus and Sentiment Analysis
par: Kellert, Olga, et autres
Publié: (2025)

Large Language Models Often Know When They Are Being Evaluated
par: Needham, Joe, et autres
Publié: (2025)

Can LLMs Refuse Questions They Do Not Know? Measuring Knowledge-Aware Refusal in Factual Tasks
par: Pan, Wenbo, et autres
Publié: (2025)

Enhancing Wireless Device Identification through RF Fingerprinting: Leveraging Transient Energy Spectrum Analysis
par: Ahmed, Nisar, et autres
Publié: (2025)

How Much Do LLMs Know About Chinese Zero Pronouns?
par: Li, Yifei, et autres
Publié: (2026)

GeoResponder: Towards Building Geospatial LLMs for Time-Critical Disaster Response
par: Zguir, Ahmed El Fekih, et autres
Publié: (2025)

Evaluating the Unseen Capabilities: How Many Theorems Do LLMs Know?
par: Li, Xiang, et autres
Publié: (2025)

Emotion-Aware Embedding Fusion in LLMs (Flan-T5, LLAMA 2, DeepSeek-R1, and ChatGPT 4) for Intelligent Response Generation
par: Rasool, Abdur, et autres
Publié: (2024)

Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden States
par: Duan, Hanyu, et autres
Publié: (2024)

The Hawthorne Effect in Reasoning Models: Evaluating and Steering Test Awareness
par: Abdelnabi, Sahar, et autres
Publié: (2025)

DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs
par: Mousavi, Seyed Mahed, et autres
Publié: (2024)

What If We Allocate Test-Time Compute Adaptively?
par: Bilal, Ahsan, et autres
Publié: (2026)

Do LLMs Really Know What They Don't Know? Internal States Mainly Reflect Knowledge Recall Rather Than Truthfulness
par: Cheang, Chi Seng, et autres
Publié: (2025)

Do LLMs Know When to NOT Answer? Investigating Abstention Abilities of Large Language Models
par: Madhusudhan, Nishanth, et autres
Publié: (2024)

Do Multilingual LLMs have specialized language heads?
par: Naufil, Muhammad
Publié: (2026)

Data Doping or True Intelligence? Evaluating the Transferability of Injected Knowledge in LLMs
par: Jan, Essa, et autres
Publié: (2025)

FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environments
par: Saeidi, Amir, et autres
Publié: (2026)

Do LLMs Know What Luxembourgish Borrows? Probing Lexical Neology in Low-Resource Multilingual Models
par: Hosseini-Kivanani, Nina
Publié: (2026)

Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations
par: Liu, Yilong, et autres
Publié: (2026)

Do Language Models Know When They'll Refuse? Probing Introspective Awareness of Safety Boundaries
par: Gondil, Tanay
Publié: (2026)

The role of large language models in UI/UX design: A systematic literature review
par: Ahmed, Ammar, et autres
Publié: (2025)

Do LLMs Really Forget? Evaluating Unlearning with Knowledge Correlation and Confidence Awareness
par: Wei, Rongzhe, et autres
Publié: (2025)

Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Models
par: Ferrando, Javier, et autres
Publié: (2024)

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory
par: Cacioli, Jon-Paul
Publié: (2026)

Development of Crop Yield Estimation Model using Soil and Environmental Parameters
par: Ahmed, Nisar, et autres
Publié: (2021)

When Incentives Backfire, Data Stops Being Human
par: Santy, Sebastin, et autres
Publié: (2025)

DentalGPT: Incentivizing Multimodal Complex Reasoning in Dentistry
par: Cai, Zhenyang, et autres
Publié: (2025)