Cover Image

Do LLMs Know They Are Being Tested? Evaluation Awareness and Incentive-Sensitive Failures in GPT-OSS-20B

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ahmed, Nisar, Zaman, Muhammad Imran, Saleem, Gulshan, Hassan, Ali
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Deep Learning-Based Age Estimation and Gender Deep Learning-Based Age Estimation and Gender Classification for Targeted Advertisement
by: Zaman, Muhammad Imran, et al.
Published: (2025)

MetaQAP - A Meta-Learning Approach for Quality-Aware Pretraining in Image Quality Assessment
by: Ahmed, Nisar, et al.
Published: (2025)

Learning to Reason: Training LLMs with GPT-OSS or DeepSeek R1 Reasoning Traces
by: Shmidman, Shaltiel, et al.
Published: (2025)

A Robust Deep Networks based Multi-Object MultiCamera Tracking System for City Scale Traffic
by: Zaman, Muhammad Imran, et al.
Published: (2025)

Do We Know What LLMs Don't Know? A Study of Consistency in Knowledge Probing
by: Zhao, Raoyuan, et al.
Published: (2025)

OpenAI's GPT-OSS-20B Model and Safety Alignment Issues in a Low-Resource Language
by: Inuwa-Dutse, Isa
Published: (2025)

Is GPT-OSS Good? A Comprehensive Evaluation of OpenAI's Latest Open Source Models
by: Bi, Ziqian, et al.
Published: (2025)

Improving Arabic Multi-Label Emotion Classification using Stacked Embeddings and Hybrid Loss Function
by: Aslam, Muhammad Azeem, et al.
Published: (2024)

LLMs Learn Constructions That Humans Do Not Know
by: Dunn, Jonathan, et al.
Published: (2025)

Do LLMs Know to Respect Copyright Notice?
by: Xu, Jialiang, et al.
Published: (2024)

Knowing But Not Doing: Convergent Morality and Divergent Action in LLMs
by: Huang, Jen-tse, et al.
Published: (2026)

Hallucination as Commitment Failure: Larger LLMs Misfire Despite Knowing the Answer
by: Yeom, Jewon, et al.
Published: (2026)

LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked
by: Phute, Mansi, et al.
Published: (2023)

Evaluating Compositional Approaches for Focus and Sentiment Analysis
by: Kellert, Olga, et al.
Published: (2025)

Large Language Models Often Know When They Are Being Evaluated
by: Needham, Joe, et al.
Published: (2025)

Can LLMs Refuse Questions They Do Not Know? Measuring Knowledge-Aware Refusal in Factual Tasks
by: Pan, Wenbo, et al.
Published: (2025)

Enhancing Wireless Device Identification through RF Fingerprinting: Leveraging Transient Energy Spectrum Analysis
by: Ahmed, Nisar, et al.
Published: (2025)

How Much Do LLMs Know About Chinese Zero Pronouns?
by: Li, Yifei, et al.
Published: (2026)

GeoResponder: Towards Building Geospatial LLMs for Time-Critical Disaster Response
by: Zguir, Ahmed El Fekih, et al.
Published: (2025)

Evaluating the Unseen Capabilities: How Many Theorems Do LLMs Know?
by: Li, Xiang, et al.
Published: (2025)

Emotion-Aware Embedding Fusion in LLMs (Flan-T5, LLAMA 2, DeepSeek-R1, and ChatGPT 4) for Intelligent Response Generation
by: Rasool, Abdur, et al.
Published: (2024)

Do LLMs Know about Hallucination? An Empirical Investigation of LLM's Hidden States
by: Duan, Hanyu, et al.
Published: (2024)

The Hawthorne Effect in Reasoning Models: Evaluating and Steering Test Awareness
by: Abdelnabi, Sahar, et al.
Published: (2025)

DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs
by: Mousavi, Seyed Mahed, et al.
Published: (2024)

What If We Allocate Test-Time Compute Adaptively?
by: Bilal, Ahsan, et al.
Published: (2026)

Do LLMs Really Know What They Don't Know? Internal States Mainly Reflect Knowledge Recall Rather Than Truthfulness
by: Cheang, Chi Seng, et al.
Published: (2025)

Do LLMs Know When to NOT Answer? Investigating Abstention Abilities of Large Language Models
by: Madhusudhan, Nishanth, et al.
Published: (2024)

Do Multilingual LLMs have specialized language heads?
by: Naufil, Muhammad
Published: (2026)

Data Doping or True Intelligence? Evaluating the Transferability of Injected Knowledge in LLMs
by: Jan, Essa, et al.
Published: (2025)

FAMA: Failure-Aware Meta-Agentic Framework for Open-Source LLMs in Interactive Tool Use Environments
by: Saeidi, Amir, et al.
Published: (2026)

Do LLMs Know What Luxembourgish Borrows? Probing Lexical Neology in Low-Resource Multilingual Models
by: Hosseini-Kivanani, Nina
Published: (2026)

Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations
by: Liu, Yilong, et al.
Published: (2026)

Do Language Models Know When They'll Refuse? Probing Introspective Awareness of Safety Boundaries
by: Gondil, Tanay
Published: (2026)

The role of large language models in UI/UX design: A systematic literature review
by: Ahmed, Ammar, et al.
Published: (2025)

Do LLMs Really Forget? Evaluating Unlearning with Knowledge Correlation and Confidence Awareness
by: Wei, Rongzhe, et al.
Published: (2025)

Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Models
by: Ferrando, Javier, et al.
Published: (2024)

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory
by: Cacioli, Jon-Paul
Published: (2026)

Development of Crop Yield Estimation Model using Soil and Environmental Parameters
by: Ahmed, Nisar, et al.
Published: (2021)

When Incentives Backfire, Data Stops Being Human
by: Santy, Sebastin, et al.
Published: (2025)

DentalGPT: Incentivizing Multimodal Complex Reasoning in Dentistry
by: Cai, Zhenyang, et al.
Published: (2025)