Cover Image

Measuring and Analyzing Intelligence via Contextual Uncertainty in Large Language Models using Information-Theoretic Metrics

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Shim, Jae Wan
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Enhancing Cross Entropy with a Linearly Adaptive Loss Function for Optimized Classification Performance
by: Shim, Jae Wan
Published: (2025)

On Information-Theoretic Measures of Predictive Uncertainty
by: Schweighofer, Kajetan, et al.
Published: (2024)

LogitScope: A Framework for Analyzing LLM Uncertainty Through Information Metrics
by: Ahmed, Farhan, et al.
Published: (2026)

How to Measure the Intelligence of Large Language Models?
by: Körber, Nils, et al.
Published: (2024)

LLM-Metrics: Measuring Research Impact Through Large Language Model Memory
by: Shen, Si, et al.
Published: (2026)

PPLqa: An Unsupervised Information-Theoretic Quality Metric for Comparing Generative Large Language Models
by: Friedland, Gerald, et al.
Published: (2024)

Contextual Augmentation for Entity Linking using Large Language Models
by: Vollmers, Daniel, et al.
Published: (2025)

TMIQ: Quantifying Test and Measurement Domain Intelligence in Large Language Models
by: Olowe, Emmanuel A., et al.
Published: (2025)

From Passive Metric to Active Signal: The Evolving Role of Uncertainty Quantification in Large Language Models
by: Zhang, Jiaxin, et al.
Published: (2026)

Rule Encoding and Compliance in Large Language Models: An Information-Theoretic Analysis
by: Diederich, Joachim
Published: (2025)

DebUnc: Improving Large Language Model Agent Communication With Uncertainty Metrics
by: Yoffe, Luke, et al.
Published: (2024)

An Information-Theoretic Framework for Robust Large Language Model Editing
by: Chen, Qizhou, et al.
Published: (2025)

An Information Theoretic Evaluation Metric For Strong Unlearning
by: Jeon, Dongjae, et al.
Published: (2024)

Information Theoretic Adversarial Training of Large Language Models
by: Zhang, Yiwei, et al.
Published: (2026)

DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language Models
by: Xie, Jinxiang, et al.
Published: (2024)

Improving Contextual ASR via Multi-grained Fusion with Large Language Models
by: Zhou, Shilin, et al.
Published: (2025)

Analyzing Cognitive Differences Among Large Language Models through the Lens of Social Worldview
by: Li, Jiatao, et al.
Published: (2025)

Contextuality from Single-State Ontological Models: An Information-Theoretic Obstruction
by: Kim, Song-Ju
Published: (2026)

MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialogues
by: Liu, Zheyuan, et al.
Published: (2026)

Large Language Model-Based Uncertainty-Adjusted Label Extraction for Artificial Intelligence Model Development in Upper Extremity Radiography
by: Kreutzer, Hanna, et al.
Published: (2025)

Establishing Reliability Metrics for Reward Models in Large Language Models
by: Chen, Yizhou, et al.
Published: (2025)

Localizing Input Uncertainty Quantification for Large Language Models via Shapley Values
by: Lee, Seongjun, et al.
Published: (2026)

Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review
by: Abbasli, Toghrul, et al.
Published: (2025)

PiCo: Jailbreaking Multimodal Large Language Models via Pictorial Code Contextualization
by: Liu, Aofan, et al.
Published: (2025)

Revealing Multi-View Hallucination in Large Vision-Language Models
by: Park, Wooje, et al.
Published: (2026)

Are Large Vision-Language Models Ready to Guide Blind and Low-Vision Individuals?
by: Kim, Eunki, et al.
Published: (2025)

Uncertainty Quantification of Large Language Models using Approximate Bayesian Computation
by: Sharma, Mridul, et al.
Published: (2025)

Analyzing the Ethical Logic of Six Large Language Models
by: Neuman, W. Russell, et al.
Published: (2025)

Analyzing Nobel Prize Literature with Large Language Models
by: Yang, Zhenyuan, et al.
Published: (2024)

Agentmandering: A Game-Theoretic Framework for Fair Redistricting via Large Language Model Agents
by: Li, Hao, et al.
Published: (2025)

An Information-Theoretic Approach to Analyze NLP Classification Tasks
by: Wang, Luran, et al.
Published: (2024)

Semantic Density: Uncertainty Quantification for Large Language Models through Confidence Measurement in Semantic Space
by: Qiu, Xin, et al.
Published: (2024)

Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models
by: Hu, Zhiyuan, et al.
Published: (2024)

Contextual Reinforcement in Multimodal Token Compression for Large Language Models
by: Piero, Naderdel, et al.
Published: (2025)

Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement Learning
by: Si, Shuzheng, et al.
Published: (2025)

Measuring Copyright Risks of Large Language Model via Partial Information Probing
by: Zhao, Weijie, et al.
Published: (2024)

Detecting Model Drifts in Non-Stationary Environment Using Edit Operation Measures
by: Lee, Chang-Hwan, et al.
Published: (2025)

Addressing Moral Uncertainty using Large Language Models for Ethical Decision-Making
by: Dubey, Rohit K., et al.
Published: (2025)

Analyzing Memorization in Large Language Models through the Lens of Model Attribution
by: Menta, Tarun Ram, et al.
Published: (2025)

Efficient Task Adaptation in Large Language Models via Selective Parameter Optimization
by: Wan, Weijie, et al.
Published: (2026)