Semantic Energy: Detecting LLM Hallucination Beyond Entropy

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Ma, Huan, Pan, Jiadong, Liu, Jing, Chen, Yan, Zhou, Joey Tianyi, Wang, Guangyu, Hu, Qinghua, Wu, Hua, Zhang, Changqing, Wang, Haifeng
Format:	Preprint
Veröffentlicht:	2025
Schlagworte:	Machine Learning
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Estimating LLM Uncertainty with Evidence
von: Ma, Huan, et al.
Veröffentlicht: (2025)

The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection
von: Zhang, Qingyang, et al.
Veröffentlicht: (2024)

Selective Learning: Towards Robust Calibration with Dynamic Regularization
von: Han, Zongbo, et al.
Veröffentlicht: (2024)

Helping CLIP See Both the Forest and the Trees: A Decomposition and Description Approach
von: Xue, Leyan, et al.
Veröffentlicht: (2025)

Mitigating Entangled Steering in Large Vision-Language Models for Hallucination Reduction
von: Zhang, Yuanhong, et al.
Veröffentlicht: (2026)

Computational Reasoning of Large Language Models
von: Wu, Haitao, et al.
Veröffentlicht: (2025)

Efficient Hallucination Detection: Adaptive Bayesian Estimation of Semantic Entropy with Guided Semantic Exploration
von: Sun, Qiyao, et al.
Veröffentlicht: (2026)

Collaborative Knowledge Infusion for Low-resource Stance Detection
von: Yan, Ming, et al.
Veröffentlicht: (2024)

Generalized Few-Shot Out-of-Distribution Detection
von: Li, Pinxuan, et al.
Veröffentlicht: (2025)

Beyond Linear LLM Invocation: An Efficient and Effective Semantic Filter Paradigm
von: Hou, Nan, et al.
Veröffentlicht: (2026)

Semantic Reformulation Entropy for Robust Hallucination Detection in QA Tasks
von: Tong, Chaodong, et al.
Veröffentlicht: (2025)

Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs
von: Kossen, Jannik, et al.
Veröffentlicht: (2024)

Spurious Feature Eraser: Stabilizing Test-Time Adaptation for Vision-Language Foundation Model
von: Ma, Huan, et al.
Veröffentlicht: (2024)

Exploring Task-Level Optimal Prompts for Visual In-Context Learning
von: Zhu, Yan, et al.
Veröffentlicht: (2025)

SEReDeEP: Hallucination Detection in Retrieval-Augmented Models via Semantic Entropy and Context-Parameter Fusion
von: Wang, Lei
Veröffentlicht: (2025)

PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations
von: Wu, Yuhe, et al.
Veröffentlicht: (2026)

BEE-RAG: Balanced Entropy Engineering for Retrieval-Augmented Generation
von: Wang, Yuhao, et al.
Veröffentlicht: (2025)

Estimating the Black-box LLM Uncertainty with Distribution-Aligned Adversarial Distillation
von: Cui, Huizi, et al.
Veröffentlicht: (2026)

Hallucination Detection on a Budget: Efficient Bayesian Estimation of Semantic Entropy
von: Ciosek, Kamil, et al.
Veröffentlicht: (2025)

Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges
von: Liu, Ping, et al.
Veröffentlicht: (2024)

PVP: Polar Representation Boost for 3D Semantic Occupancy Prediction
von: Xue, Yujing, et al.
Veröffentlicht: (2024)

LLM Hallucination Detection: HSAD
von: Li, JinXin, et al.
Veröffentlicht: (2025)

Semantic Faithfulness and Entropy Production Measures to Tame Your LLM Demons and Manage Hallucinations
von: Halperin, Igor
Veröffentlicht: (2025)

Beyond Semantic Entropy: Boosting LLM Uncertainty Quantification with Pairwise Semantic Similarity
von: Nguyen, Dang, et al.
Veröffentlicht: (2025)

Data-independent Module-aware Pruning for Hierarchical Vision Transformers
von: He, Yang, et al.
Veröffentlicht: (2024)

EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detection
von: Qiu, Zihang, et al.
Veröffentlicht: (2024)

ICAD-LLM: One-for-All Anomaly Detection via In-Context Learning with Large Language Models
von: Wu, Zhongyuan, et al.
Veröffentlicht: (2025)

Agent Trading Arena: A Study on Numerical Understanding in LLM-Based Agents
von: Ma, Tianmi, et al.
Veröffentlicht: (2025)

UniVRSE: Unified Vision-conditioned Response Semantic Entropy for Hallucination Detection in Medical Vision-Language Models
von: Liao, Zehui, et al.
Veröffentlicht: (2025)

Reducing Linguistic Hallucination in LM-Based Speech Enhancement via Noise-Invariant Acoustic-Semantic Distillation
von: Wang, Zheng, et al.
Veröffentlicht: (2026)

Beyond Modality Collapse: Representations Blending for Multimodal Dataset Distillation
von: Zhang, Xin, et al.
Veröffentlicht: (2025)

Why Semantic Entropy Fails: Geometry-Aware and Calibrated Uncertainty for Policy Optimization
von: Zhang, Zheyuan, et al.
Veröffentlicht: (2026)

Enhancing Uncertainty Modeling with Semantic Graph for Hallucination Detection
von: Chen, Kedi, et al.
Veröffentlicht: (2025)

Self-Improving Code Generation via Semantic Entropy and Behavioral Consensus
von: Zhang, Huan, et al.
Veröffentlicht: (2026)

Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning
von: Wu, Shengqiong, et al.
Veröffentlicht: (2024)

Steer LLM Latents for Hallucination Detection
von: Park, Seongheon, et al.
Veröffentlicht: (2025)

Out-Of-Distribution Detection with Diversification (Provably)
von: Yao, Haiyun, et al.
Veröffentlicht: (2024)

Beyond ROUGE: N-Gram Subspace Features for LLM Hallucination Detection
von: Li, Jerry, et al.
Veröffentlicht: (2025)

Efficient Reinforcement Learning with Semantic and Token Entropy for LLM Reasoning
von: Cao, Hongye, et al.
Veröffentlicht: (2025)

Rethinking LLM Ensembling from the Perspective of Mixture Models
von: Fu, Jiale, et al.
Veröffentlicht: (2026)

if (filemtime($filename) + $maxlifetime < time()) { unlink($filename); $count++; } } return $count; } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ protected function saveSession($sessId, $data): bool { $sessFile = $this->path . '/sess_' . $sessId; if ($handle = fopen($sessFile, 'w')) { $return = false; // Lock the file for exclusive access to avoid issues with multiple // processes writing session simultaneously: if (flock($handle, LOCK_EX)) { $return = fwrite($handle, $data); // Make sure that there's no trailing data by truncating the file to // the correct length: ftruncate($handle, strlen($data)); fflush($handle); flock($handle, LOCK_UN); } fclose($handle); if ($return !== false) { return true; } } // If we got this far, something went wrong with the file output... // It is tempting to throw an exception here, but this code is called // outside of the context of exception handling, so all we can do is // echo a message.

// Anecdotal testing Today and Yesterday seems to indicate destroy() // is called by the garbage collector and everything is good. // Something to keep in mind though. return 0; } /** * Write function that is called when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ public function write($sessId, $data): bool { if ($this->writesDisabled) { return true; } return $this->saveSession($sessId, $data); } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ abstract protected function saveSession($sessId, $data): bool; }

* * @return void */ public function writeClose() { // The assumption is that we're using PHP's ext/session. // session_write_close() will actually overwrite $_SESSION with an // empty array on completion -- which leads to a mismatch between what // is in the storage object and $_SESSION. To get around this, we // temporarily reset $_SESSION to an array, and then re-link it to // the storage object. // // Additionally, while you _can_ write to $_SESSION following a // session_write_close() operation, no changes made to it will be // flushed to the session handler. As such, we now mark the storage // object isImmutable. $storage = $this->getStorage(); if (! $storage->isImmutable()) { $_SESSION = $storage->toArray(true); session_write_close(); $storage->fromArray($_SESSION); $storage->markImmutable(); } } /** * Attempt to set the session name * * If the session has already been started, or if the name provided fails * validation, an exception will be raised. * * @param string $name * @return SessionManager * @throws Exception\InvalidArgumentException */ public function setName($name) { if ($this->sessionExists()) { throw new Exception\InvalidArgumentException( 'Cannot set session name after a session has already started'

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
language	"de"
VUFIND_SESSION	"f1bafde2e46560047ad120df861fd063"
ui	"standard"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790897342.4211 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "f1bafde2e46560047ad120df861fd063" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"language=de; VUFIND_SESSION=f1bafde2e46560047ad120df861fd063; ui=standard"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.217.142"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"34027"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2508_14496/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2508_14496/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790897342.4133
REQUEST_TIME	1790897342

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler