Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910963009060864 |
|---|---|
| author | Zhu, Yuqicheng Hernández, Daniel He, Yuan Ding, Zifeng Xiong, Bo Kharlamov, Evgeny Staab, Steffen |
| author_facet | Zhu, Yuqicheng Hernández, Daniel He, Yuan Ding, Zifeng Xiong, Bo Kharlamov, Evgeny Staab, Steffen |
| contents | Uncertainty quantification in Knowledge Graph Embedding (KGE) methods is crucial for ensuring the reliability of downstream applications. A recent work applies conformal prediction to KGE methods, providing uncertainty estimates by generating a set of answers that is guaranteed to include the true answer with a predefined confidence level. However, existing methods provide probabilistic guarantees averaged over a reference set of queries and answers (marginal coverage guarantee). In high-stakes applications such as medical diagnosis, a stronger guarantee is often required: the predicted sets must provide consistent coverage per query (conditional coverage guarantee). We propose CondKGCP, a novel method that approximates predicate-conditional coverage guarantees while maintaining compact prediction sets. CondKGCP merges predicates with similar vector representations and augments calibration with rank information. We prove the theoretical guarantees and demonstrate empirical effectiveness of CondKGCP by comprehensive evaluations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16877 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings Zhu, Yuqicheng Hernández, Daniel He, Yuan Ding, Zifeng Xiong, Bo Kharlamov, Evgeny Staab, Steffen Artificial Intelligence Uncertainty quantification in Knowledge Graph Embedding (KGE) methods is crucial for ensuring the reliability of downstream applications. A recent work applies conformal prediction to KGE methods, providing uncertainty estimates by generating a set of answers that is guaranteed to include the true answer with a predefined confidence level. However, existing methods provide probabilistic guarantees averaged over a reference set of queries and answers (marginal coverage guarantee). In high-stakes applications such as medical diagnosis, a stronger guarantee is often required: the predicted sets must provide consistent coverage per query (conditional coverage guarantee). We propose CondKGCP, a novel method that approximates predicate-conditional coverage guarantees while maintaining compact prediction sets. CondKGCP merges predicates with similar vector representations and augments calibration with rank information. We prove the theoretical guarantees and demonstrate empirical effectiveness of CondKGCP by comprehensive evaluations. |
| title | Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2505.16877 |