GraphCompliance: Aligning Policy and Context Graphs for LLM-Based Regulatory Compliance

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chung, Jiseong, Ko, Ronny, Yoo, Wonchul, Onizuka, Makoto, Kim, Sungmok, Kim, Tae-Wan, Shin, Won-Yong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914124202508288
author Chung, Jiseong
Ko, Ronny
Yoo, Wonchul
Onizuka, Makoto
Kim, Sungmok
Kim, Tae-Wan
Shin, Won-Yong
author_facet Chung, Jiseong
Ko, Ronny
Yoo, Wonchul
Onizuka, Makoto
Kim, Sungmok
Kim, Tae-Wan
Shin, Won-Yong
contents Compliance at web scale poses practical challenges: each request may require a regulatory assessment. Regulatory texts (e.g., the General Data Protection Regulation, GDPR) are cross-referential and normative, while runtime contexts are expressed in unstructured natural language. This setting motivates us to align semantic information in unstructured text with the structured, normative elements of regulations. To this end, we introduce GraphCompliance, a framework that represents regulatory texts as a Policy Graph and runtime contexts as a Context Graph, and aligns them. In this formulation, the policy graph encodes normative structure and cross-references, whereas the context graph formalizes events as subject-action-object (SAO) and entity-relation triples. This alignment anchors the reasoning of a judge large language model (LLM) in structured information and helps reduce the burden of regulatory interpretation and event parsing, enabling a focus on the core reasoning step. In experiments on 300 GDPR-derived real-world scenarios spanning five evaluation tasks, GraphCompliance yields 4.1-7.2 percentage points (pp) higher micro-F1 than LLM-only and RAG baselines, with fewer under- and over-predictions, resulting in higher recall and lower false positive rates. Ablation studies indicate contributions from each graph component, suggesting that structured representations and a judge LLM are complementary for normative reasoning.
format Preprint
id arxiv_https___arxiv_org_abs_2510_26309
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GraphCompliance: Aligning Policy and Context Graphs for LLM-Based Regulatory Compliance
Chung, Jiseong
Ko, Ronny
Yoo, Wonchul
Onizuka, Makoto
Kim, Sungmok
Kim, Tae-Wan
Shin, Won-Yong
Artificial Intelligence
Information Retrieval
I.2.7
Compliance at web scale poses practical challenges: each request may require a regulatory assessment. Regulatory texts (e.g., the General Data Protection Regulation, GDPR) are cross-referential and normative, while runtime contexts are expressed in unstructured natural language. This setting motivates us to align semantic information in unstructured text with the structured, normative elements of regulations. To this end, we introduce GraphCompliance, a framework that represents regulatory texts as a Policy Graph and runtime contexts as a Context Graph, and aligns them. In this formulation, the policy graph encodes normative structure and cross-references, whereas the context graph formalizes events as subject-action-object (SAO) and entity-relation triples. This alignment anchors the reasoning of a judge large language model (LLM) in structured information and helps reduce the burden of regulatory interpretation and event parsing, enabling a focus on the core reasoning step. In experiments on 300 GDPR-derived real-world scenarios spanning five evaluation tasks, GraphCompliance yields 4.1-7.2 percentage points (pp) higher micro-F1 than LLM-only and RAG baselines, with fewer under- and over-predictions, resulting in higher recall and lower false positive rates. Ablation studies indicate contributions from each graph component, suggesting that structured representations and a judge LLM are complementary for normative reasoning.
title GraphCompliance: Aligning Policy and Context Graphs for LLM-Based Regulatory Compliance
topic Artificial Intelligence
Information Retrieval
I.2.7
url https://arxiv.org/abs/2510.26309