CourtGuard: A Model-Agnostic Framework for Zero-Shot Policy Adaptation in LLM Safety
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917295436070912 |
|---|---|
| author | Suleymanov, Umid Bayramov, Rufiz Gafarli, Suad Musayeva, Seljan Mammadov, Taghi Akhundlu, Aynur Kantarcioglu, Murat |
| author_facet | Suleymanov, Umid Bayramov, Rufiz Gafarli, Suad Musayeva, Seljan Mammadov, Taghi Akhundlu, Aynur Kantarcioglu, Murat |
| contents | Current safety mechanisms for Large Language Models (LLMs) rely heavily on static, fine-tuned classifiers that suffer from adaptation rigidity, the inability to enforce new governance rules without expensive retraining. To address this, we introduce CourtGuard, a retrieval-augmented multi-agent framework that reimagines safety evaluation as Evidentiary Debate. By orchestrating an adversarial debate grounded in external policy documents, CourtGuard achieves state-of-the-art performance across 7 safety benchmarks, outperforming dedicated policy-following baselines without fine-tuning. Beyond standard metrics, we highlight two critical capabilities: (1) Zero-Shot Adaptability, where our framework successfully generalized to an out-of-domain Wikipedia Vandalism task (achieving 90\% accuracy) by swapping the reference policy; and (2) Automated Data Curation and Auditing, where we leveraged CourtGuard to curate and audit nine novel datasets of sophisticated adversarial attacks. Our results demonstrate that decoupling safety logic from model weights offers a robust, interpretable, and adaptable path for meeting current and future regulatory requirements in AI governance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_22557 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | CourtGuard: A Model-Agnostic Framework for Zero-Shot Policy Adaptation in LLM Safety Suleymanov, Umid Bayramov, Rufiz Gafarli, Suad Musayeva, Seljan Mammadov, Taghi Akhundlu, Aynur Kantarcioglu, Murat Artificial Intelligence Machine Learning Current safety mechanisms for Large Language Models (LLMs) rely heavily on static, fine-tuned classifiers that suffer from adaptation rigidity, the inability to enforce new governance rules without expensive retraining. To address this, we introduce CourtGuard, a retrieval-augmented multi-agent framework that reimagines safety evaluation as Evidentiary Debate. By orchestrating an adversarial debate grounded in external policy documents, CourtGuard achieves state-of-the-art performance across 7 safety benchmarks, outperforming dedicated policy-following baselines without fine-tuning. Beyond standard metrics, we highlight two critical capabilities: (1) Zero-Shot Adaptability, where our framework successfully generalized to an out-of-domain Wikipedia Vandalism task (achieving 90\% accuracy) by swapping the reference policy; and (2) Automated Data Curation and Auditing, where we leveraged CourtGuard to curate and audit nine novel datasets of sophisticated adversarial attacks. Our results demonstrate that decoupling safety logic from model weights offers a robust, interpretable, and adaptable path for meeting current and future regulatory requirements in AI governance. |
| title | CourtGuard: A Model-Agnostic Framework for Zero-Shot Policy Adaptation in LLM Safety |
| topic | Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2602.22557 |