ASTRA: Autonomous Spatial-Temporal Red-teaming for AI Software Assistants
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916883311099904 |
|---|---|
| author | Xu, Xiangzhe Shen, Guangyu Su, Zian Cheng, Siyuan Guo, Hanxi Yan, Lu Chen, Xuan Jiang, Jiasheng Jin, Xiaolong Wang, Chengpeng Zhang, Zhuo Zhang, Xiangyu |
| author_facet | Xu, Xiangzhe Shen, Guangyu Su, Zian Cheng, Siyuan Guo, Hanxi Yan, Lu Chen, Xuan Jiang, Jiasheng Jin, Xiaolong Wang, Chengpeng Zhang, Zhuo Zhang, Xiangyu |
| contents | AI coding assistants like GitHub Copilot are rapidly transforming software development, but their safety remains deeply uncertain-especially in high-stakes domains like cybersecurity. Current red-teaming tools often rely on fixed benchmarks or unrealistic prompts, missing many real-world vulnerabilities. We present ASTRA, an automated agent system designed to systematically uncover safety flaws in AI-driven code generation and security guidance systems. ASTRA works in three stages: (1) it builds structured domain-specific knowledge graphs that model complex software tasks and known weaknesses; (2) it performs online vulnerability exploration of each target model by adaptively probing both its input space, i.e., the spatial exploration, and its reasoning processes, i.e., the temporal exploration, guided by the knowledge graphs; and (3) it generates high-quality violation-inducing cases to improve model alignment. Unlike prior methods, ASTRA focuses on realistic inputs-requests that developers might actually ask-and uses both offline abstraction guided domain modeling and online domain knowledge graph adaptation to surface corner-case vulnerabilities. Across two major evaluation domains, ASTRA finds 11-66% more issues than existing techniques and produces test cases that lead to 17% more effective alignment training, showing its practical value for building safer AI systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_03936 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ASTRA: Autonomous Spatial-Temporal Red-teaming for AI Software Assistants Xu, Xiangzhe Shen, Guangyu Su, Zian Cheng, Siyuan Guo, Hanxi Yan, Lu Chen, Xuan Jiang, Jiasheng Jin, Xiaolong Wang, Chengpeng Zhang, Zhuo Zhang, Xiangyu Cryptography and Security Computation and Language Machine Learning Software Engineering AI coding assistants like GitHub Copilot are rapidly transforming software development, but their safety remains deeply uncertain-especially in high-stakes domains like cybersecurity. Current red-teaming tools often rely on fixed benchmarks or unrealistic prompts, missing many real-world vulnerabilities. We present ASTRA, an automated agent system designed to systematically uncover safety flaws in AI-driven code generation and security guidance systems. ASTRA works in three stages: (1) it builds structured domain-specific knowledge graphs that model complex software tasks and known weaknesses; (2) it performs online vulnerability exploration of each target model by adaptively probing both its input space, i.e., the spatial exploration, and its reasoning processes, i.e., the temporal exploration, guided by the knowledge graphs; and (3) it generates high-quality violation-inducing cases to improve model alignment. Unlike prior methods, ASTRA focuses on realistic inputs-requests that developers might actually ask-and uses both offline abstraction guided domain modeling and online domain knowledge graph adaptation to surface corner-case vulnerabilities. Across two major evaluation domains, ASTRA finds 11-66% more issues than existing techniques and produces test cases that lead to 17% more effective alignment training, showing its practical value for building safer AI systems. |
| title | ASTRA: Autonomous Spatial-Temporal Red-teaming for AI Software Assistants |
| topic | Cryptography and Security Computation and Language Machine Learning Software Engineering |
| url | https://arxiv.org/abs/2508.03936 |