OCCULT: Evaluating Large Language Models for Offensive Cyber Operation Capabilities
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Kouremetis, Michael, Dotter, Marissa, Byrne, Alex, Martin, Dan, Michalak, Ethan, Russo, Gianpaolo, Threet, Michael, Zarrella, Guido |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
PentestJudge: Judging Agent Behavior Against Operational Requirements
par: Caldwell, Shane, et autres
Publié: (2025)
par: Caldwell, Shane, et autres
Publié: (2025)
Systematic Capability Benchmarking of Frontier Large Language Models for Offensive Cyber Tasks
par: Merves, Tyler H., et autres
Publié: (2026)
par: Merves, Tyler H., et autres
Publié: (2026)
An Empirical Evaluation of LLMs for Solving Offensive Security Challenges
par: Shao, Minghao, et autres
Publié: (2024)
par: Shao, Minghao, et autres
Publié: (2024)
AICrypto: Evaluating Cryptography Capabilities of Large Language Models
par: Wang, Yu, et autres
Publié: (2025)
par: Wang, Yu, et autres
Publié: (2025)
Large Language Models for Cyber Security
par: Somani, Raunak, et autres
Publié: (2025)
par: Somani, Raunak, et autres
Publié: (2025)
Evaluating and Enhancing the Vulnerability Reasoning Capabilities of Large Language Models
par: Lu, Li, et autres
Publié: (2026)
par: Lu, Li, et autres
Publié: (2026)
What is the AGI in Offensive Security ?
par: Cho, Youngwoong
Publié: (2026)
par: Cho, Youngwoong
Publié: (2026)
Offensive Robot Cybersecurity
par: Mayoral-Vilches, Víctor
Publié: (2025)
par: Mayoral-Vilches, Víctor
Publié: (2025)
Offensive AI: Enhancing Directory Brute-forcing Attack with the Use of Language Models
par: Castagnaro, Alberto, et autres
Publié: (2024)
par: Castagnaro, Alberto, et autres
Publié: (2024)
PACEbench: A Framework for Evaluating Practical AI Cyber-Exploitation Capabilities
par: Liu, Zicheng, et autres
Publié: (2025)
par: Liu, Zicheng, et autres
Publié: (2025)
Weaponizing Language Models for Cybersecurity Offensive Operations: Automating Vulnerability Assessment Report Validation; A Review Paper
par: Almuhaidib, Abdulrahman S, et autres
Publié: (2025)
par: Almuhaidib, Abdulrahman S, et autres
Publié: (2025)
RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents
par: Black, Sid, et autres
Publié: (2025)
par: Black, Sid, et autres
Publié: (2025)
Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities
par: Anurin, Andrey, et autres
Publié: (2024)
par: Anurin, Andrey, et autres
Publié: (2024)
Cyber Orbits of Large Scale Network Traffic
par: Kepner, Jeremy, et autres
Publié: (2025)
par: Kepner, Jeremy, et autres
Publié: (2025)
Adversarial Knapsack and Secondary Effects of Common Information for Cyber Operations
par: Goohs, Jon, et autres
Publié: (2024)
par: Goohs, Jon, et autres
Publié: (2024)
CS-Eval: A Comprehensive Large Language Model Benchmark for CyberSecurity
par: Yu, Zhengmin, et autres
Publié: (2024)
par: Yu, Zhengmin, et autres
Publié: (2024)
Evaluating Large Language Models' Capability to Launch Fully Automated Spear Phishing Campaigns: Validated on Human Subjects
par: Heiding, Fred, et autres
Publié: (2024)
par: Heiding, Fred, et autres
Publié: (2024)
Exploiting AI for Attacks: On the Interplay between Adversarial AI and Offensive AI
par: Schröer, Saskia Laura, et autres
Publié: (2025)
par: Schröer, Saskia Laura, et autres
Publié: (2025)
The Infinite Mutation Engine? Measuring Polymorphism in LLM-Generated Offensive Code
par: Hortea, Gabriel, et autres
Publié: (2026)
par: Hortea, Gabriel, et autres
Publié: (2026)
HonestCyberEval: An AI Cyber Risk Benchmark for Automated Software Exploitation
par: Ristea, Dan, et autres
Publié: (2024)
par: Ristea, Dan, et autres
Publié: (2024)
A Comprehensive Overview of Large Language Models (LLMs) for Cyber Defences: Opportunities and Directions
par: Hassanin, Mohammed, et autres
Publié: (2024)
par: Hassanin, Mohammed, et autres
Publié: (2024)
SEvenLLM: Benchmarking, Eliciting, and Enhancing Abilities of Large Language Models in Cyber Threat Intelligence
par: Ji, Hangyuan, et autres
Publié: (2024)
par: Ji, Hangyuan, et autres
Publié: (2024)
CyLens: Towards Reinventing Cyber Threat Intelligence in the Paradigm of Agentic Large Language Models
par: Liu, Xiaoqun, et autres
Publié: (2025)
par: Liu, Xiaoqun, et autres
Publié: (2025)
Cyber Warfare During Operation Sindoor: Malware Campaign Analysis and Detection Framework
par: Paliwal, Prakhar, et autres
Publié: (2025)
par: Paliwal, Prakhar, et autres
Publié: (2025)
CYBERSECEVAL 3: Advancing the Evaluation of Cybersecurity Risks and Capabilities in Large Language Models
par: Wan, Shengye, et autres
Publié: (2024)
par: Wan, Shengye, et autres
Publié: (2024)
LLM-Assisted AHP for Explainable Cyber Range Evaluation
par: Kampourakis, Vyron, et autres
Publié: (2025)
par: Kampourakis, Vyron, et autres
Publié: (2025)
Bribe & Fork: Cheap Bribing Attacks via Forking Threat
par: Avarikioti, Zeta, et autres
Publié: (2024)
par: Avarikioti, Zeta, et autres
Publié: (2024)
Offensive tool determination strategy R.I.D.D.L.E. + (C)
par: Errico, Herman
Publié: (2025)
par: Errico, Herman
Publié: (2025)
Towards Effective Identification of Attack Techniques in Cyber Threat Intelligence Reports using Large Language Models
par: Nguyen, Hoang Cuong, et autres
Publié: (2025)
par: Nguyen, Hoang Cuong, et autres
Publié: (2025)
PLLM-CS: Pre-trained Large Language Model (LLM) for Cyber Threat Detection in Satellite Networks
par: Hassanin, Mohammed, et autres
Publié: (2024)
par: Hassanin, Mohammed, et autres
Publié: (2024)
A Survey on Offensive AI Within Cybersecurity
par: Girhepuje, Sahil, et autres
Publié: (2024)
par: Girhepuje, Sahil, et autres
Publié: (2024)
Dynamic Risk Assessments for Offensive Cybersecurity Agents
par: Wei, Boyi, et autres
Publié: (2025)
par: Wei, Boyi, et autres
Publié: (2025)
PRvL: Quantifying the Capabilities and Risks of Large Language Models for PII Redaction
par: Garza, Leon, et autres
Publié: (2025)
par: Garza, Leon, et autres
Publié: (2025)
CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Models
par: Bhatt, Manish, et autres
Publié: (2024)
par: Bhatt, Manish, et autres
Publié: (2024)
CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scale
par: Wang, Zhun, et autres
Publié: (2025)
par: Wang, Zhun, et autres
Publié: (2025)
Concept-ROT: Poisoning Concepts in Large Language Models with Model Editing
par: Grimes, Keltin, et autres
Publié: (2024)
par: Grimes, Keltin, et autres
Publié: (2024)
AEGIS: White-Box Attack Path Generation using LLMs and Training Effectiveness Evaluation for Large-Scale Cyber Defence Exercises
par: Tung, Ivan K., et autres
Publié: (2026)
par: Tung, Ivan K., et autres
Publié: (2026)
APT-LLM: Embedding-Based Anomaly Detection of Cyber Advanced Persistent Threats Using Large Language Models
par: Benabderrahmane, Sidahmed, et autres
Publié: (2025)
par: Benabderrahmane, Sidahmed, et autres
Publié: (2025)
Large Language Model Integration with Reinforcement Learning to Augment Decision-Making in Autonomous Cyber Operations
par: Tholl, Konur, et autres
Publié: (2025)
par: Tholl, Konur, et autres
Publié: (2025)
CyberMaskQA: A Privacy-Aware Benchmark for Evaluating Large Language Models in Cybersecurity Question Answering
par: Gaddi, Matilda, et autres
Publié: (2026)
par: Gaddi, Matilda, et autres
Publié: (2026)
Documents similaires
-
PentestJudge: Judging Agent Behavior Against Operational Requirements
par: Caldwell, Shane, et autres
Publié: (2025) -
Systematic Capability Benchmarking of Frontier Large Language Models for Offensive Cyber Tasks
par: Merves, Tyler H., et autres
Publié: (2026) -
An Empirical Evaluation of LLMs for Solving Offensive Security Challenges
par: Shao, Minghao, et autres
Publié: (2024) -
AICrypto: Evaluating Cryptography Capabilities of Large Language Models
par: Wang, Yu, et autres
Publié: (2025) -
Large Language Models for Cyber Security
par: Somani, Raunak, et autres
Publié: (2025)