Cover Image

Evaluation of LLM Chatbots for OSINT-based Cyber Threat Awareness

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shafee, Samaneh, Bessani, Alysson, Ferreira, Pedro M.
Format:	Preprint
Published:	2024
Subjects:	Cryptography and Security Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLM Cyber Evaluations Don't Capture Real-World Risk
by: Lukošiūtė, Kamilė, et al.
Published: (2025)

AutoMalDesc: Large-Scale Script Analysis for Cyber Threat Research
by: Apostu, Alexandru-Mihai, et al.
Published: (2025)

ThreatCrawl: A BERT-based Focused Crawler for the Cybersecurity Domain
by: Kuehn, Philipp, et al.
Published: (2023)

AnnoCTR: A Dataset for Detecting and Linking Entities, Tactics, and Techniques in Cyber Threat Reports
by: Lange, Lukas, et al.
Published: (2024)

Cyber-Zero: Training Cybersecurity Agents without Runtime
by: Zhuo, Terry Yue, et al.
Published: (2025)

Evaluating the Usability of LLMs in Threat Intelligence Enrichment
by: Srikanth, Sanchana, et al.
Published: (2024)

FALCON: Autonomous Cyber Threat Intelligence Mining with LLMs for IDS Rule Generation
by: Mitra, Shaswata, et al.
Published: (2025)

Cyber-Attack Technique Classification Using Two-Stage Trained Large Language Models
by: You, Weiqiu, et al.
Published: (2024)

Watermark under Fire: A Robustness Evaluation of LLM Watermarking
by: Liang, Jiacheng, et al.
Published: (2024)

Cross-Session Threats in AI Agents: Benchmark, Evaluation, and Algorithms
by: Azarafrooz, Ari
Published: (2026)

ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigation
by: Wu, Yiran, et al.
Published: (2025)

On Calibration of LLM-based Guard Models for Reliable Content Moderation
by: Liu, Hongfu, et al.
Published: (2024)

LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems
by: Moia, Vitor Hugo Galhardo, et al.
Published: (2025)

BinaryShield: Cross-Service Threat Intelligence in LLM Services using Privacy-Preserving Fingerprints
by: Gill, Waris, et al.
Published: (2025)

Can Federated Learning Safeguard Private Data in LLM Training? Vulnerabilities, Attacks, and Defense Evaluation
by: Guo, Wenkai, et al.
Published: (2025)

Improving Your Model Ranking on Chatbot Arena by Vote Rigging
by: Min, Rui, et al.
Published: (2025)

CyberThreat-Eval: Can Large Language Models Automate Real-World Threat Research?
by: Chen, Xiangsen, et al.
Published: (2026)

Vendor-Conditioned Contrastive Learning for Predicting Organizational Cyber Threat Targets
by: Ampel, Benjamin M.
Published: (2020)

CodeCloak: A Method for Evaluating and Mitigating Code Leakage by LLM Code Assistants
by: Noah, Amit Finkman, et al.
Published: (2024)

LLM Unlearning Should Be Form-Independent
by: Ye, Xiaotian, et al.
Published: (2025)

GCG Attack On A Diffusion LLM
by: Neyroud, Ruben, et al.
Published: (2025)

LLMGuard: Guarding Against Unsafe LLM Behavior
by: Goyal, Shubh, et al.
Published: (2024)

Sparse Autoencoders are Capable LLM Jailbreak Mitigators
by: Assogba, Yannick, et al.
Published: (2026)

Localizing Malicious Outputs from CodeLLM
by: Borana, Mayukh, et al.
Published: (2025)

Humanizing the Machine: Proxy Attacks to Mislead LLM Detectors
by: Wang, Tianchun, et al.
Published: (2024)

Improving LLM Safety Alignment with Dual-Objective Optimization
by: Zhao, Xuandong, et al.
Published: (2025)

Beyond Indistinguishability: Measuring Extraction Risk in LLM APIs
by: Liu, Ruixuan, et al.
Published: (2026)

Importing Phantoms: Measuring LLM Package Hallucination Vulnerabilities
by: Krishna, Arjun, et al.
Published: (2025)

PVMark: Enabling Public Verifiability for LLM Watermarking Schemes
by: Duan, Haohua, et al.
Published: (2025)

Assessing Deanonymization Risks with Stylometry-Assisted LLM Agent
by: Zhang, Boyang, et al.
Published: (2026)

MVP-ORAM: a Wait-free Concurrent ORAM for Confidential BFT Storage
by: Vassantlal, Robin, et al.
Published: (2025)

LLM Dataset Inference: Did you train on my dataset?
by: Maini, Pratyush, et al.
Published: (2024)

Robust LLM safeguarding via refusal feature adversarial training
by: Yu, Lei, et al.
Published: (2024)

Proving membership in LLM pretraining data via data watermarks
by: Wei, Johnny Tian-Zheng, et al.
Published: (2024)

No Free Lunch in LLM Watermarking: Trade-offs in Watermarking Design Choices
by: Pang, Qi, et al.
Published: (2024)

AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
by: Zeng, Yifan, et al.
Published: (2024)

The Canary's Echo: Auditing Privacy Risks of LLM-Generated Synthetic Text
by: Meeus, Matthieu, et al.
Published: (2025)

TextSeal: A Localized LLM Watermark for Provenance & Distillation Protection
by: Sander, Tom, et al.
Published: (2026)

Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLM
by: Yang, Xikang, et al.
Published: (2024)

WaterMax: breaking the LLM watermark detectability-robustness-quality trade-off
by: Giboulot, Eva, et al.
Published: (2024)