Cover Image

AutoTestForge: A Multidimensional Automated Testing Framework for Natural Language Processing Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xing, Hengrui, Tian, Cong, Zhao, Liang, Ma, Zhi, Wang, WenSheng, Zhang, Nan, Huang, Chao, Duan, Zhenhua
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Computation and Language Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Automated Penetration Testing: Formalization and Realization
by: Skandylas, Charilaos, et al.
Published: (2024)

AutoDFBench 1.0: A Benchmarking Framework for Digital Forensic Tool Testing and Generated Code Evaluation
by: Wickramasekara, Akila, et al.
Published: (2025)

PrediQL: Automated Testing of GraphQL APIs with LLMs
by: Liu, Shaolun, et al.
Published: (2025)

AIM: Automated Input Set Minimization for Metamorphic Security Testing
by: Chaleshtari, Nazanin Bayati, et al.
Published: (2024)

Enhancing Fuzz Testing Efficiency through Automated Fuzz Target Generation
by: Tran, Chi Thien
Published: (2026)

Automated Testing of Broken Authentication Vulnerabilities in Web APIs with AuthREST
by: Corradini, Davide, et al.
Published: (2025)

PPT4J: Patch Presence Test for Java Binaries
by: Pan, Zhiyuan, et al.
Published: (2023)

Security Testing of RESTful APIs With Test Case Mutation
by: Salva, Sebastien, et al.
Published: (2024)

Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration Testing
by: Peng, Jiaren, et al.
Published: (2026)

TPSQLi: Test Prioritization for SQL Injection Vulnerability Detection in Web Applications
by: Yang, Guan-Yan, et al.
Published: (2025)

OpDiffer: LLM-Assisted Opcode-Level Differential Testing of Ethereum Virtual Machine
by: Ma, Jie, et al.
Published: (2025)

Measuring the Permission Gate: A Stress-Test Evaluation of Claude Code's Auto Mode
by: Ji, Zimo, et al.
Published: (2026)

Reactive Bottom-Up Testing
by: Muralee, Siddharth, et al.
Published: (2025)

AutoVulnPHP: LLM-Powered Two-Stage PHP Vulnerability Detection and Automated Localization
by: Wang, Zhiqiang, et al.
Published: (2026)

A Systematic Literature Review on Automated Exploit and Security Test Generation
by: Bui, Quang-Cuong, et al.
Published: (2025)

Towards the Systematic Testing of Regular Expression Engines
by: Çakar, Berk, et al.
Published: (2026)

EvoPoC: Automated Exploit Synthesis for DeFi Smart Contracts via Hierarchical Knowledge Graphs
by: Liang, Ruichao, et al.
Published: (2026)

From Transactions to Exploits: Automated PoC Synthesis for Real-World DeFi Attacks
by: Su, Xing, et al.
Published: (2026)

RAN Tester UE: An Automated Declarative UE Centric Security Testing Platform
by: Ueltschey, Charles Marion, et al.
Published: (2025)

A Systematic Study of LLM-Based Architectures for Automated Patching
by: Xu, Qingxiao, et al.
Published: (2026)

PentestGPT: An LLM-empowered Automatic Penetration Testing Tool
by: Deng, Gelei, et al.
Published: (2023)

Unlocking Reproducibility: Automating re-Build Process for Open-Source Software
by: Hassanshahi, Behnaz, et al.
Published: (2025)

CodeHacker: Automated Test Case Generation for Detecting Vulnerabilities in Competitive Programming Solutions
by: Shi, Jingwei, et al.
Published: (2026)

Generating Proof-of-Vulnerability Tests to Help Enhance the Security of Complex Software
by: Kanchi, Shravya, et al.
Published: (2026)

Execution-State-Aware LLM Reasoning for Automated Proof-of-Vulnerability Generation
by: Li, Haoyu, et al.
Published: (2026)

Automated Repair of OpenID Connect Programs (Extended Version)
by: Rahat, Tamjid Al, et al.
Published: (2025)

GraphQLer: Enhancing GraphQL Security with Context-Aware API Testing
by: Tsai, Omar, et al.
Published: (2025)

What Makes a Good LLM Agent for Real-world Penetration Testing?
by: Deng, Gelei, et al.
Published: (2026)

Probing Privacy Leaks in LLM-based Code Generation via Test Generation
by: Ge, Yifei, et al.
Published: (2026)

How Secure is Secure Code Generation? Adversarial Prompts Put LLM Defenses to the Test
by: Tessa, Melissa, et al.
Published: (2026)

FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction
by: Sheng, Ze, et al.
Published: (2026)

KernJC: Automated Vulnerable Environment Generation for Linux Kernel Vulnerabilities
by: Ruan, Bonan, et al.
Published: (2024)

Scalable Test Generation to Trigger Rare Targets in High-Level Synthesizable IPs for Cloud FPGAs
by: Debnath, Mukta, et al.
Published: (2024)

Verbatim Data Transcription Failures in LLM Code Generation: A State-Tracking Stress Test
by: Haque, Mohd Ariful, et al.
Published: (2026)

Who Tests the Testers? Systematic Enumeration and Coverage Audit of LLM Agent Tool Call Safety
by: Chen, Xuan, et al.
Published: (2026)

"False negative -- that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testing
by: Ami, Amit Seal, et al.
Published: (2023)

QASecClaw: A Multi-Agent LLM Approach for False Positive Reduction in Static Application Security Testing
by: Ameen, Mohd Ruhul, et al.
Published: (2026)

When AI Takes the Wheel: Security Analysis of Framework-Constrained Program Generation
by: Liu, Yue, et al.
Published: (2025)

SCALE: Constructing Structured Natural Language Comment Trees for Software Vulnerability Detection
by: Wen, Xin-Cheng, et al.
Published: (2024)

{A New Hope}: Contextual Privacy Policies for Mobile Applications and An Approach Toward Automated Generation
by: Pan, Shidong, et al.
Published: (2024)