Cover Image

Auto-Prompt Generation is Not Robust: Prompt Optimization Driven by Pseudo Gradient

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shi, Zeru, Wang, Zhenting, Su, Yongye, Luo, Weidi, Gao, Hang, Yang, Fan, Tang, Ruixiang, Zhang, Yongfeng
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models
by: Shi, Zeru, et al.
Published: (2026)

Read the Scene, Not the Script: Outcome-Aware Safety for LLMs
by: Wu, Rui, et al.
Published: (2025)

EmojiPrompt: Generative Prompt Obfuscation for Privacy-Preserving Communication with Cloud-based LLMs
by: Lin, Sam, et al.
Published: (2024)

ADO: Automatic Data Optimization for Inputs in LLM Prompts
by: Lin, Sam, et al.
Published: (2025)

In-context Demonstration Matters: On Prompt Optimization for Pseudo-Supervision Refinement
by: Zhang, Zhen-Yu, et al.
Published: (2024)

Meaningless Tokens, Meaningful Gains: How Activation Shifts Enhance LLM Reasoning
by: Shi, Zeru, et al.
Published: (2025)

From Commands to Prompts: LLM-based Semantic File System for AIOS
by: Shi, Zeru, et al.
Published: (2024)

AutoPDL: Automatic Prompt Optimization for LLM Agents
by: Spiess, Claudio, et al.
Published: (2025)

Robust Detection of LLM-Generated Text: A Comparative Analysis
by: Su, Yongye, et al.
Published: (2024)

$p1$: Better Prompt Optimization with Fewer Prompts
by: Gao, Zhaolin, et al.
Published: (2026)

Can Gradient Descent Simulate Prompting?
by: Zhang, Eric, et al.
Published: (2025)

Self-Supervised Prompt Optimization
by: Xiang, Jinyu, et al.
Published: (2025)

Dialogue for Prompting: a Policy-Gradient-Based Discrete Prompt Generation for Few-shot Learning
by: Li, Chengzhengxu, et al.
Published: (2023)

Textual Gradients are a Flawed Metaphor for Automatic Prompt Optimization
by: Melcer, Daniel, et al.
Published: (2025)

LLM Prompt Duel Optimizer: Efficient Label-Free Prompt Optimization
by: Wu, Yuanchen, et al.
Published: (2025)

PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts
by: Zhu, Kaijie, et al.
Published: (2023)

AutoMedPrompt: A New Framework for Optimizing LLM Medical Prompts Using Textual Gradients
by: Wu, Sean, et al.
Published: (2025)

Adaptive Prompt Structure Factorization: A Framework for Self-Discovering and Optimizing Compositional Prompt Programs
by: Liu, Haoyue, et al.
Published: (2026)

Prompt Stability Matters: Evaluating and Optimizing Auto-Generated Prompt in General-Purpose Systems
by: Chen, Ke, et al.
Published: (2025)

Automatic Prompt Optimization with Prompt Distillation
by: Dyagin, Ernest A., et al.
Published: (2025)

AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems
by: Zhang, Boxuan, et al.
Published: (2026)

Disentangling Memory and Reasoning Ability in Large Language Models
by: Jin, Mingyu, et al.
Published: (2024)

StealthRank: LLM Ranking Manipulation via Stealthy Prompt Optimization
by: Tang, Yiming, et al.
Published: (2025)

Automatic Pseudo-Harmful Prompt Generation for Evaluating False Refusals in Large Language Models
by: An, Bang, et al.
Published: (2024)

AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
by: Gu, Haoran, et al.
Published: (2026)

Efficient Prompt Optimization Through the Lens of Best Arm Identification
by: Shi, Chengshuai, et al.
Published: (2024)

MoPE: Mixture of Prompt Experts for Parameter-Efficient and Scalable Multimodal Fusion
by: Jiang, Ruixiang, et al.
Published: (2024)

On Prompt-Driven Safeguarding for Large Language Models
by: Zheng, Chujie, et al.
Published: (2024)

APPL: A Prompt Programming Language for Harmonious Integration of Programs and Large Language Model Prompts
by: Dong, Honghua, et al.
Published: (2024)

PromptWizard: Task-Aware Prompt Optimization Framework
by: Agarwal, Eshaan, et al.
Published: (2024)

VPO: Aligning Text-to-Video Generation Models with Prompt Optimization
by: Cheng, Jiale, et al.
Published: (2025)

ADOPT: Adaptive Dependency-Guided Joint Prompt Optimization for Multi-Step LLM Pipelines
by: Zhao, Minjun, et al.
Published: (2025)

Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs
by: Gao, Xin, et al.
Published: (2025)

Local Prompt Optimization
by: Jain, Yash, et al.
Published: (2025)

PromptAL: Sample-Aware Dynamic Soft Prompts for Few-Shot Active Learning
by: Xiang, Hui, et al.
Published: (2025)

SIG: Speaker Identification in Literature via Prompt-Based Generation
by: Su, Zhenlin, et al.
Published: (2023)

Prompt Exploration with Prompt Regression
by: Feffer, Michael, et al.
Published: (2024)

SIPDO: Closed-Loop Prompt Optimization via Synthetic Data Feedback
by: Yu, Yaoning, et al.
Published: (2025)

When Reward Hacking Rebounds: Understanding and Mitigating It with Representation-Level Signals
by: Wu, Rui, et al.
Published: (2026)

Auto-Demo Prompting: Leveraging Generated Outputs as Demonstrations for Enhanced Batch Prompting
by: Feng, Longyu, et al.
Published: (2024)