Inoculation Prompting: Instructing LLMs to misbehave at train-time improves test-time alignment
Fuente:
arXiv
Saved in:
| Main Authors: | Wichers, Nevan, Ebtekar, Aram, Azarbal, Ariana, Gillioz, Victor, Ye, Christine, Ryd, Emil, Rathi, Neil, Sleight, Henry, Mallen, Alex, Roger, Fabien, Marks, Samuel |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Recontextualization Mitigates Specification Gaming without Modifying the Specification
by: Azarbal, Ariana, et al.
Published: (2025)
by: Azarbal, Ariana, et al.
Published: (2025)
Model Spec Midtraining: Improving How Alignment Training Generalizes
by: Li, Chloe, et al.
Published: (2026)
by: Li, Chloe, et al.
Published: (2026)
Gradient-Based Language Model Red Teaming
by: Wichers, Nevan, et al.
Published: (2024)
by: Wichers, Nevan, et al.
Published: (2024)
Foundations of algorithmic thermodynamics
by: Ebtekar, Aram, et al.
Published: (2023)
by: Ebtekar, Aram, et al.
Published: (2023)
Golden Handcuffs make safer AI agents
by: Ebtekar, Aram, et al.
Published: (2026)
by: Ebtekar, Aram, et al.
Published: (2026)
Visualizing Neural Network Imagination
by: Wichers, Nevan, et al.
Published: (2024)
by: Wichers, Nevan, et al.
Published: (2024)
Toward Universal Laws of Outlier Propagation
by: Ebtekar, Aram, et al.
Published: (2025)
by: Ebtekar, Aram, et al.
Published: (2025)
Fine Flood Forecasts: Incorporating local data into global models through fine-tuning
by: Ryd, Emil, et al.
Published: (2025)
by: Ryd, Emil, et al.
Published: (2025)
Inoculation Prompting: Eliciting traits from LLMs during training can suppress them at test-time
by: Tan, Daniel, et al.
Published: (2025)
by: Tan, Daniel, et al.
Published: (2025)
The momentum-space conformal bootstrap in 2d
by: Gillioz, Marc
Published: (2025)
by: Gillioz, Marc
Published: (2025)
Dynamic Relation Inference via Verb Embeddings
by: Suissa, Omri, et al.
Published: (2025)
by: Suissa, Omri, et al.
Published: (2025)
Eliciting Secret Knowledge from Language Models
by: Cywiński, Bartosz, et al.
Published: (2025)
by: Cywiński, Bartosz, et al.
Published: (2025)
Beyond Sparse Rewards: Enhancing Reinforcement Learning with Language Model Critique in Text Generation
by: Cao, Meng, et al.
Published: (2024)
by: Cao, Meng, et al.
Published: (2024)
Fusion-Eval: Integrating Assistant Evaluators with LLMs
by: Shu, Lei, et al.
Published: (2023)
by: Shu, Lei, et al.
Published: (2023)
Towards eliciting latent knowledge from LLMs with mechanistic interpretability
by: Cywiński, Bartosz, et al.
Published: (2025)
by: Cywiński, Bartosz, et al.
Published: (2025)
All Code, No Thought: Current Language Models Struggle to Reason in Ciphered Language
by: Guo, Shiyuan, et al.
Published: (2025)
by: Guo, Shiyuan, et al.
Published: (2025)
Analysis of Parallel Boarding Methods in a Multi-Aisle Flying Wing Aircraft
by: Ryd, Emil, et al.
Published: (2024)
by: Ryd, Emil, et al.
Published: (2024)
Intensive language contact in the Caucasus
by: Wichers Schreur, Jesse
Published: (2026)
by: Wichers Schreur, Jesse
Published: (2026)
Problems of Associations Accrediting Preparation Programs for School Media Professionals.
by: Wichers, Jean Elaine
Published: (1982)
by: Wichers, Jean Elaine
Published: (1982)
Heart of the Humanities Program
by: Wichers, Jean Elaine
Published: (1976)
by: Wichers, Jean Elaine
Published: (1976)
Removing Sandbagging in LLMs by Training with Weak Supervision
by: Ryd, Emil, et al.
Published: (2026)
by: Ryd, Emil, et al.
Published: (2026)
El ascenso de la economía del comportamiento: misbehaving, de Richard Thaler*
by: Cass R. Sunsteitf
Published: (2019)
by: Cass R. Sunsteitf
Published: (2019)
Shaping capabilities with token-level data filtering
by: Rathi, Neil, et al.
Published: (2026)
by: Rathi, Neil, et al.
Published: (2026)
A large synthetic dataset for machine learning applications in power transmission grids
by: Gillioz, Marc, et al.
Published: (2024)
by: Gillioz, Marc, et al.
Published: (2024)
IPAdapter-Instruct: Resolving Ambiguity in Image-based Conditioning using Instruct Prompts
by: Rowles, Ciara, et al.
Published: (2024)
by: Rowles, Ciara, et al.
Published: (2024)
Los bosques en 50 años : de los planes de ordenación a la silvicultura electrónica (Primera parte)
by: Mallén, Carlos
Published: (2002)
by: Mallén, Carlos
Published: (2002)
Los bosques en 50 años : de la recolecta al cultivo, plantaciones comerciales y no comerciales (segunda parte)
by: Mallén, Carlos
Published: (2002)
by: Mallén, Carlos
Published: (2002)
Real time anomalies detection on video
by: Poirier, Fabien
Published: (2024)
by: Poirier, Fabien
Published: (2024)
PROTECT: Protein circadian time prediction using unsupervised learning
by: Ogholbake, Aram Ansary, et al.
Published: (2025)
by: Ogholbake, Aram Ansary, et al.
Published: (2025)
VIP: Vision Instructed Pre-training for Robotic Manipulation
by: Li, Zhuoling, et al.
Published: (2024)
by: Li, Zhuoling, et al.
Published: (2024)
Prompt-aligned Gradient for Prompt Tuning
by: Zhu, Beier, et al.
Published: (2022)
by: Zhu, Beier, et al.
Published: (2022)
México en la evaluación de los bosques del mundo
by: Mallén Rivera, Carlos
Published: (2003)
by: Mallén Rivera, Carlos
Published: (2003)
Desarrollo histórico del pensamiento político / Rubén Salazar Mallén
by: Salazar Mallén, Rubén
by: Salazar Mallén, Rubén
Conservar la biodiversidad, ¿mito o realidad? / Isabel Ruiz Mallén
by: Ruiz Mallén, Isabel
by: Ruiz Mallén, Isabel
Año 2002 montañas, cumbres, leyes y religión
by: Mallén Rivera, Carlos
Published: (2003)
by: Mallén Rivera, Carlos
Published: (2003)
El Hegel de Hegel y el Hegel de Marx / Rubén Salazar Mallén
by: Salazar Mallén, Rubén
by: Salazar Mallén, Rubén
La polémica chinosoviética y la revolución proletaria / Rubén Salazar Mallén
by: Salazar Mallén, Rubén
Published: (1965)
by: Salazar Mallén, Rubén
Published: (1965)
La orientación inegable de la biotecnología : de las estacas a los organismos genéticamente transformados
by: Mallén Rivera, Carlos
Published: (2002)
by: Mallén Rivera, Carlos
Published: (2002)
La orientación inegable de la biotecnología (De las estacas a los organismos genéticamente transformados (2a. parte)
by: Mallén Rivera, Carlos
Published: (2002)
by: Mallén Rivera, Carlos
Published: (2002)
Virus computacionales : Un enfoque objetivo / Guillermo M. Mallen
by: Mallen, Guillermo M
by: Mallen, Guillermo M
Similar Items
-
Recontextualization Mitigates Specification Gaming without Modifying the Specification
by: Azarbal, Ariana, et al.
Published: (2025) -
Model Spec Midtraining: Improving How Alignment Training Generalizes
by: Li, Chloe, et al.
Published: (2026) -
Gradient-Based Language Model Red Teaming
by: Wichers, Nevan, et al.
Published: (2024) -
Foundations of algorithmic thermodynamics
by: Ebtekar, Aram, et al.
Published: (2023) -
Golden Handcuffs make safer AI agents
by: Ebtekar, Aram, et al.
Published: (2026)