Copertina

Shifting the Gradient: Understanding How Defensive Training Methods Protect Language Model Integrity

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Grant, Satchel, Gillioz, Victor, Ward, Jake, McGrath, Thomas
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Model Alignment Search
di: Grant, Satchel
Pubblicazione: (2025)

Emergent Symbol-like Number Variables in Artificial Neural Networks
di: Grant, Satchel, et al.
Pubblicazione: (2025)

Addressing divergent representations from causal interventions on neural networks
di: Grant, Satchel, et al.
Pubblicazione: (2025)

In-Training Defenses against Emergent Misalignment in Language Models
di: Kaczér, David, et al.
Pubblicazione: (2025)

Training Deliberative Monitors for Black-Box Scheming Detection
di: Sinha, Aditya, et al.
Pubblicazione: (2026)

From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks
di: Russin, Jacob, et al.
Pubblicazione: (2024)

Rank-1 LoRAs Encode Interpretable Reasoning Signals
di: Ward, Jake, et al.
Pubblicazione: (2025)

What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shift
di: Chang, Jiamin, et al.
Pubblicazione: (2025)

Uncovering Gradient Inversion Risks in Practical Language Model Training
di: Feng, Xinguo, et al.
Pubblicazione: (2025)

Learning-based estimation of cattle weight gain and its influencing factors
di: Hossain, Muhammad Riaz Hasib, et al.
Pubblicazione: (2025)

Mob-based cattle weight gain forecasting using ML models
di: Hossain, Muhammad Riaz Hasib, et al.
Pubblicazione: (2025)

Training Large Language Models to Reason via EM Policy Gradient
di: Xu, Tianbing
Pubblicazione: (2025)

Through the River: Understanding the Benefit of Schedule-Free Methods for Language Model Training
di: Song, Minhak, et al.
Pubblicazione: (2025)

Understanding Gradient Boosting Classifier: Training, Prediction, and the Role of $γ_j$
di: Chen, Hung-Hsuan
Pubblicazione: (2024)

Understanding Post-Training Structural Changes in Large Language Models
di: He, Xinyu, et al.
Pubblicazione: (2025)

A Voter-Based Stochastic Rejection-Method Framework for Asymptotically Safe Language Model Outputs
di: Watts, Jake R., et al.
Pubblicazione: (2024)

How to Protect Models against Adversarial Unlearning?
di: Jasiorski, Patryk, et al.
Pubblicazione: (2025)

Recontextualization Mitigates Specification Gaming without Modifying the Specification
di: Azarbal, Ariana, et al.
Pubblicazione: (2025)

Backward-Friendly Optimization: Training Large Language Models with Approximate Gradients under Memory Constraints
di: Yang, Jing, et al.
Pubblicazione: (2025)

Adversarial Training for Defense Against Label Poisoning Attacks
di: Bal, Melis Ilayda, et al.
Pubblicazione: (2025)

Low-Precision Training of Large Language Models: Methods, Challenges, and Opportunities
di: Hao, Zhiwei, et al.
Pubblicazione: (2025)

Optimal Defenses Against Gradient Reconstruction Attacks
di: Chen, Yuxiao, et al.
Pubblicazione: (2024)

Understanding Asynchronous Inference Methods for Vision-Language-Action Models
di: Agouzoul, Ayoub
Pubblicazione: (2026)

Understanding and Accelerating the Training of Masked Diffusion Language Models
di: Hong, Chunsan, et al.
Pubblicazione: (2026)

Stories in Space: In-Context Learning Trajectories in Conceptual Belief Space
di: Bigelow, Eric, et al.
Pubblicazione: (2026)

Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training
di: Ma, Yuhan, et al.
Pubblicazione: (2024)

Post-Training with Policy Gradients: Optimality and the Base Model Barrier
di: Mousavi-Hosseini, Alireza, et al.
Pubblicazione: (2026)

DeepDefense: Layer-Wise Gradient-Feature Alignment for Building Robust Neural Networks
di: Lin, Ci, et al.
Pubblicazione: (2025)

Entropy-Gated Selective Policy Optimization:Token-Level Gradient Allocation for Hybrid Training of Large Language Models
di: Hu, Yuelin, et al.
Pubblicazione: (2026)

Policy-Gradient Training of Language Models for Ranking
di: Gao, Ge, et al.
Pubblicazione: (2023)

Zero-Sacrifice Persistent-Robustness Adversarial Defense for Pre-Trained Encoders
di: Lei, Zhuxin, et al.
Pubblicazione: (2026)

How Do Large Language Models Understand Graph Patterns? A Benchmark for Graph Pattern Comprehension
di: Dai, Xinnan, et al.
Pubblicazione: (2024)

Protecting Copyright of Medical Pre-trained Language Models: Training-Free Backdoor Model Watermarking
di: Kong, Cong, et al.
Pubblicazione: (2024)

From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning
di: Wu, Xuansheng, et al.
Pubblicazione: (2023)

Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models
di: Abbes, Istabrak, et al.
Pubblicazione: (2025)

Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models
di: Das, Rocktim Jyoti, et al.
Pubblicazione: (2023)

Towards Understanding Link Predictor Generalizability Under Distribution Shifts
di: Revolinsky, Jay, et al.
Pubblicazione: (2024)

Black-box Gradient Attack on Graph Neural Networks: Deeper Insights in Graph-based Attack and Defense
di: Zhan, Haoxi, et al.
Pubblicazione: (2021)

Combining Stochastic Defenses to Resist Gradient Inversion: An Ablation Study
di: Scheliga, Daniel, et al.
Pubblicazione: (2022)

Towards Understanding Subliminal Learning: When and How Hidden Biases Transfer
di: Schrodi, Simon, et al.
Pubblicazione: (2025)