Cover Image

Large Pre-Training Datasets Don't Always Guarantee Robustness after Fine-Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hwang, Jaedong, Cheung, Brian, Hong, Zhang-Wei, Boopathy, Akhilan, Agrawal, Pulkit, Fiete, Ila
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Grid Cell-Inspired Fragmentation and Recall for Efficient Map Building
by: Hwang, Jaedong, et al.
Published: (2023)

Unified Neural Network Scaling Laws and Scale-time Equivalence
by: Boopathy, Akhilan, et al.
Published: (2024)

Towards Exact Computation of Inductive Bias
by: Boopathy, Akhilan, et al.
Published: (2024)

Breaking Neural Network Scaling Laws with Modularity
by: Boopathy, Akhilan, et al.
Published: (2024)

Permutation Invariant Learning with High-Dimensional Particle Filters
by: Boopathy, Akhilan, et al.
Published: (2024)

Resampling-free Particle Filters in High-dimensions
by: Boopathy, Akhilan, et al.
Published: (2024)

Training Neural Networks from Scratch with Parallel Low-Rank Adapters
by: Huh, Minyoung, et al.
Published: (2024)

Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images
by: Yu, Zhuoran, et al.
Published: (2023)

Do Diffusion Models Learn Semantically Meaningful and Efficient Representations?
by: Liang, Qiyao, et al.
Published: (2024)

Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning
by: Hwang, Jaedong, et al.
Published: (2025)

How Diffusion Models Learn to Factorize and Compose
by: Liang, Qiyao, et al.
Published: (2024)

Adapt, But Don't Forget: Fine-Tuning and Contrastive Routing for Lane Detection under Distribution Shift
by: Khan, Mohammed Abdul Hafeez, et al.
Published: (2025)

Vision Transformers Don't Need Trained Registers
by: Jiang, Nick, et al.
Published: (2025)

Fundamental performance bounds on time-series generation using reservoir computing
by: Qian, Daoyuan, et al.
Published: (2024)

Don't let the information slip away
by: Li, Taozhe, et al.
Published: (2026)

Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Frontier AI Models
by: Duan, Sunny, et al.
Published: (2024)

Scale, Don't Fine-tune: Guiding Multimodal LLMs for Efficient Visual Place Recognition at Test-Time
by: Cheng, Jintao, et al.
Published: (2025)

Reasoning Models Don't Always Say What They Think
by: Chen, Yanda, et al.
Published: (2025)

Don't Look at the Camera: Achieving Perceived Eye Contact
by: Gao, Alice, et al.
Published: (2024)

Don't Just Fine-tune the Agent, Tune the Environment
by: Lu, Siyuan, et al.
Published: (2025)

Pre-trained Model Guided Fine-Tuning for Zero-Shot Adversarial Robustness
by: Wang, Sibo, et al.
Published: (2024)

Surely Large Multimodal Models (Don't) Excel in Visual Species Recognition?
by: Liu, Tian, et al.
Published: (2025)

NeIn: Telling What You Don't Want
by: Bui, Nhat-Tan, et al.
Published: (2024)

"Don't forget to put the milk back!" Dataset for Enabling Embodied Agents to Detect Anomalous Situations
by: Mullen Jr, James F., et al.
Published: (2024)

Mix, Don't Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings
by: Jeha, Paul, et al.
Published: (2026)

Describe, Don't Dictate: Semantic Image Editing with Natural Language Intent
by: Ci, En, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark
by: Xin, Yi, et al.
Published: (2024)

Disentangling Fine-Tuning from Pre-Training in Visual Captioning with Hybrid Markov Logic
by: Shah, Monika, et al.
Published: (2025)

Attractor Geometry of Transformer Memory: From Conflict Arbitration to Confident Hallucination
by: Liang, Qiyao, et al.
Published: (2026)

Modular connectivity in neural networks emerges from Poisson noise-motivated regularisation, and promotes robustness and compositional generalisation
by: Qian, Daoyuan, et al.
Published: (2025)

Delay Embedding Theory of Neural Sequence Models
by: Ostrow, Mitchell, et al.
Published: (2024)

Don't Miss the Forest for the Trees: Attentional Vision Calibration for Large Vision Language Models
by: Woo, Sangmin, et al.
Published: (2024)

On the Robustness Tradeoff in Fine-Tuning
by: Li, Kunyang, et al.
Published: (2025)

Don't Fear Peculiar Activation Functions: EUAF and Beyond
by: Wang, Qianchao, et al.
Published: (2024)

Hip High-Tech Purchases Don't Always Work Out as Planned
by: Prisk, Dennis P., et al.
Published: (2005)

Show, Don't Tell: Morphing Latent Reasoning into Image Generation
by: Chen, Harold Haodong, et al.
Published: (2026)

Don't Pause! Every prediction matters in a streaming video
by: Chatterjee, Dibyadip, et al.
Published: (2026)

Don't Look into the Dark: Latent Codes for Pluralistic Image Inpainting
by: Chen, Haiwei, et al.
Published: (2024)

KaRMA: A Kinematic Metric for Fine Manipulation Ability in Robotic Hands
by: Peticco, Martin, et al.
Published: (2026)

TV100: A TV Series Dataset that Pre-Trained CLIP Has Not Seen
by: Zhou, Da-Wei, et al.
Published: (2024)