Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks
Fuente:
arXiv
Saved in:
| Main Authors: | Chen, Hao, Wang, Jindong, Shah, Ankit, Tao, Ran, Wei, Hongxin, Xie, Xing, Sugiyama, Masashi, Raj, Bhiksha |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations
by: Chen, Hao, et al.
Published: (2023)
by: Chen, Hao, et al.
Published: (2023)
Impact of Noisy Supervision in Foundation Model Learning
by: Chen, Hao, et al.
Published: (2024)
by: Chen, Hao, et al.
Published: (2024)
Slight Corruption in Pre-training Data Makes Better Diffusion Models
by: Chen, Hao, et al.
Published: (2024)
by: Chen, Hao, et al.
Published: (2024)
How Effective is Pre-training of Large Masked Autoencoders for Downstream Earth Observation Tasks?
by: Sosa, Jose, et al.
Published: (2024)
by: Sosa, Jose, et al.
Published: (2024)
Learning to Rank Pre-trained Vision-Language Models for Downstream Tasks
by: Ding, Yuhe, et al.
Published: (2024)
by: Ding, Yuhe, et al.
Published: (2024)
An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learning
by: Chen, Hao, et al.
Published: (2022)
by: Chen, Hao, et al.
Published: (2022)
Downstream Transfer Attack: Adversarial Attacks on Downstream Models with Pre-trained Vision Transformers
by: Zheng, Weijie, et al.
Published: (2024)
by: Zheng, Weijie, et al.
Published: (2024)
Multi-instance Learning as Downstream Task of Self-Supervised Learning-based Pre-trained Model
by: Matsuishi, Koki, et al.
Published: (2025)
by: Matsuishi, Koki, et al.
Published: (2025)
XQ-GAN: An Open-source Image Tokenization Framework for Autoregressive Generation
by: Li, Xiang, et al.
Published: (2024)
by: Li, Xiang, et al.
Published: (2024)
NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training
by: Tao, Yiyi, et al.
Published: (2024)
by: Tao, Yiyi, et al.
Published: (2024)
A Foundation Model for DAS Signal Recognition and Visual Prompt Tuning of the Pre-trained Model for Downstream Tasks
by: Gui, Kun, et al.
Published: (2025)
by: Gui, Kun, et al.
Published: (2025)
Understanding the Multi-modal Prompts of the Pre-trained Vision-Language Model
by: Ma, Shuailei, et al.
Published: (2023)
by: Ma, Shuailei, et al.
Published: (2023)
RobustFormer: Noise-Robust Pre-training for images and videos
by: Bastola, Ashish, et al.
Published: (2024)
by: Bastola, Ashish, et al.
Published: (2024)
Counterfactual Reasoning for Multi-Label Image Classification via Patching-Based Training
by: Xie, Ming-Kun, et al.
Published: (2024)
by: Xie, Ming-Kun, et al.
Published: (2024)
FALCON: Fairness Learning via Contrastive Attention Approach to Continual Semantic Scene Understanding
by: Truong, Thanh-Dat, et al.
Published: (2023)
by: Truong, Thanh-Dat, et al.
Published: (2023)
Weak-to-Strong Diffusion with Reflection
by: Bai, Lichen, et al.
Published: (2025)
by: Bai, Lichen, et al.
Published: (2025)
Advancing ALS Applications with Large-Scale Pre-training: Dataset Development and Downstream Assessment
by: Xiu, Haoyi, et al.
Published: (2025)
by: Xiu, Haoyi, et al.
Published: (2025)
VideoJudge: Bootstrapping Enables Scalable Supervision of MLLM-as-a-Judge for Video Understanding
by: Waheed, Abdul, et al.
Published: (2025)
by: Waheed, Abdul, et al.
Published: (2025)
Bridging Weakly-Supervised Learning and VLM Distillation: Noisy Partial Label Learning for Efficient Downstream Adaptation
by: Wang, Qian-Wei, et al.
Published: (2025)
by: Wang, Qian-Wei, et al.
Published: (2025)
BadLabel: A Robust Perspective on Evaluating and Enhancing Label-noise Learning
by: Zhang, Jingfeng, et al.
Published: (2023)
by: Zhang, Jingfeng, et al.
Published: (2023)
ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding
by: Xue, Le, et al.
Published: (2023)
by: Xue, Le, et al.
Published: (2023)
Rethinking UMM Visual Generation: Masked Modeling for Efficient Image-Only Pre-training
by: Sun, Peng, et al.
Published: (2026)
by: Sun, Peng, et al.
Published: (2026)
Instance-dependent Label Distribution Estimation for Learning with Label Noise
by: Liao, Zehui, et al.
Published: (2022)
by: Liao, Zehui, et al.
Published: (2022)
EAGLE: Efficient Adaptive Geometry-based Learning in Cross-view Understanding
by: Truong, Thanh-Dat, et al.
Published: (2024)
by: Truong, Thanh-Dat, et al.
Published: (2024)
L2B: Learning to Bootstrap Robust Models for Combating Label Noise
by: Zhou, Yuyin, et al.
Published: (2022)
by: Zhou, Yuyin, et al.
Published: (2022)
What Sketch Explainability Really Means for Downstream Tasks
by: Bandyopadhyay, Hmrishav, et al.
Published: (2024)
by: Bandyopadhyay, Hmrishav, et al.
Published: (2024)
Pre-trained Models Succeed in Medical Imaging with Representation Similarity Degradation
by: Zu, Wenqiang, et al.
Published: (2025)
by: Zu, Wenqiang, et al.
Published: (2025)
LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
by: Wu, Wei, et al.
Published: (2024)
by: Wu, Wei, et al.
Published: (2024)
FLAME: Frozen Large Language Models Enable Data-Efficient Language-Image Pre-training
by: Cao, Anjia, et al.
Published: (2024)
by: Cao, Anjia, et al.
Published: (2024)
Are Multimodal Large Language Models Good Annotators for Image Tagging?
by: Xie, Ming-Kun, et al.
Published: (2026)
by: Xie, Ming-Kun, et al.
Published: (2026)
A Category-theoretical Meta-analysis of Definitions of Disentanglement
by: Zhang, Yivan, et al.
Published: (2023)
by: Zhang, Yivan, et al.
Published: (2023)
Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)
by: Yang, Penghui, et al.
Published: (2023)
Dataset Distillation for Super-Resolution without Class Labels and Pre-trained Models
by: Cho, Sunwoo, et al.
Published: (2025)
by: Cho, Sunwoo, et al.
Published: (2025)
Task-wise Sampling Convolutions for Arbitrary-Oriented Object Detection in Aerial Images
by: Huang, Zhanchao, et al.
Published: (2022)
by: Huang, Zhanchao, et al.
Published: (2022)
PreMix: Label-Efficient Multiple Instance Learning via Non-Contrastive Pre-training and Feature Mixing
by: Wong, Bryan, et al.
Published: (2024)
by: Wong, Bryan, et al.
Published: (2024)
VILA: On Pre-training for Visual Language Models
by: Lin, Ji, et al.
Published: (2023)
by: Lin, Ji, et al.
Published: (2023)
Limitations of NERF with pre-trained Vision Features for Few-Shot 3D Reconstruction
by: Sanjyal, Ankit
Published: (2025)
by: Sanjyal, Ankit
Published: (2025)
Scalable and Generalizable Correspondence Pruning via Geometry-Consistent Pre-training
by: Liao, Tangfei, et al.
Published: (2024)
by: Liao, Tangfei, et al.
Published: (2024)
Mitigating Instance-Dependent Label Noise: Integrating Self-Supervised Pretraining with Pseudo-Label Refinement
by: Bala, Gouranga, et al.
Published: (2024)
by: Bala, Gouranga, et al.
Published: (2024)
ImageFolder: Autoregressive Image Generation with Folded Tokens
by: Li, Xiang, et al.
Published: (2024)
by: Li, Xiang, et al.
Published: (2024)
Similar Items
-
Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations
by: Chen, Hao, et al.
Published: (2023) -
Impact of Noisy Supervision in Foundation Model Learning
by: Chen, Hao, et al.
Published: (2024) -
Slight Corruption in Pre-training Data Makes Better Diffusion Models
by: Chen, Hao, et al.
Published: (2024) -
How Effective is Pre-training of Large Masked Autoencoders for Downstream Earth Observation Tasks?
by: Sosa, Jose, et al.
Published: (2024) -
Learning to Rank Pre-trained Vision-Language Models for Downstream Tasks
by: Ding, Yuhe, et al.
Published: (2024)