Cover Image

Pre-training with Random Orthogonal Projection Image Modeling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Haghighat, Maryam, Moghadam, Peyman, Mohamed, Shaheer, Koniusz, Piotr
Format:	Preprint
Published:	2023
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pretraining
by: Mohamed, Shaheer, et al.
Published: (2023)

Feature Hallucination for Self-supervised Action Recognition
by: Wang, Lei, et al.
Published: (2025)

Video Understanding by Design: How Datasets Shape Architectures and Insights
by: Wang, Lei, et al.
Published: (2025)

Pair-VPR: Place-Aware Pre-training and Contrastive Pair Classification for Visual Place Recognition with Vision Transformers
by: Hausler, Stephen, et al.
Published: (2024)

Adaptive Multi-head Contrastive Learning
by: Wang, Lei, et al.
Published: (2023)

Subspace Kernel Learning on Tensor Sequences
by: Wang, Lei, et al.
Published: (2026)

Motion meets Attention: Video Motion Prompts
by: Chen, Qixiang, et al.
Published: (2024)

Graph Your Own Prompt
by: Ding, Xi, et al.
Published: (2025)

Learning Time in Static Classifiers
by: Ding, Xi, et al.
Published: (2025)

Hierarchically Robust Zero-shot Vision-language Models
by: Dong, Junhao, et al.
Published: (2026)

Uncertainty-DTW for Sequences and Visual Tokens
by: Wang, Lei, et al.
Published: (2026)

Possibilistic Predictive Uncertainty for Deep Learning
by: Ni, Yao, et al.
Published: (2026)

Meet JEANIE: a Similarity Measure for 3D Skeleton Sequences via Temporal-Viewpoint Alignment
by: Wang, Lei, et al.
Published: (2024)

Learnable Expansion of Graph Operators for Multi-Modal Feature Fusion
by: Ding, Dexuan, et al.
Published: (2024)

ICED: Concept-level Machine Unlearning via Interpretable Concept Decomposition
by: Lin, Shen, et al.
Published: (2026)

M2Distill: Multi-Modal Distillation for Lifelong Imitation Learning
by: Roy, Kaushik, et al.
Published: (2024)

Noise Consistency Regularization for Improved Subject-Driven Image Synthesis
by: Ni, Yao, et al.
Published: (2025)

Unlocking Pre-trained Image Backbones for Semantic Image Synthesis
by: Berrada, Tariq, et al.
Published: (2023)

Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
by: Lai, Zhengfeng, et al.
Published: (2024)

Multi-modal Vision Pre-training for Medical Image Analysis
by: Rui, Shaohao, et al.
Published: (2024)

Benchmarking the Influence of Pre-training on Explanation Performance in MR Image Classification
by: Oliveira, Marta, et al.
Published: (2023)

Dataset Ownership Verification in Contrastive Pre-trained Models
by: Xie, Yuechen, et al.
Published: (2025)

Practical Continual Forgetting for Pre-trained Vision Models
by: Zhao, Hongbo, et al.
Published: (2025)

Domain-Specific Pre-training Improves Confidence in Whole Slide Image Classification
by: Chitnis, Soham Rohit, et al.
Published: (2023)

PARIC: Probabilistic Attention Regularization for Language Guided Image Classification from Pre-trained Vison Language Models
by: Nautiyal, Mayank, et al.
Published: (2025)

Multi-View and Multi-Scale Alignment for Contrastive Language-Image Pre-training in Mammography
by: Du, Yuexi, et al.
Published: (2024)

Privacy-Aware Video Anomaly Detection through Orthogonal Subspace Projection
by: Wang, Lei, et al.
Published: (2026)

Gradient-based Fine-Tuning through Pre-trained Model Regularization
by: Liu, Xuanbo, et al.
Published: (2025)

Slight Corruption in Pre-training Data Makes Better Diffusion Models
by: Chen, Hao, et al.
Published: (2024)

Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation
by: Zhang, Yuhui, et al.
Published: (2023)

CHAIN: Enhancing Generalization in Data-Efficient GANs via lipsCHitz continuity constrAIned Normalization
by: Ni, Yao, et al.
Published: (2024)

Self-supervised Pre-training of Text Recognizers
by: Kišš, Martin, et al.
Published: (2024)

Effective Backdoor Mitigation in Vision-Language Models Depends on the Pre-training Objective
by: Verma, Sahil, et al.
Published: (2023)

Region-Aware Reconstruction Strategy for Pre-training fMRI Foundation Model
by: Doodipala, Ruthwik Reddy, et al.
Published: (2025)

Closed-Form Linear-Probe Dataset Distillation for Pre-trained Vision Models
by: Peng, Bincheng, et al.
Published: (2026)

Fooling Contrastive Language-Image Pre-trained Models with CLIPMasterPrints
by: Freiberger, Matthias, et al.
Published: (2023)

ModelGrow: Continual Text-to-Video Pre-training with Model Expansion and Language Understanding Enhancement
by: Rao, Zhefan, et al.
Published: (2024)

SwordBench: Evaluating Orthogonality of Steering Image Representations
by: Zaigrajew, Vladimir, et al.
Published: (2026)

Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models
by: Tang, Yiwen, et al.
Published: (2023)

Domain Guidance: A Simple Transfer Approach for a Pre-trained Diffusion Model
by: Zhong, Jincheng, et al.
Published: (2025)