Copertina

TinySSL: Distilled Self-Supervised Pretraining for Sub-Megabyte MCU Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Wilson, Bibin
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

TinyVLM: Zero-Shot Object Detection on Microcontrollers via Vision-Language Distillation with Matryoshka Embeddings
di: Wilson, Bibin
Pubblicazione: (2026)

TE-SSL: Time and Event-aware Self Supervised Learning for Alzheimer's Disease Progression Analysis
di: Thrasher, Jacob, et al.
Pubblicazione: (2024)

GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning
di: Feizi, Aarash, et al.
Pubblicazione: (2024)

FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pretraining
di: Mohamed, Shaheer, et al.
Pubblicazione: (2023)

U-Mamba2-SSL for Semi-Supervised Tooth and Pulp Segmentation in CBCT
di: Tan, Zhi Qin, et al.
Pubblicazione: (2025)

SAR Object Detection with Self-Supervised Pretraining and Curriculum-Aware Sampling
di: Almalioglu, Yasin, et al.
Pubblicazione: (2025)

SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval
di: Jawade, Bhavin, et al.
Pubblicazione: (2025)

Latent Replay Detection: Memory-Efficient Continual Object Detection on Microcontrollers via Task-Adaptive Compression
di: Wilson, Bibin
Pubblicazione: (2026)

SSL-NBV: A Self-Supervised-Learning-Based Next-Best-View algorithm for Efficient 3D Plant Reconstruction by a Robot
di: Ci, Jianchao, et al.
Pubblicazione: (2024)

On Pretraining Data Diversity for Self-Supervised Learning
di: Hammoud, Hasan Abed Al Kader, et al.
Pubblicazione: (2024)

Anatomy-Anchored Self-Supervision: Distilling Vision Foundation Models for Invariant Ultrasound Representation
di: Zhu, Chunzheng, et al.
Pubblicazione: (2026)

CoMAD: A Multiple-Teacher Self-Supervised Distillation Framework
di: Mandalika, Sriram, et al.
Pubblicazione: (2025)

TinyDrop: Tiny Model Guided Token Dropping for Vision Transformers
di: Wang, Guoxin, et al.
Pubblicazione: (2025)

Boosting Medical Vision-Language Pretraining via Momentum Self-Distillation under Limited Computing Resources
di: Pham, Phuc, et al.
Pubblicazione: (2025)

Data-Centric Approach to Constrained Machine Learning: A Case Study on Conway's Game of Life
di: Bibin, Anton, et al.
Pubblicazione: (2024)

SSL4RL: Revisiting Self-supervised Learning as Intrinsic Reward for Visual-Language Reasoning
di: Guo, Xiaojun, et al.
Pubblicazione: (2025)

Boost Self-Supervised Dataset Distillation via Parameterization, Predefined Augmentation, and Approximation
di: Yu, Sheng-Feng, et al.
Pubblicazione: (2025)

Dataset Distillation for Pre-Trained Self-Supervised Vision Models
di: Cazenavette, George, et al.
Pubblicazione: (2025)

Trust-SSL: Additive-Residual Selective Invariance for Robust Aerial Self-Supervised Learning
di: Boulila, Wadii, et al.
Pubblicazione: (2026)

MAE-Based Self-Supervised Pretraining for Data-Efficient Medical Image Segmentation Using nnFormer
di: Sureddi, R. M. Krishna, et al.
Pubblicazione: (2026)

Exploring Facial Expression Recognition through Semi-Supervised Pretraining and Temporal Modeling
di: Yu, Jun, et al.
Pubblicazione: (2024)

Depth-Guided Self-Supervised Human Keypoint Detection via Cross-Modal Distillation
di: Anand, Aman, et al.
Pubblicazione: (2024)

Self-Supervised Quantization-Aware Knowledge Distillation
di: Zhao, Kaiqi, et al.
Pubblicazione: (2024)

Mitigating Overfitting in Medical Imaging: Self-Supervised Pretraining vs. ImageNet Transfer Learning for Dermatological Diagnosis
di: Matas, Iván, et al.
Pubblicazione: (2025)

From Pretraining to Privacy: Federated Ultrasound Foundation Model with Self-Supervised Learning
di: Jiang, Yuncheng, et al.
Pubblicazione: (2024)

MCU: An Evaluation Framework for Open-Ended Game Agents
di: Zheng, Xinyue, et al.
Pubblicazione: (2023)

Morph-SSL: Self-Supervision with Longitudinal Morphing to Predict AMD Progression from OCT
di: Chakravarty, Arunava, et al.
Pubblicazione: (2023)

StreamTinyNet: video streaming analysis with spatial-temporal TinyML
di: Shalby, Hazem Hesham Yousef, et al.
Pubblicazione: (2024)

Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation
di: Zhou, Mingyuan, et al.
Pubblicazione: (2024)

VIVID-Med: LLM-Supervised Structured Pretraining for Deployable Medical ViTs
di: Wang, Xiyao, et al.
Pubblicazione: (2026)

TinyFormer: Preserving Tiny Objects in YOLO-DETR Hybrid Real-time Detectors
di: Hsieh, Jun-Wei, et al.
Pubblicazione: (2026)

SSL-Interactions: Pretext Tasks for Interactive Trajectory Prediction
di: Bhattacharyya, Prarthana, et al.
Pubblicazione: (2024)

Review helps learn better: Temporal Supervised Knowledge Distillation
di: Wang, Dongwei, et al.
Pubblicazione: (2023)

CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentation
di: Taghavi, Pardis, et al.
Pubblicazione: (2025)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
di: Kim, Taeheon, et al.
Pubblicazione: (2025)

Subimage Overlap Prediction: Task-Aligned Self-Supervised Pretraining For Semantic Segmentation In Remote Sensing Imagery
di: Sharma, Lakshay, et al.
Pubblicazione: (2026)

DA-SSL: self-supervised domain adaptor to leverage foundational models in turbt histopathology slides
di: Zhang, Haoyue, et al.
Pubblicazione: (2025)

TinySAM 2: Extreme Memory Compression for Efficient Track Anything Model
di: Ding, Zhaoyuan, et al.
Pubblicazione: (2026)

UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision
di: Han, Ruiyan, et al.
Pubblicazione: (2026)

Weakly Supervised Pretraining and Multi-Annotator Supervised Finetuning for Facial Wrinkle Detection
di: Moon, Ik Jun, et al.
Pubblicazione: (2024)