RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Nath, Utkarsh, Wang, Yancheng, Yang, Yingzhen
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Computer Vision and Pattern Recognition Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Learning Low-Rank Feature for Thorax Disease Classification
di: Goel, Rajeev, et al.
Pubblicazione: (2024)

Efficient Visual Transformer by Learnable Token Merging
di: Wang, Yancheng, et al.
Pubblicazione: (2024)

Compact Vision Transformer by Reduction of Kernel Complexity
di: Wang, Yancheng, et al.
Pubblicazione: (2025)

Learning Informative Attention Weights for Person Re-Identification
di: Wang, Yancheng, et al.
Pubblicazione: (2025)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
di: Li, Hui, et al.
Pubblicazione: (2025)

Improve Cross-Architecture Generalization on Dataset Distillation
di: Zhou, Binglin, et al.
Pubblicazione: (2024)

Latent Danger Zone: Distilling Unified Attention for Cross-Architecture Black-box Attacks
di: Li, Yang, et al.
Pubblicazione: (2025)

Towards Accurate and Robust Architectures via Neural Architecture Search
di: Ou, Yuwei, et al.
Pubblicazione: (2024)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
di: Huang, Yanglin, et al.
Pubblicazione: (2025)

Self-supervised Cross-silo Federated Neural Architecture Search
di: Liang, Xinle, et al.
Pubblicazione: (2021)

Improving Neural ODEs via Knowledge Distillation
di: Chu, Haoyu, et al.
Pubblicazione: (2022)

ECToNAS: Evolutionary Cross-Topology Neural Architecture Search
di: Schiessler, Elisabeth J., et al.
Pubblicazione: (2024)

Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates
di: Kokane, Shirley, et al.
Pubblicazione: (2024)

Multi-objective Differentiable Neural Architecture Search
di: Sukthanker, Rhea Sanjay, et al.
Pubblicazione: (2024)

Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities
di: Li, Guihong, et al.
Pubblicazione: (2023)

MoENAS: Mixture-of-Expert based Neural Architecture Search for jointly Accurate, Fair, and Robust Edge Deep Neural Networks
di: Mecharbat, Lotfi Abdelkrim, et al.
Pubblicazione: (2025)

Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
di: Wang, Hu, et al.
Pubblicazione: (2023)

Multi-conditioned Graph Diffusion for Neural Architecture Search
di: Asthana, Rohan, et al.
Pubblicazione: (2024)

DANCE: Resource-Efficient Neural Architecture Search with Data-Aware and Continuous Adaptation
di: Wang, Maolin, et al.
Pubblicazione: (2025)

FlatNAS: optimizing Flatness in Neural Architecture Search for Out-of-Distribution Robustness
di: Gambella, Matteo, et al.
Pubblicazione: (2024)

CoLLM-NAS: Collaborative Large Language Models for Efficient Knowledge-Guided Neural Architecture Search
di: Li, Zhe, et al.
Pubblicazione: (2025)

Knowledge Distillation Based on Transformed Teacher Matching
di: Zheng, Kaixiang, et al.
Pubblicazione: (2024)

TrashDet: Iterative Neural Architecture Search for Efficient Waste Detection
di: Tran, Tony, et al.
Pubblicazione: (2025)

Resource-Aware Heterogeneous Federated Learning using Neural Architecture Search
di: Yu, Sixing, et al.
Pubblicazione: (2022)

Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification
di: Guo, Chenqi, et al.
Pubblicazione: (2025)

Towards Robust Out-of-Distribution Generalization: Data Augmentation and Neural Architecture Search Approaches
di: Bai, Haoyue
Pubblicazione: (2024)

Forward-Backward Knowledge Distillation for Continual Clustering
di: Sadeghi, Mohammadreza, et al.
Pubblicazione: (2024)

ILASH: A Predictive Neural Architecture Search Framework for Multi-Task Applications
di: Rahman, Md Hafizur, et al.
Pubblicazione: (2024)

HEP-NAS: Towards Efficient Few-shot Neural Architecture Search via Hierarchical Edge Partitioning
di: Li, Jianfeng, et al.
Pubblicazione: (2024)

Test-Time Canonicalization by Foundation Models for Robust Perception
di: Singhal, Utkarsh, et al.
Pubblicazione: (2025)

Distilling the Knowledge in Data Pruning
di: Ben-Baruch, Emanuel, et al.
Pubblicazione: (2024)

einspace: Searching for Neural Architectures from Fundamental Operations
di: Ericsson, Linus, et al.
Pubblicazione: (2024)

Densely Distilling Cumulative Knowledge for Continual Learning
di: Shi, Zenglin, et al.
Pubblicazione: (2024)

Scaling Up Quantization-Aware Neural Architecture Search for Efficient Deep Learning on the Edge
di: Lu, Yao, et al.
Pubblicazione: (2024)

GRASP-GCN: Graph-Shape Prioritization for Neural Architecture Search under Distribution Shifts
di: Casarin, Sofia, et al.
Pubblicazione: (2024)

Understanding Adversarial Robustness from Feature Maps of Convolutional Layers
di: Xu, Cong, et al.
Pubblicazione: (2022)

Towards Adversarially Robust Dataset Distillation by Curvature Regularization
di: Xue, Eric, et al.
Pubblicazione: (2024)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
di: Zhang, Qifan, et al.
Pubblicazione: (2024)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
di: Xiang, Qianlong, et al.
Pubblicazione: (2024)

REDistill: Robust Estimator Distillation for Balancing Robustness and Efficiency
di: Tybl, Ondrej, et al.
Pubblicazione: (2026)