Heterogeneous Learning Rate Scheduling for Neural Architecture Search on Long-Tailed Datasets

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Tang, Chenxia
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Kernel-Level Energy-Efficient Neural Architecture Search for Tabular Dataset
by: La, Hoang-Loc, et al.
Published: (2025)

Multi-Objective Neural Architecture Search by Learning Search Space Partitions
by: Zhao, Yiyang, et al.
Published: (2024)

Space Alignment Matters: The Missing Piece for Inducing Neural Collapse in Long-Tailed Learning
by: Wang, Jinping, et al.
Published: (2025)

A Survey on Neural Architecture Search Based on Reinforcement Learning
by: Shao, Wenzhu
Published: (2024)

Younger: The First Dataset for Artificial Intelligence-Generated Neural Network Architecture
by: Yang, Zhengxin, et al.
Published: (2024)

ScheduleFree+: Scaling Learning-Rate-Free & Schedule-Free Learning to Large Language Models
by: Defazio, Aaron
Published: (2026)

Cyclical Log Annealing as a Learning Rate Scheduler
by: Naveen, Philip
Published: (2024)

Graph Neural Architecture Search with GPT-4
by: Wang, Haishuai, et al.
Published: (2023)

Optimal Linear Decay Learning Rate Schedules and Further Refinements
by: Defazio, Aaron, et al.
Published: (2023)

Transferrable Surrogates in Expressive Neural Architecture Search Spaces
by: Qin, Shiwen, et al.
Published: (2025)

Decision Transformer for Enhancing Neural Local Search on the Job Shop Scheduling Problem
by: de Puiseau, Constantin Waubert, et al.
Published: (2024)

TailedTS: Benchmark Dataset for Heavy-Tailed Time Series Prediction and Periodicity Quantification
by: Chen, Xinyu, et al.
Published: (2026)

ExpTest: Automating Learning Rate Searching and Tuning with Insights from Linearized Neural Networks
by: Chaudhry, Zan, et al.
Published: (2024)

Unsupervised Contrastive Learning Using Out-Of-Distribution Data for Long-Tailed Dataset
by: Hoang, Cuong Manh, et al.
Published: (2025)

SeqNAS: Neural Architecture Search for Event Sequence Classification
by: Udovichenko, Igor, et al.
Published: (2024)

MicroNAS: Zero-Shot Neural Architecture Search for MCUs
by: Qiao, Ye, et al.
Published: (2024)

Reinforced Compressive Neural Architecture Search for Versatile Adversarial Robustness
by: Wang, Dingrong, et al.
Published: (2024)

Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision
by: Zhang, Zeyang, et al.
Published: (2024)

Weight-Entanglement Meets Gradient-Based Neural Architecture Search
by: Sukthanker, Rhea Sanjay, et al.
Published: (2023)

Neural Architecture Search: Two Constant Shared Weights Initialisations
by: Gracheva, Ekaterina
Published: (2023)

Decoupled Federated Learning on Long-Tailed and Non-IID data with Feature Statistics
by: Chen, Zhuoxin, et al.
Published: (2024)

Momentum Boosted Episodic Memory for Improving Learning in Long-Tailed RL Environments
by: Fernandes, Dolton, et al.
Published: (2025)

Insights from the Use of Previously Unseen Neural Architecture Search Datasets
by: Geada, Rob, et al.
Published: (2024)

One LR Doesn't Fit All: Heavy-Tail Guided Layerwise Learning Rates for LLMs
by: He, Di, et al.
Published: (2026)

Prediction of Bank Credit Ratings using Heterogeneous Topological Graph Neural Networks
by: Liu, Junyi, et al.
Published: (2025)

Graph-RHO: Critical-path-aware Heterogeneous Graph Network for Long-Horizon Flexible Job-Shop Scheduling
by: Li, Yujie, et al.
Published: (2026)

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler
by: Dremov, Aleksandr, et al.
Published: (2025)

Transfer Learning for Bayesian Optimization on Heterogeneous Search Spaces
by: Fan, Zhou, et al.
Published: (2023)

Causal-aware Graph Neural Architecture Search under Distribution Shifts
by: Li, Peiwen, et al.
Published: (2024)

NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models
by: Xu, Yang, et al.
Published: (2024)

Structured Progressive Knowledge Activation for LLM-Driven Neural Architecture Search
by: Liu, Zhen, et al.
Published: (2026)

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler
by: Shen, Yikang, et al.
Published: (2024)

BubbleSpec: Turning Long-Tail Bubbles into Speculative Rollout Drafts for Synchronous Reinforcement Learning
by: Xu, Yuhang, et al.
Published: (2026)

A Transformer-based Neural Architecture Search Method
by: Wang, Shang, et al.
Published: (2025)

Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction
by: Thuremella, Divya, et al.
Published: (2025)

ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving
by: Nie, Tong, et al.
Published: (2026)

TG-NAS: Generalizable Zero-Cost Proxies with Operator Description Embedding and Graph Learning for Efficient Neural Architecture Search
by: Qiao, Ye, et al.
Published: (2024)

Learning Heterogeneous Performance-Fairness Trade-offs in Federated Learning
by: Ye, Rongguang, et al.
Published: (2025)

In Search for Architectures and Loss Functions in Multi-Objective Reinforcement Learning
by: Terekhov, Mikhail, et al.
Published: (2024)

REMIND: Rethinking Medical High-Modality Learning under Missingness--A Long-Tailed Distribution Perspective
by: Wu, Chenwei, et al.
Published: (2026)