Image de couverture de livre

Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Fu, Yonggan, Zhang, Yongan, Zhang, Yang, Cox, David, Lin, Yingyan Celine
Format:	Preprint
Publié:	2021
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Auto-Agent-Distiller: Towards Efficient Deep Reinforcement Learning Agents via Neural Architecture Search
par: Fu, Yonggan, et autres
Publié: (2020)

A3C-S: Automated Agent Accelerator Co-Search towards Efficient Deep Reinforcement Learning
par: Fu, Yonggan, et autres
Publié: (2021)

DNA: Differentiable Network-Accelerator Co-Search
par: Zhang, Yongan, et autres
Publié: (2020)

MG-Verilog: Multi-grained Dataset Towards Enhanced LLM-assisted Verilog Generation
par: Zhang, Yongan, et autres
Publié: (2024)

ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks
par: You, Haoran, et autres
Publié: (2022)

AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks
par: Fu, Yonggan, et autres
Publié: (2020)

Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks
par: Fu, Yonggan, et autres
Publié: (2021)

HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmark
par: Li, Chaojian, et autres
Publié: (2021)

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design
par: You, Haoran, et autres
Publié: (2021)

GPT4AIGChip: Towards Next-Generation AI Accelerator Design Automation via Large Language Models
par: Fu, Yonggan, et autres
Publié: (2023)

InstantNet: Automated Generation and Deployment of Instantaneously Switchable-Precision Networks
par: Fu, Yonggan, et autres
Publié: (2021)

2-in-1 Accelerator: Enabling Random Precision Switch for Winning Both Adversarial Robustness and Efficiency
par: Fu, Yonggan, et autres
Publié: (2021)

AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment
par: Fu, Yonggan, et autres
Publié: (2024)

CPT: Efficient Deep Neural Network Training via Cyclic Precision
par: Fu, Yonggan, et autres
Publié: (2021)

Early-Bird GCNs: Graph-Network Co-Optimization Towards More Efficient GCN Training and Inference via Drawing Early-Bird Lottery Tickets
par: You, Haoran, et autres
Publié: (2021)

Robust Tickets Can Transfer Better: Drawing More Transferable Subnetworks in Transfer Learning
par: Fu, Yonggan, et autres
Publié: (2023)

DANCE: DAta-Network Co-optimization for Efficient Segmentation Model Training and Inference
par: Li, Chaojian, et autres
Publié: (2021)

Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Speech Processing
par: Fu, Yonggan, et autres
Publié: (2022)

Drawing Early-Bird Tickets: Towards More Efficient Training of Deep Networks
par: You, Haoran, et autres
Publié: (2019)

Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration
par: Yu, Zhongzhi, et autres
Publié: (2024)

ShiftAddNet: A Hardware-Inspired Deep Network
par: You, Haoran, et autres
Publié: (2020)

ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design
par: You, Haoran, et autres
Publié: (2022)

DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks
par: Fu, Yonggan, et autres
Publié: (2022)

When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
par: You, Haoran, et autres
Publié: (2024)

SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
par: You, Haoran, et autres
Publié: (2022)

Bitwidth-Specific Logarithmic Arithmetic for Future Hardware-Accelerated Training
par: Hamad, Hassan, et autres
Publié: (2025)

ERSAM: Neural Architecture Search For Energy-Efficient and Real-Time Social Ambiance Measurement
par: Li, Chaojian, et autres
Publié: (2023)

MixGCN: Scalable GCN Training by Mixture of Parallelism and Mixture of Accelerators
par: Wan, Cheng, et autres
Publié: (2025)

ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
par: You, Haoran, et autres
Publié: (2023)

$R^2$-dLLM: Accelerating Diffusion Large Language Models via Spatio-Temporal Redundancy Reduction
par: Du, Zhenbang, et autres
Publié: (2026)

ScaleBITS: Scalable Bitwidth Search for Hardware-Aligned Mixed-Precision LLMs
par: Li, Xinlin, et autres
Publié: (2026)

Auto-CARD: Efficient and Robust Codec Avatar Driving for Real-time Mobile Telepresence
par: Fu, Yonggan, et autres
Publié: (2023)

Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speed
par: Fu, Yonggan, et autres
Publié: (2025)

QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models
par: Liu, Jing, et autres
Publié: (2023)

The Value of Graph-based Encoding in NBA Salary Prediction
par: Su, Junhao, et autres
Publié: (2026)

ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
par: You, Haoran, et autres
Publié: (2024)

BlockBatch: Multi-Scale Consensus Decoding for Efficient Diffusion Language Model Inference
par: Wu, Xiaoyou, et autres
Publié: (2026)

MGS: Markov Greedy Sums for Accurate Low-Bitwidth Floating-Point Accumulation
par: Natesh, Vikas, et autres
Publié: (2025)

LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models
par: Shi, Dachuan, et autres
Publié: (2025)

PQS (Prune, Quantize, and Sort): Low-Bitwidth Accumulation of Dot Products in Neural Network Computations
par: Natesh, Vikas, et autres
Publié: (2025)