Copertina

Big2Small: A Unifying Neural Network Framework for Model Compression

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liao, Jing-Xiao, Wang, Haoran, Li, Tao, Lyu, Daoming, Zhang, Yi, Cai, Chengjun, Fan, Feng-Lei
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction
di: Ye, Zesheng, et al.
Pubblicazione: (2025)

Efficient Model Compression for Bayesian Neural Networks
di: Saha, Diptarka, et al.
Pubblicazione: (2024)

On Model Compression for Neural Networks: Framework, Algorithm, and Convergence Guarantee
di: Li, Chenyang, et al.
Pubblicazione: (2023)

Low-Rank Prehab: Preparing Neural Networks for SVD Compression
di: Qin, Haoran, et al.
Pubblicazione: (2025)

Towards Causal Classification: A Comprehensive Study on Graph Neural Networks
di: Job, Simi, et al.
Pubblicazione: (2024)

Inference-friendly Graph Compression for Graph Neural Networks
di: Fan, Yangxin, et al.
Pubblicazione: (2025)

On Expressivity of Height in Neural Networks
di: Fan, Feng-Lei, et al.
Pubblicazione: (2023)

Depth-induced NTK: Bridging Over-parameterized Neural Networks and Deep Neural Kernels
di: Tian, Yong-Ming, et al.
Pubblicazione: (2025)

"Lossless" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach
di: Gu, Lingyu, et al.
Pubblicazione: (2024)

Unified Stochastic Framework for Neural Network Quantization and Pruning
di: Zhang, Haoyu, et al.
Pubblicazione: (2024)

Unified Framework for Pre-trained Neural Network Compression via Decomposition and Optimized Rank Selection
di: Aghababaei-Harandi, Ali, et al.
Pubblicazione: (2024)

A Unified Kernel for Neural Network Learning
di: Zhang, Shao-Qun, et al.
Pubblicazione: (2024)

A Unified Gradient-based Framework for Task-agnostic Continual Learning-Unlearning
di: Huang, Zhehao, et al.
Pubblicazione: (2025)

A Novel Collaborative Framework for Efficient Synchronization in Split Federated Learning over Wireless Networks
di: Gao, Haoran, et al.
Pubblicazione: (2025)

Compressed Concatenation of Small Embedding Models
di: Ayad, Mohamed Ayoub Ben, et al.
Pubblicazione: (2025)

Bridging Domain Adaptation and Graph Neural Networks: A Tensor-Based Framework for Effective Label Propagation
di: Wen, Tao, et al.
Pubblicazione: (2025)

Vanishing Contributions: A Unified Framework for Smooth and Iterative Model Compression
di: Nikiforos, Lorenzo, et al.
Pubblicazione: (2025)

Arondight: Red Teaming Large Vision Language Models with Auto-generated Multi-modal Jailbreak Prompts
di: Liu, Yi, et al.
Pubblicazione: (2024)

A Generalized Spectral Framework to Expain Neural Scaling and Compression Dynamics
di: Zhang, Yizhou
Pubblicazione: (2025)

IGNN-Solver: A Graph Neural Solver for Implicit Graph Neural Networks
di: Lin, Junchao, et al.
Pubblicazione: (2024)

Graph Neural Networks on Quantum Computers
di: Liao, Yidong, et al.
Pubblicazione: (2024)

Cross-Space Synergy: A Unified Framework for Multimodal Emotion Recognition in Conversation
di: Lyu, Xiaosen, et al.
Pubblicazione: (2025)

Network Dynamics-Based Framework for Understanding Deep Neural Networks
di: Lin, Yuchen, et al.
Pubblicazione: (2025)

Improving Data-aware and Parameter-aware Robustness for Continual Learning
di: Xiao, Hanxi, et al.
Pubblicazione: (2024)

Learnware of Language Models: Specialized Small Language Models Can Do Big
di: Tan, Zhi-Hao, et al.
Pubblicazione: (2025)

FIMP: Foundation Model-Informed Message Passing for Graph Neural Networks
di: Rizvi, Syed Asad, et al.
Pubblicazione: (2022)

Majority Kernels: An Approach to Leverage Big Model Dynamics for Efficient Small Model Training
di: Mazzawi, Hanna, et al.
Pubblicazione: (2024)

PREMAP: A Unifying PREiMage APproximation Framework for Neural Networks
di: Zhang, Xiyue, et al.
Pubblicazione: (2024)

IDEA: A Flexible Framework of Certified Unlearning for Graph Neural Networks
di: Dong, Yushun, et al.
Pubblicazione: (2024)

How Big Should a Wireless Foundation Model Be?
di: Cheng, Wei-Lun, et al.
Pubblicazione: (2026)

Self-Compressing Neural Networks
di: Cséfalvay, Szabolcs, et al.
Pubblicazione: (2023)

Unified Graph Networks (UGN): A Deep Neural Framework for Solving Graph Problems
di: Dawn, Rudrajit, et al.
Pubblicazione: (2025)

Normalized Relevance Measure as a Unifying Framework to Explain Neural Network Latent Structures
di: Xiong, Ping, et al.
Pubblicazione: (2026)

NeuronSeek: On Stability and Expressivity of Task-driven Neurons
di: Pei, Hanyu, et al.
Pubblicazione: (2025)

SmallKV: Small Model Assisted Compensation of KV Cache Compression for Efficient LLM Inference
di: Zhao, Yi, et al.
Pubblicazione: (2025)

PrivTune: Efficient and Privacy-Preserving Fine-Tuning of Large Language Models via Device-Cloud Collaboration
di: Liu, Yi, et al.
Pubblicazione: (2025)

Neural Network Compression for Reinforcement Learning Tasks
di: Ivanov, Dmitry A., et al.
Pubblicazione: (2024)

When Do Neural Networks Learn World Models?
di: Zhang, Tianren, et al.
Pubblicazione: (2025)

Robust and Efficient Deep Hedging via Linearized Objective Neural Network
di: Zhao, Lei, et al.
Pubblicazione: (2025)

Issues with Neural Tangent Kernel Approach to Neural Networks
di: Liu, Haoran, et al.
Pubblicazione: (2025)