Copertina

Research on Personalized Compression Algorithm for Pre-trained Models Based on Homomorphic Entropy Increase

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Yicong, Guo, Xing, Du, Haohua
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

On Model Compression for Neural Networks: Framework, Algorithm, and Convergence Guarantee
di: Li, Chenyang, et al.
Pubblicazione: (2023)

BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual Polynomials
di: Xing, Xingrun, et al.
Pubblicazione: (2023)

Unleashing the Power of Pre-trained Language Models for Offline Reinforcement Learning
di: Shi, Ruizhe, et al.
Pubblicazione: (2023)

Orthogonal Approximate Message Passing Algorithms for Rectangular Spiked Matrix Models with Rotationally Invariant Noise
di: Chen, Haohua, et al.
Pubblicazione: (2026)

Representational Homomorphism Predicts and Improves Compositional Generalization In Transformer Language Model
di: An, Zhiyu, et al.
Pubblicazione: (2026)

Graph Generative Pre-trained Transformer
di: Chen, Xiaohui, et al.
Pubblicazione: (2025)

A Pre-trained Data Deduplication Model based on Active Learning
di: Shi, Haochen, et al.
Pubblicazione: (2023)

Unlabeled Data vs. Pre-trained Knowledge: Rethinking SSL in the Era of Large Models
di: Lv, Song-Lin, et al.
Pubblicazione: (2025)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
di: Song, Weixi, et al.
Pubblicazione: (2023)

An Enhanced Audio Feature Tailored for Anomalous Sound Detection Based on Pre-trained Models
di: Zhong, Guirui, et al.
Pubblicazione: (2025)

TrajMamba: An Efficient and Semantic-rich Vehicle Trajectory Pre-training Model
di: Liu, Yichen, et al.
Pubblicazione: (2025)

Clip-Low Increases Entropy and Clip-High Decreases Entropy in Reinforcement Learning of Large Language Models
di: Park, Jaesung R., et al.
Pubblicazione: (2025)

LOST: Low-rank and Sparse Pre-training for Large Language Models
di: Li, Jiaxi, et al.
Pubblicazione: (2025)

Homomorphism Expressivity of Spectral Invariant Graph Neural Networks
di: Gai, Jingchu, et al.
Pubblicazione: (2025)

Timer: Generative Pre-trained Transformers Are Large Time Series Models
di: Liu, Yong, et al.
Pubblicazione: (2024)

Neural Dynamics-Informed Pre-trained Framework for Personalized Brain Functional Network Construction
di: Jiang, Hongjie, et al.
Pubblicazione: (2026)

Model Merging in Pre-training of Large Language Models
di: Li, Yunshui, et al.
Pubblicazione: (2025)

Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Model
di: Niu, Peisong, et al.
Pubblicazione: (2025)

THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression
di: Li, Minghao, et al.
Pubblicazione: (2023)

Thinking Augmented Pre-training
di: Wang, Liang, et al.
Pubblicazione: (2025)

FlowletFormer: Network Behavioral Semantic Aware Pre-training Model for Traffic Classification
di: Liu, Liming, et al.
Pubblicazione: (2025)

Re-Evaluating the Impact of Unseen-Class Unlabeled Data on Semi-Supervised Learning Model
di: He, Rundong, et al.
Pubblicazione: (2025)

Task Groupings Regularization: Data-Free Meta-Learning with Heterogeneous Pre-trained Models
di: Wei, Yongxian, et al.
Pubblicazione: (2024)

PLMTrajRec: A Scalable and Generalizable Trajectory Recovery Method with Pre-trained Language Models
di: Wei, Tonglong, et al.
Pubblicazione: (2024)

Machine Unlearning of Pre-trained Large Language Models
di: Yao, Jin, et al.
Pubblicazione: (2024)

Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Models
di: Chen, Yuyan, et al.
Pubblicazione: (2024)

TiKMiX: Take Data Influence into Dynamic Mixture for Language Model Pre-training
di: Wang, Yifan, et al.
Pubblicazione: (2025)

Pre-trained Language Model and Knowledge Distillation for Lightweight Sequential Recommendation
di: Li, Li, et al.
Pubblicazione: (2024)

Accelerating Reinforcement Learning Algorithms Convergence using Pre-trained Large Language Models as Tutors With Advice Reusing
di: Toral, Lukas, et al.
Pubblicazione: (2025)

Homomorphic WiSARDs: Efficient Weightless Neural Network training over encrypted data
di: Neumann, Leonardo, et al.
Pubblicazione: (2024)

Pre-training under infinite compute
di: Kim, Konwoo, et al.
Pubblicazione: (2025)

Compression via Pre-trained Transformers: A Study on Byte-Level Multimodal Data
di: Heurtel-Depeiges, David, et al.
Pubblicazione: (2024)

UniTE: A Survey and Unified Pipeline for Pre-training Spatiotemporal Trajectory Embeddings
di: Lin, Yan, et al.
Pubblicazione: (2024)

Revisiting ML Training under Fully Homomorphic Encryption: Convergence Guarantees, Differential Privacy, and Efficient Algorithms
di: Zhou, Yvonne, et al.
Pubblicazione: (2026)

ChemBART: A Pre-trained BART Model Assisting Organic Chemistry Analysis
di: Li, Kenan, et al.
Pubblicazione: (2026)

Incorporating Pre-trained Diffusion Models in Solving the Schrödinger Bridge Problem
di: Tang, Zhicong, et al.
Pubblicazione: (2025)

Diffusion Domain Expansion: Learning to Coordinate Pre-trained Diffusion Models
di: Lifar, Egor, et al.
Pubblicazione: (2026)

Vertical Federated Learning Hybrid Local Pre-training
di: Li, Wenguo, et al.
Pubblicazione: (2024)

AFL: A Single-Round Analytic Approach for Federated Learning with Pre-trained Models
di: He, Run, et al.
Pubblicazione: (2024)

One Model for All: Universal Pre-training for EEG based Emotion Recognition across Heterogeneous Datasets and Paradigms
di: Li, Xiang, et al.
Pubblicazione: (2025)