Image de couverture de livre

Training-free Ultra Small Model for Universal Sparse Reconstruction in Compressed Sensing

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Tang, Chaoqing, Zhuang, Huanze, Tian, Guiyun, Zeng, Zhenli, Ding, Yi, Liu, Wenzhong, Bai, Xiang
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

UNIQUE: Universal Top-k Sparse Attention for Training-free Inference and Sparsity-aware Training
par: Deng, Keqi, et autres
Publié: (2026)

SEAP: Training-free Sparse Expert Activation Pruning Unlock the Brainpower of Large Language Models
par: Liang, Xun, et autres
Publié: (2025)

HiSAC: Hierarchical Sparse Activation Compression for Ultra-long Sequence Modeling in Recommenders
par: Yuan, Kun, et autres
Publié: (2026)

Ultra Memory-Efficient On-FPGA Training of Transformers via Tensor-Compressed Optimization
par: Tian, Jiayi, et autres
Publié: (2025)

Saten: Sparse Augmented Tensor Networks for Post-Training Compression of Large Language Models
par: Solgi, Ryan, et autres
Publié: (2025)

KV-Embedding: Training-free Text Embedding via Internal KV Re-routing in Decoder-only LLMs
par: Tang, Yixuan, et autres
Publié: (2026)

One-for-All Pruning: A Universal Model for Customized Compression of Large Language Models
par: Ye, Rongguang, et autres
Publié: (2025)

Cross-Family Speculative Prefill: Training-Free Long-Context Compression with Small Draft Models
par: Upasani, Shubhangi, et autres
Publié: (2026)

Jailbreak Antidote: Runtime Safety-Utility Balance via Sparse Representation Adjustment in Large Language Models
par: Shen, Guobin, et autres
Publié: (2024)

TaDA: Training-free recipe for Decoding with Adaptive KV Cache Compression and Mean-centering
par: Joshi, Vinay, et autres
Publié: (2025)

One Small and One Large for Document-level Event Argument Extraction
par: Peng, Jiaren, et autres
Publié: (2024)

KVReviver: Reversible KV Cache Compression with Sketch-Based Token Reconstruction
par: Yuan, Aomufei, et autres
Publié: (2025)

Compressing Lengthy Context With UltraGist
par: Zhang, Peitian, et autres
Publié: (2024)

LACONIC: Dense-Level Effectiveness for Scalable Sparse Retrieval via a Two-Phase Training Curriculum
par: Xu, Zhichao, et autres
Publié: (2026)

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies
par: Hu, Shengding, et autres
Publié: (2024)

Training-free Context-adaptive Attention for Efficient Long Context Modeling
par: You, Zeng, et autres
Publié: (2025)

RATE: Reviewer Profiling and Annotation-free Training for Expertise Ranking in Peer Review Systems
par: Liu, Weicong, et autres
Publié: (2026)

Compressed Sensing for Capability Localization in Large Language Models
par: Bair, Anna, et autres
Publié: (2026)

BEAVER: A Training-Free Hierarchical Prompt Compression Method via Structure-Aware Page Selection
par: Hu, Zhengpei, et autres
Publié: (2026)

Achieving Sparse Activation in Small Language Models
par: Song, Jifeng, et autres
Publié: (2024)

A Unified Sparse Attention via Multi-Granularity Compression
par: Liu, Siran, et autres
Publié: (2025)

CSPLADE: Learned Sparse Retrieval with Causal Language Models
par: Xu, Zhichao, et autres
Publié: (2025)

Sparse Rewards Can Self-Train Dialogue Agents
par: Lattimer, Barrett Martin, et autres
Publié: (2024)

Efficient Long CoT Reasoning in Small Language Models
par: Wang, Zhaoyang, et autres
Publié: (2025)

SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
par: Feng, Kehua, et autres
Publié: (2024)

White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
par: Yu, Yaodong, et autres
Publié: (2023)

Data-free Weight Compress and Denoise for Large Language Models
par: Peng, Runyu, et autres
Publié: (2024)

From Similarity to Structure: Training-free LLM Context Compression with Hybrid Graph Priors
par: Zhou, Yitian, et autres
Publié: (2026)

Wave Network: An Ultra-Small Language Model
par: Zhang, Xin, et autres
Publié: (2024)

GCoder: Improving Large Language Model for Generalized Graph Problem Solving
par: Zhang, Qifan, et autres
Publié: (2024)

Ultra-FineWeb: Efficient Data Filtering and Verification for High-Quality LLM Training Data
par: Wang, Yudong, et autres
Publié: (2025)

Improving Large Models with Small models: Lower Costs and Better Performance
par: Chen, Dong, et autres
Publié: (2024)

PDF-WuKong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling
par: Xie, Xudong, et autres
Publié: (2024)

Training Superior Sparse Autoencoders for Instruct Models
par: Li, Jiaming, et autres
Publié: (2025)

Learning to Seek Help: Dynamic Collaboration Between Small and Large Language Models
par: Zeng, Hang, et autres
Publié: (2026)

SIRI: Scaling Iterative Reinforcement Learning with Interleaved Compression
par: Wen, Haoming, et autres
Publié: (2025)

MemoryFormer: Minimize Transformer Computation by Removing Fully-Connected Layers
par: Ding, Ning, et autres
Publié: (2024)

Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models
par: Pan, Bowen, et autres
Publié: (2024)

IndexCache: Accelerating Sparse Attention via Cross-Layer Index Reuse
par: Bai, Yushi, et autres
Publié: (2026)

SparseRM: A Lightweight Preference Modeling with Sparse Autoencoder
par: Liu, Dengcan, et autres
Publié: (2025)