Cover Image

Large Multimodal Model Compression via Efficient Pruning and Distillation at AntGroup

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Maolin, Zhao, Yao, Liu, Jiajia, Chen, Jingdong, Zhuang, Chenyi, Gu, Jinjie, Guo, Ruocheng, Zhao, Xiangyu
Format:	Preprint
Published:	2023
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DNS-Rec: Data-aware Neural Architecture Search for Recommender Systems
by: Zhang, Sheng, et al.
Published: (2024)

Tensorized Hypergraph Neural Networks
by: Wang, Maolin, et al.
Published: (2023)

Lookahead: An Inference Acceleration Framework for Large Language Model with Lossless Generation Accuracy
by: Zhao, Yao, et al.
Published: (2023)

FunReason: Enhancing Large Language Models' Function Calling via Self-Refinement Multiscale Loss and Automated Data Refinement
by: Hao, Bingguang, et al.
Published: (2025)

CSR:Achieving 1 Bit Key-Value Cache via Sparse Representation
by: Zhang, Hongxuan, et al.
Published: (2024)

Put Teacher in Student's Shoes: Cross-Distillation for Ultra-compact Model Compression Framework
by: Wang, Maolin, et al.
Published: (2025)

Mitigate Position Bias with Coupled Ranking Bias on CTR Prediction
by: Zhao, Yao, et al.
Published: (2024)

Recon-Act: A Self-Evolving Multi-Agent Browser-Use System via Web Reconnaissance, Tool Generation, and Task Execution
by: He, Kaiwen, et al.
Published: (2025)

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
by: Xie, Zhitian, et al.
Published: (2024)

Fast Chain-of-Thought: A Glance of Future from Parallel Decoding Leads to Answers Faster
by: Zhang, Hongxuan, et al.
Published: (2023)

SPARK: Adaptive Low-Rank Knowledge Graph Modeling in Hybrid Geometric Spaces for Recommendation
by: Wang, Binhao, et al.
Published: (2025)

Data Efficient Adaptation in Large Language Models via Continuous Low-Rank Fine-Tuning
by: Han, Xiao, et al.
Published: (2025)

Reasoning through Exploration: A Reinforcement Learning Framework for Robust Function Calling
by: Hao, Bingguang, et al.
Published: (2025)

EPSD: Early Pruning with Self-Distillation for Efficient Model Compression
by: Chen, Dong, et al.
Published: (2024)

DANCE: Resource-Efficient Neural Architecture Search with Data-Aware and Continuous Adaptation
by: Wang, Maolin, et al.
Published: (2025)

Adversarial Curriculum Graph Contrastive Learning with Pair-wise Augmentation
by: Zhao, Xinjian, et al.
Published: (2024)

EM-KD: Distilling Efficient Multimodal Large Language Model with Unbalanced Vision Tokens
by: Feng, Ze, et al.
Published: (2025)

MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning
by: Wang, Maolin, et al.
Published: (2025)

Renormalization Group Guided Tensor Network Structure Search
by: Wang, Maolin, et al.
Published: (2025)

Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs
by: Wang, Yuhao, et al.
Published: (2025)

Curriculum Learning for Efficient Chain-of-Thought Distillation via Structure-Aware Masking and GRPO
by: Yu, Bowen, et al.
Published: (2026)

CharPoet: A Chinese Classical Poetry Generation System Based on Token-free LLM
by: Yu, Chengyue, et al.
Published: (2024)

Profile-Aware Maneuvering: A Dynamic Multi-Agent System for Robust GAIA Problem Solving by AWorld
by: Xie, Zhitian, et al.
Published: (2025)

Stepwise Reasoning Error Disruption Attack of LLMs
by: Peng, Jingyu, et al.
Published: (2024)

Cumulative Distribution Function based General Temporal Point Processes
by: Wang, Maolin, et al.
Published: (2024)

Comb, Prune, Distill: Towards Unified Pruning for Vision Model Compression
by: Schmitt, Jonas, et al.
Published: (2024)

Efficient Multimodal Dataset Distillation via Generative Models
by: Zhao, Zhenghao, et al.
Published: (2025)

STAR-Rec: Making Peace with Length Variance and Pattern Diversity in Sequential Recommendation
by: Wang, Maolin, et al.
Published: (2025)

FunReason-MT Technical Report: Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-use
by: Xu, Zengzhuang, et al.
Published: (2025)

Explainable Behavior Cloning: Teaching Large Language Model Agents through Learning by Demonstration
by: Guan, Yanchu, et al.
Published: (2024)

Empowering Denoising Sequential Recommendation with Large Language Model Embeddings
by: Wu, Tongzhou, et al.
Published: (2025)

RAG-R1: Incentivizing the Search and Reasoning Capabilities of LLMs through Multi-query Parallelism
by: Tan, Zhiwen, et al.
Published: (2025)

LiveAgentBench: Comprehensive Benchmarking of Agentic Systems Across 104 Real-World Challenges
by: Li, Hao, et al.
Published: (2026)

LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Models
by: Zhang, Dingkun, et al.
Published: (2024)

UniComp: A Unified Evaluation of Large Language Model Compression via Pruning, Quantization and Distillation
by: von Rad, Jonathan, et al.
Published: (2026)

Compressing Multi-Task Model for Autonomous Driving via Pruning and Knowledge Distillation
by: Wang, Jiayuan, et al.
Published: (2025)

EfficientXpert: Efficient Domain Adaptation for Large Language Models via Propagation-Aware Pruning
by: Zhao, Songlin, et al.
Published: (2025)

Prune-Quantize-Distill: An Ordered Pipeline for Efficient Neural Network Compression
by: Zhou, Longsheng, et al.
Published: (2026)

AdaSwitch: Balancing Exploration and Guidance in Knowledge Distillation via Adaptive Switching
by: Peng, Jingyu, et al.
Published: (2025)

PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation
by: Fan, Tao, et al.
Published: (2025)