Copertina

DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ke, Wenjin, Li, Zhe, Li, Dong, Tian, Lu, Barsoum, Emad
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

AdaLoRA-QAT: Adaptive Low-Rank and Quantization-Aware Segmentation
di: Deb, Prantik, et al.
Pubblicazione: (2026)

FraQAT: Quantization Aware Training with Fractional bits
di: Morreale, Luca, et al.
Pubblicazione: (2025)

MonoGS++: Fast and Accurate Monocular RGB Gaussian SLAM
di: Li, Renwu, et al.
Pubblicazione: (2025)

QAPruner: Quantization-Aware Vision Token Pruning for Multimodal Large Language Models
di: Wang, Xinhao, et al.
Pubblicazione: (2026)

SpecVLM: Fast Speculative Decoding in Vision-Language Models
di: Huang, Haiduo, et al.
Pubblicazione: (2025)

Fast Occupancy Network
di: Lu, Mingjie, et al.
Pubblicazione: (2024)

CR-QAT: Curriculum Relational Quantization-Aware Training for Open-Vocabulary Object Detection
di: Park, Jinyeong, et al.
Pubblicazione: (2026)

LADDER: An Efficient Framework for Video Frame Interpolation
di: Shen, Tong, et al.
Pubblicazione: (2024)

Partial Convolution Meets Visual Attention
di: Huang, Haiduo, et al.
Pubblicazione: (2025)

Fine-Grained Post-Training Quantization for Large Vision Language Models with Quantization-Aware Integrated Gradients
di: Xiang, Ziwei, et al.
Pubblicazione: (2026)

Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptation
di: Wanyan, Yuyang, et al.
Pubblicazione: (2025)

DUET-VLM: Dual stage Unified Efficient Token reduction for VLM Training and Inference
di: Singh, Aditya Kumar, et al.
Pubblicazione: (2026)

Q$^2$: Quantization-Aware Gradient Balancing and Attention Alignment for Low-Bit Quantization
di: Wang, Zhaoyang, et al.
Pubblicazione: (2025)

MBQ: Modality-Balanced Quantization for Large Vision-Language Models
di: Li, Shiyao, et al.
Pubblicazione: (2024)

DoRA: Weight-Decomposed Low-Rank Adaptation
di: Liu, Shih-Yang, et al.
Pubblicazione: (2024)

Athena: Enhancing Multimodal Reasoning with Data-efficient Process Reward Models
di: Wang, Shuai, et al.
Pubblicazione: (2025)

Full-Rank No More: Low-Rank Weight Training for Modern Speech Recognition Models
di: Fernandez-Lopez, Adriana, et al.
Pubblicazione: (2024)

Efficient Quantization-Aware Training on Segment Anything Model in Medical Images and Its Deployment
di: Lu, Haisheng, et al.
Pubblicazione: (2024)

Pause and Think: A Dataset and Benchmark for Video-Grounded Assistive Action Suggestion
di: Singh, Shivam, et al.
Pubblicazione: (2026)

E-MMDiT: Revisiting Multimodal Diffusion Transformer Design for Fast Image Synthesis under Limited Resources
di: Shen, Tong, et al.
Pubblicazione: (2025)

AMD-Hummingbird: Towards an Efficient Text-to-Video Model
di: Isobe, Takashi, et al.
Pubblicazione: (2025)

Breaking Modality Heterogeneity in Low-Bit Quantization for Large Vision-Language Models
di: Zhong, Yi, et al.
Pubblicazione: (2026)

Scheduling Weight Transitions for Quantization-Aware Training
di: Lee, Junghyup, et al.
Pubblicazione: (2024)

XModBench: Benchmarking Cross-Modal Capabilities and Consistency in Omni-Language Models
di: Wang, Xingrui, et al.
Pubblicazione: (2025)

BALR-SAM: Boundary-Aware Low-Rank Adaptation of SAM for Resource-Efficient Medical Image Segmentation
di: Liu, Zelin, et al.
Pubblicazione: (2025)

CARPE: Context-Aware Image Representation Prioritization via Ensemble for Large Vision-Language Models
di: Lee, Donghee, et al.
Pubblicazione: (2026)

Decomposed Vector-Quantized Variational Autoencoder for Human Grasp Generation
di: Zhao, Zhe, et al.
Pubblicazione: (2024)

IWP: Token Pruning as Implicit Weight Pruning in Large Vision Language Models
di: Lee, Dong-Jae, et al.
Pubblicazione: (2026)

Layout-Conditioned Autoregressive Text-to-Image Generation via Structured Masking
di: Zheng, Zirui, et al.
Pubblicazione: (2025)

Not All NVFP4 QAT Recipes Are Equal: How Architecture and Scale Shape Model Quality for Anomaly Segmentation
di: Du, Zijian, et al.
Pubblicazione: (2026)

ProReflow: Progressive Reflow with Decomposed Velocity
di: Ke, Lei, et al.
Pubblicazione: (2025)

DilateQuant: Accurate and Efficient Diffusion Quantization via Weight Dilation
di: Liu, Xuewen, et al.
Pubblicazione: (2024)

DL$^3$M: A Vision-to-Language Framework for Expert-Level Medical Reasoning through Deep Learning and Large Language Models
di: Hasan, Md. Najib, et al.
Pubblicazione: (2025)

Edit as You See: Image-guided Video Editing via Masked Motion Modeling
di: Huang, Zhi-Lin, et al.
Pubblicazione: (2025)

SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models
di: Fang, Hengyu, et al.
Pubblicazione: (2025)

SLA2: Sparse-Linear Attention with Learnable Routing and QAT
di: Zhang, Jintao, et al.
Pubblicazione: (2026)

DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion
di: Wu, Yujia, et al.
Pubblicazione: (2024)

Tail-Aware Post-Training Quantization for 3D Geometry Models
di: Pan, Sicheng, et al.
Pubblicazione: (2026)

Advancing Multimodal Large Language Models with Quantization-Aware Scale Learning for Efficient Adaptation
di: Xie, Jingjing, et al.
Pubblicazione: (2024)

A Low-Rank Method for Vision Language Model Hallucination Mitigation in Autonomous Driving
di: Long, Keke, et al.
Pubblicazione: (2025)