Image de couverture de livre

PreLoRA: Hybrid Pre-training of Vision Transformers with Full Training and Low-Rank Adapters

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Thapa, Krishu K, Barik, Reet, Chitty-Venkata, Krishna Teja, Emani, Murali, Vishwanath, Venkatram
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Performance
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LangVision-LoRA-NAS: Neural Architecture Search for Variable LoRA Rank in Vision Language Models
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

LExI: Layer-Adaptive Active Experts for Efficient MoE Model Inference
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

ImageNet-Think-250K: A Large-Scale Synthetic Dataset for Multimodal Reasoning for Vision Language Models
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

BaKlaVa -- Budgeted Allocation of KV cache for Long-context Inference
par: Gulhan, Ahmed Burak, et autres
Publié: (2025)

Swimba: Switch Mamba Model Scales State Space Models
par: Du, Zhixu, et autres
Publié: (2026)

MoPEQ: Mixture of Mixed Precision Quantized Experts
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

PagedEviction: Structured Block-wise KV Cache Pruning for Efficient Large Language Model Inference
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2025)

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators
par: Chitty-Venkata, Krishna Teja, et autres
Publié: (2024)

L1RA: Dynamic Rank Assignment in LoRA Fine-Tuning
par: Singh, Raul, et autres
Publié: (2025)

LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits
par: Zhou, Zikai, et autres
Publié: (2025)

An Analysis of Performance Bottlenecks in MRI Pre-Processing
par: Dugré, Mathieu, et autres
Publié: (2024)

C-LoRA: Continual Low-Rank Adaptation for Pre-trained Models
par: Zhang, Xin, et autres
Publié: (2025)

Profiling LoRA/QLoRA Fine-Tuning Efficiency on Consumer GPUs: An RTX 4060 Case Study
par: Avinash, MSR
Publié: (2025)

Improving the Serving Performance of Multi-LoRA Large Language Models via Efficient LoRA and KV Cache Management
par: Zhang, Hang, et autres
Publié: (2025)

Scalable Binary CUR Low-Rank Approximation Algorithm
par: Su, Bowen
Publié: (2025)

Makinote: An FPGA-Based HW/SW Platform for Pre-Silicon Emulation of RISC-V Designs
par: Perdomo, Elias, et autres
Publié: (2024)

Columbo: Low Level End-to-End System Traces through Modular Full-System Simulation
par: Görgen, Jakob, et autres
Publié: (2024)

AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
par: Liu, Ziyun, et autres
Publié: (2026)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
par: Zhang, Chengqian, et autres
Publié: (2026)

Network Anatomy and Real-Time Measurement of Nvidia GeForce NOW Cloud Gaming
par: Lyu, Minzhao, et autres
Publié: (2024)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
par: Wang, Zhengbo, et autres
Publié: (2024)

FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models
par: Shao, Zishan, et autres
Publié: (2025)

FLuRKA: Fast and accurate unified Low-Rank & Kernel Attention
par: Gupta, Ahan, et autres
Publié: (2023)

SONIQ: System-Optimized Noise-Injected Ultra-Low-Precision Quantization with Full-Precision Parity
par: Zhou, Cyrus, et autres
Publié: (2023)

H2EAL: Hybrid-Bonding Architecture with Hybrid Sparse Attention for Efficient Long-Context LLM Inference
par: Fu, Zizhuo, et autres
Publié: (2025)

Low-Rank GEMM: Efficient Matrix Multiplication via Low-Rank Approximation with FP8 Acceleration
par: Metere, Alfredo
Publié: (2025)

FlashSVD v1.5: Making Low-Rank Transformers Inference Actually Fast
par: Wu, Wenhao, et autres
Publié: (2026)

Profiling Apple Silicon Performance for ML Training
par: Feng, Dahua, et autres
Publié: (2025)

A Data-driven ML Approach for Maximizing Performance in LLM-Adapter Serving
par: Agullo, Ferran, et autres
Publié: (2025)

Use of Soy Protein Concentrate in Pre-Starter and Starter Diets for Broilers
par: LG Vasconcelos
Publié: (2017)

Ranking with Ties based on Noisy Performance Data
par: Sankaran, Aravind, et autres
Publié: (2024)

Efficiently Ranking Software Variants with Minimal Benchmarks
par: Matricon, Théo, et autres
Publié: (2025)

Updates on the Low-Level Abstraction of Memory Access
par: Gruber, Bernhard Manfred
Publié: (2023)

LoREnc: Low-Rank Encryption for Securing Foundation Models and LoRA Adapters
par: Ahn, Beomjin, et autres
Publié: (2026)

Efficient Hybrid Amplitude-Phase Quantization for Multi-Antenna Relay System
par: Kim, Changdae, et autres
Publié: (2025)

A Low-Dissipation and Scalable GEMM Accelerator with Silicon Nitride Photonics
par: Karempudi, Venkata Sai Praneeth, et autres
Publié: (2024)

LoPace: A Lossless Optimized Prompt Accurate Compression Engine for Large Language Model Applications
par: Ulla, Aman
Publié: (2026)

Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing
par: Wang, Yuxin, et autres
Publié: (2023)

PPU: Design and Implementation of a Pipelined Full Posit Processing Unit
par: Rossi, Federico, et autres
Publié: (2023)