Copertina

LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kim, Taeho, Wang, Yanming, Chaturvedi, Vatshank, Gupta, Lokesh, Kim, Seyeon, Kwon, Yongin, Ha, Sangtae
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Artificial Intelligence Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Exploring the Trade-Offs: Quantization Methods, Task Difficulty, and Model Size in Large Language Models From Edge to Giant
di: Lee, Jemin, et al.
Pubblicazione: (2024)

Question Answering on Patient Medical Records with Private Fine-Tuned LLMs
di: Kothari, Sara, et al.
Pubblicazione: (2025)

QuantuneV2: Compiler-Based Local Metric-Driven Mixed Precision Quantization for Practical Embedded AI Applications
di: Kim, Jeongseok, et al.
Pubblicazione: (2025)

Pre-Storage Reasoning for Episodic Memory: Shifting Inference Burden to Memory for Personalized Dialogue
di: Kim, Sangyeop, et al.
Pubblicazione: (2025)

BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs
di: Yoon, Sangyeon, et al.
Pubblicazione: (2026)

Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model
di: Lin, Chun-Hsien, et al.
Pubblicazione: (2024)

Not All Adapters Matter: Selective Adapter Freezing for Memory-Efficient Fine-Tuning of Language Models
di: Son, Hyegang, et al.
Pubblicazione: (2024)

Revealing the Inherent Instructability of Pre-Trained Language Models
di: An, Seokhyun, et al.
Pubblicazione: (2024)

Fine-Grained and Thematic Evaluation of LLMs in Social Deduction Game
di: Kim, Byungjun, et al.
Pubblicazione: (2024)

QFlash: Bridging Quantization and Memory Efficiency in Vision Transformer Attention
di: Oh, Sehyeon, et al.
Pubblicazione: (2026)

Amuro and Char: Analyzing the Relationship between Pre-Training and Fine-Tuning of Large Language Models
di: Sun, Kaiser, et al.
Pubblicazione: (2024)

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models
di: Arteaga, Gabriel Y., et al.
Pubblicazione: (2024)

Understanding the Performance and Estimating the Cost of LLM Fine-Tuning
di: Xia, Yuchen, et al.
Pubblicazione: (2024)

DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selection
di: Das, Devleena, et al.
Pubblicazione: (2023)

User-Specific Dialogue Generation with User Profile-Aware Pre-Training Model and Parameter-Efficient Fine-Tuning
di: Otsuka, Atsushi, et al.
Pubblicazione: (2024)

MedBioLM: Optimizing Medical and Biological QA with Fine-Tuned Large Language Models and Retrieval-Augmented Generation
di: Kim, Seonok
Pubblicazione: (2025)

Fine-Tuning Qwen 2.5 3B for Realistic Movie Dialogue Generation
di: Gupta, Kartik
Pubblicazione: (2025)

Model Fusion through Bayesian Optimization in Language Model Fine-Tuning
di: Jang, Chaeyun, et al.
Pubblicazione: (2024)

InfiMed-Foundation: Pioneering Advanced Multimodal Medical Models with Compute-Efficient Pre-Training and Multi-Stage Fine-Tuning
di: Zhu, Guanghao, et al.
Pubblicazione: (2025)

Syntriever: How to Train Your Retriever with Synthetic Data from LLMs
di: Kim, Minsang, et al.
Pubblicazione: (2025)

Fine-Tuning LLMs for Reliable Medical Question-Answering Services
di: Anaissi, Ali, et al.
Pubblicazione: (2024)

Reversing Large Language Models for Efficient Training and Fine-Tuning
di: Gal, Eshed, et al.
Pubblicazione: (2025)

Generation and De-Identification of Indian Clinical Discharge Summaries using LLMs
di: Singh, Sanjeet, et al.
Pubblicazione: (2024)

M2S: Multi-turn to Single-turn jailbreak in Red Teaming for LLMs
di: Ha, Junwoo, et al.
Pubblicazione: (2025)

Fine-Tuning LLMs for Low-Resource Dialect Translation: The Case of Lebanese
di: Yakhni, Silvana, et al.
Pubblicazione: (2025)

Supervised Fine-Tuning or In-Context Learning? Evaluating LLMs for Clinical NER
di: Baroian, Andrei
Pubblicazione: (2025)

Incivility and Rigidity: Evaluating the Risks of Fine-Tuning LLMs for Political Argumentation
di: Churina, Svetlana, et al.
Pubblicazione: (2024)

TuCo: Measuring the Contribution of Fine-Tuning to Individual Responses of LLMs
di: Nuti, Felipe, et al.
Pubblicazione: (2025)

60 Data Points are Sufficient to Fine-Tune LLMs for Question-Answering
di: Ye, Junjie, et al.
Pubblicazione: (2024)

Diffusion-Inspired Masked Fine-Tuning for Knowledge Injection in Autoregressive LLMs
di: Pan, Xu, et al.
Pubblicazione: (2025)

How Training Data Shapes the Use of Parametric and In-Context Knowledge in Language Models
di: Kim, Minsung, et al.
Pubblicazione: (2025)

Designing Memory-Augmented AR Agents for Spatiotemporal Reasoning in Personalized Task Assistance
di: Choi, Dongwook, et al.
Pubblicazione: (2025)

Mixed Non-linear Quantization for Vision Transformers
di: Kim, Gihwan, et al.
Pubblicazione: (2024)

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
di: Zhou, Sifan, et al.
Pubblicazione: (2025)

Removing RLHF Protections in GPT-4 via Fine-Tuning
di: Zhan, Qiusi, et al.
Pubblicazione: (2023)

Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
di: Li, Wu, et al.
Pubblicazione: (2026)

SDA: Steering-Driven Distribution Alignment for Open LLMs without Fine-Tuning
di: Xia, Wei, et al.
Pubblicazione: (2025)

Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs
di: Liu, Danni, et al.
Pubblicazione: (2025)

A Comparative Analysis of Instruction Fine-Tuning LLMs for Financial Text Classification
di: Fatemi, Sorouralsadat, et al.
Pubblicazione: (2024)

X-PEFT: eXtremely Parameter-Efficient Fine-Tuning for Extreme Multi-Profile Scenarios
di: Kwak, Namju, et al.
Pubblicazione: (2024)