Cover Image

MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ren, Pengjie, Shi, Chengshun, Wu, Shiguang, Zhang, Mengqi, Ren, Zhaochun, de Rijke, Maarten, Chen, Zhumin, Pei, Jiahuan
Format:	Preprint
Published:	2024
Subjects:	Computation and Language 68T50 I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Correctness is not Faithfulness in RAG Attributions
by: Wallat, Jonas, et al.
Published: (2024)

NERCat: Fine-Tuning for Enhanced Named Entity Recognition in Catalan
by: Ferreres, Guillem Cadevall, et al.
Published: (2025)

ExcluIR: Exclusionary Neural Information Retrieval
by: Zhang, Wenhao, et al.
Published: (2024)

Targeted Lexical Injection: Unlocking Latent Cross-Lingual Alignment in Lugha-Llama via Early-Layer LoRA Fine-Tuning
by: Ngugi, Stanley
Published: (2025)

Self-Supervised Position Debiasing for Large Language Models
by: Liu, Zhongkun, et al.
Published: (2024)

Prompt Engineering and the Effectiveness of Large Language Models in Enhancing Human Productivity
by: Anam, Rizal Khoirul
Published: (2025)

ScoreRAG: A Retrieval-Augmented Generation Framework with Consistency-Relevance Scoring and Structured Summarization for News Generation
by: Lin, Pei-Yun, et al.
Published: (2025)

The Superalignment of Superhuman Intelligence with Large Language Models
by: Huang, Minlie, et al.
Published: (2024)

Culturally-Nuanced Story Generation for Reasoning in Low-Resource Languages: The Case of Javanese and Sundanese
by: Pranida, Salsabila Zahirah, et al.
Published: (2025)

Beyond Many-Shot Translation: Scaling In-Context Demonstrations For Low-Resource Machine Translation
by: Salim, Luis Frentzen, et al.
Published: (2026)

Dynamic Parameter Memory: Temporary LoRA-Enhanced LLM for Long-Sequence Emotion Recognition in Conversation
by: Mai, Jialong, et al.
Published: (2025)

A-VERT: Agnostic Verification with Embedding Ranking Targets
by: Aguirre, Nicolás, et al.
Published: (2025)

ASLoRA: Adaptive Sharing Low-Rank Adaptation Across Layers
by: Hu, Junyan, et al.
Published: (2024)

XAutoLM: Efficient Fine-Tuning of Language Models via Meta-Learning and AutoML
by: Estevanell-Valladares, Ernesto L., et al.
Published: (2025)

Atyaephyra at SemEval-2025 Task 4: Low-Rank Negative Preference Optimization
by: Bronec, Jan, et al.
Published: (2025)

Efficient Telecom Specific LLM: TSLAM-Mini with QLoRA and Digital Twin Data
by: Ethiraj, Vignesh, et al.
Published: (2025)

Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval
by: Mekonnen, Kidist Amde, et al.
Published: (2025)

ToxiFrench: Benchmarking and Enhancing Language Models via CoT Fine-Tuning for French Toxicity Detection
by: Delaval, Axel, et al.
Published: (2025)

Fine-Tuning Transformers: Vocabulary Transfer
by: Mosin, Vladislav, et al.
Published: (2021)

LLM-Assisted Crisis Management: Building Advanced LLM Platforms for Effective Emergency Response and Public Collaboration
by: Otal, Hakan T., et al.
Published: (2024)

RHealthTwin: Towards Responsible and Multimodal Digital Twins for Personalized Well-being
by: Ferdousi, Rahatara, et al.
Published: (2025)

jina-embeddings-v3: Multilingual Embeddings With Task LoRA
by: Sturua, Saba, et al.
Published: (2024)

Enhancing OCR for Sino-Vietnamese Language Processing via Fine-tuned PaddleOCRv5
by: Nguyen, Minh Hoang, et al.
Published: (2025)

Towards Probabilistic Question Answering Over Tabular Data
by: Shen, Chen, et al.
Published: (2025)

ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses
by: Zong, Chang, et al.
Published: (2024)

Pivot Language for Low-Resource Machine Translation
by: Talwar, Abhimanyu, et al.
Published: (2025)

A Multi-Agent Framework for Medical AI: Leveraging Fine-Tuned GPT, LLaMA, and DeepSeek R1 for Evidence-Based and Bias-Aware Clinical Query Processing
by: Nourmohammadi, Naeimeh, et al.
Published: (2026)

Raw Text is All you Need: Knowledge-intensive Multi-turn Instruction Tuning for Large Language Model
by: Hou, Xia, et al.
Published: (2024)

Zero- and Few-Shot Prompting with LLMs: A Comparative Study with Fine-tuned Models for Bangla Sentiment Analysis
by: Hasan, Md. Arid, et al.
Published: (2023)

Hybrid Gated Flow (HGF): Stabilizing 1.58-bit LLMs via Selective Low-Rank Correction
by: Pizzo, David Alejandro Trejo
Published: (2026)

mHC-SSM: Manifold-Constrained Hyper-Connections for State Space Language Models with Stream-Specialized Adapters
by: Mutlu, Abdulvahap, et al.
Published: (2026)

UM_FHS at TREC 2024 PLABA: Exploration of Fine-tuning and AI agent approach for plain language adaptations of biomedical text
by: Kocbek, Primoz, et al.
Published: (2025)

CLMN: Concept based Language Models via Neural Symbolic Reasoning
by: Yang, Yibo
Published: (2025)

UnifiedCrawl: Aggregated Common Crawl for Affordable Adaptation of LLMs on Low-Resource Languages
by: Tessema, Bethel Melesse, et al.
Published: (2024)

The Knesset Corpus: An Annotated Corpus of Hebrew Parliamentary Proceedings
by: Goldin, Gili, et al.
Published: (2024)

Math Natural Language Inference: this should be easy!
by: de Paiva, Valeria, et al.
Published: (2025)

Fast Quiet-STaR: Thinking Without Thought Tokens
by: Huang, Wei, et al.
Published: (2025)

New Skills or Sharper Primitives? A Probabilistic Perspective on the Emergence of Reasoning in RLVR
by: Wang, Zhilin, et al.
Published: (2026)

Pitfalls in Evaluating Interpretability Agents
by: Haklay, Tal, et al.
Published: (2026)

d-TreeRPO: Towards More Reliable Policy Optimization for Diffusion Language Models
by: Pan, Leyi, et al.
Published: (2025)