Cover Image

Decomposing Evolutionary Mixture-of-LoRA Architectures: The Routing Lever, the Lifecycle Penalty, and a Substrate-Conditional Boundary

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Kumaresan, Ramchand
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Little Rank Goes a Long Way: Random Scaffolds with LoRA Adapters Are All You Need
by: Hazan, Hananel, et al.
Published: (2026)

EvolKV: Evolutionary KV Cache Compression for LLM Inference
by: Yu, Bohan, et al.
Published: (2025)

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
by: Csordás, Róbert, et al.
Published: (2023)

Spiking Synaptic Penalty: Appropriate Penalty Term for Energy-Efficient Spiking Neural Networks
by: Suetake, Kazuma, et al.
Published: (2023)

Intelligent Neural Networks: From Layered Architectures to Graph-Organized Intelligence
by: Salomon, Antoine
Published: (2025)

Batch Normalization Decomposed
by: Nachum, Ido, et al.
Published: (2024)

Multi-Objective Evolutionary Neural Architecture Search for Recurrent Neural Networks
by: Booysen, Reinhard, et al.
Published: (2024)

SONATA: Self-adaptive Evolutionary Framework for Hardware-aware Neural Architecture Search
by: Bouzidi, Halima, et al.
Published: (2024)

ACAR: Adaptive Complexity Routing for Multi-Model Ensembles with Auditable Decision Traces
by: Kumaresan, Ramchand
Published: (2026)

Conditional Finite Mixtures of Poisson Distributions for Context-Dependent Neural Correlations
by: Sokoloski, Sacha, et al.
Published: (2019)

A Modality-Aware Cooperative Co-Evolutionary Framework for Multimodal Graph Neural Architecture Search
by: Wang, Sixuan, et al.
Published: (2025)

Representation Learning in a Decomposed Encoder Design for Bio-inspired Hebbian Learning
by: Jaziri, Achref, et al.
Published: (2023)

Compute Allocation in Evolutionary Search: From Depth-Breadth to Multi-Armed Bandits
by: Xing, Sixue, et al.
Published: (2026)

Evolutionary Multi-Objective Optimization of Large Language Model Prompts for Balancing Sentiments
by: Baumann, Jill, et al.
Published: (2024)

EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languages
by: Mercer, Johnathan
Published: (2024)

LLM-FE: Automated Feature Engineering for Tabular Data with LLMs as Evolutionary Optimizers
by: Abhyankar, Nikhil, et al.
Published: (2025)

When Large Language Models Meet Evolutionary Algorithms: Potential Enhancements and Challenges
by: Wang, Chao, et al.
Published: (2024)

Evolutionary Policy Optimization
by: Mustafaoglu, Zelal Su "Lain", et al.
Published: (2025)

Parameter-Efficient Fine-Tuning of LLMs with Mixture of Space Experts
by: Zhang, Buze, et al.
Published: (2026)

Evolutionary Multitasking AUC Optimization
by: Wang, Chao, et al.
Published: (2022)

Diffusion Models are Evolutionary Algorithms
by: Zhang, Yanbo, et al.
Published: (2024)

Evolutionary Dynamic Optimization and Machine Learning
by: Boulesnane, Abdennour
Published: (2023)

eVAE: Evolutionary Variational Autoencoder
by: Wu, Zhangkai, et al.
Published: (2023)

Elastic Architecture Search for Efficient Language Models
by: Wang, Shang
Published: (2025)

Knowledge-aware Evolutionary Graph Neural Architecture Search
by: Wang, Chao, et al.
Published: (2024)

Analysis and Explainability of LLMs Via Evolutionary Methods
by: Gallagher, Shannon K., et al.
Published: (2026)

Evolutionary Context Search for Automated Skill Acquisition
by: Sun, Qi, et al.
Published: (2026)

Natural Evolutionary Search meets Probabilistic Numerics
by: Osselin, Pierre, et al.
Published: (2025)

Deep Learning-Based Operators for Evolutionary Algorithms
by: Shem-Tov, Eliad, et al.
Published: (2024)

Experience-Based Evolutionary Algorithms for Expensive Optimization
by: Yu, Xunzhao, et al.
Published: (2023)

A Transformer-based Neural Architecture Search Method
by: Wang, Shang, et al.
Published: (2025)

HG2P: Hippocampus-inspired High-reward Graph and Model-Free Q-Gradient Penalty for Path Planning and Motion Control
by: Wang, Haoran, et al.
Published: (2024)

Code World Models for Parameter Control in Evolutionary Algorithms
by: Sartori, Camilo Chacón, et al.
Published: (2026)

Neuro-Evolutionary Approach to Physics-Aware Symbolic Regression
by: Kubalík, Jiří, et al.
Published: (2025)

Sharpness-Aware Minimization for Evolutionary Feature Construction in Regression
by: Zhang, Hengzhe, et al.
Published: (2024)

Evolutionary Machine Learning meets Self-Supervised Learning: a comprehensive survey
by: Vinhas, Adriano, et al.
Published: (2025)

Evolutionary Architecture Search through Grammar-Based Sequence Alignment
by: Martín, Adri Gómez, et al.
Published: (2025)

A Hormone-inspired Emotion Layer for Transformer language models (HELT)
by: Reda, Eslam, et al.
Published: (2026)

EvoX: Meta-Evolution for Automated Discovery
by: Liu, Shu, et al.
Published: (2026)

Why Prompt Optimization Works, and Why It Sometimes Doesn't: A Causal-Inspired Edit-Level Analysis
by: Gong, Shuzhi, et al.
Published: (2026)