Image de couverture de livre

Inducing Generalization across Languages and Tasks using Featurized Low-Rank Mixtures

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lin, Chu-Cheng, Wang, Xinyi, Clark, Jonathan H., Lu, Han, Zhu, Yun, Whitehouse, Chenxi, Yu, Hongkun
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Low-Rank Adaptation for Multilingual Summarization: An Empirical Study
par: Whitehouse, Chenxi, et autres
Publié: (2023)

Towards Knowledge-Grounded Natural Language Understanding and Generation
par: Whitehouse, Chenxi
Publié: (2024)

PRobELM: Plausibility Ranking Evaluation for Language Models
par: Yuan, Zhangdie, et autres
Publié: (2024)

Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Models
par: Zhu, Xiaochen, et autres
Publié: (2024)

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning
par: Zhang, Dacao, et autres
Publié: (2025)

Lifelong Personalized Low-Rank Adaptation of Large Language Models for Recommendation
par: Zhu, Jiachen, et autres
Publié: (2024)

Finetuning Large Language Model for Personalized Ranking
par: Bai, Zhuoxi, et autres
Publié: (2024)

Multi-Task Dense Prediction via Mixture of Low-Rank Experts
par: Yang, Yuqi, et autres
Publié: (2024)

Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation
par: Chen, Qian, et autres
Publié: (2024)

MING-MOE: Enhancing Medical Multi-Task Learning in Large Language Models with Sparse Mixture of Low-Rank Adapter Experts
par: Liao, Yusheng, et autres
Publié: (2024)

Low-Rank Adaptation with Task-Relevant Feature Enhancement for Fine-tuning Language Models
par: Li, Changqun, et autres
Publié: (2024)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
par: Zhao, Ziyu, et autres
Publié: (2025)

MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning
par: Wang, Xujia, et autres
Publié: (2024)

Mixture-of-Subspaces in Low-Rank Adaptation
par: Wu, Taiqiang, et autres
Publié: (2024)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
par: Lin, Weicheng, et autres
Publié: (2026)

A Low-Rank ADMM Splitting Approach for Semidefinite Programming
par: Han, Qiushi, et autres
Publié: (2024)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
par: Tang, Chuanyu, et autres
Publié: (2024)

TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models
par: Mu, Lin, et autres
Publié: (2026)

Astra: Activation-Space Tail-Eigenvector Low-Rank Adaptation of Large Language Models
par: Liu, Kainan, et autres
Publié: (2026)

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning
par: Zhang, Jingfan, et autres
Publié: (2024)

Evaluating Prompting and Execution-Based Methods for Deterministic Computation in LLMs
par: Yu, Hongkun
Publié: (2026)

Rethinking Rubric Generation for Improving LLM Judge and Reward Modeling for Open-ended Tasks
par: Shen, William F., et autres
Publié: (2026)

Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts
par: Chen, Qizhou, et autres
Publié: (2024)

Rethinking Low-Rank Adaptation in Vision: Exploring Head-Level Responsiveness across Diverse Tasks
par: Zhong, Yibo, et autres
Publié: (2024)

DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task
par: Liu, Wenhan, et autres
Publié: (2024)

Generalizable Multispectral Land Cover Classification via Frequency-Aware Mixture of Low-Rank Token Experts
par: Chen, Xi, et autres
Publié: (2025)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
par: Sun, Mengyang, et autres
Publié: (2025)

Generalized Contrastive Learning for Multi-Modal Retrieval and Ranking
par: Zhu, Tianyu, et autres
Publié: (2024)

LOFT: Low-Rank Orthogonal Fine-Tuning via Task-Aware Support Selection
par: Zhao, Lanxin, et autres
Publié: (2026)

Low-Rank Interconnected Adaptation across Layers
par: Zhong, Yibo, et autres
Publié: (2024)

Task-Aware Low-Rank Adaptation of Segment Anything Model
par: Wang, Xuehao, et autres
Publié: (2024)

Near field transmission using Hermite-Gaussian modes
par: Zhu, Chenxi
Publié: (2025)

Task-Customized Mixture of Adapters for General Image Fusion
par: Zhu, Pengfei, et autres
Publié: (2024)

Explore the Capacity of Near Field Channel using Gaussian Beams
par: Zhu, Chenxi
Publié: (2026)

Regularizing Subspace Redundancy of Low-Rank Adaptation
par: Zhu, Yue, et autres
Publié: (2025)

Rank Matters: Understanding and Defending Model Inversion Attacks via Low-Rank Feature Filtering
par: Yu, Hongyao, et autres
Publié: (2024)

Evolutionary Router Feature Generation for Zero-Shot Graph Anomaly Detection with Mixture-of-Experts
par: Jiang, Haiyang, et autres
Publié: (2026)

MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
par: Yang, Cheng, et autres
Publié: (2024)

Lillama: Large Language Models Compression via Low-Rank Feature Distillation
par: Sy, Yaya, et autres
Publié: (2024)

Accelerated inference for stochastic compartmental models with over-dispersed partial observations
par: Whitehouse, Michael
Publié: (2025)