Cover Image

Low-rank finetuning for LLMs: A fairness perspective

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Das, Saswat, Romanelli, Marco, Tran, Cuong, Reza, Zarreen, Kailkhura, Bhavya, Fioretto, Ferdinando
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

NeuroFilter: Privacy Guardrails for Conversational LLM Agents
by: Das, Saswat, et al.
Published: (2026)

Disparate Impact on Group Accuracy of Linearization for Private Inference
by: Das, Saswat, et al.
Published: (2024)

Beyond Jailbreaking: Auditing Contextual Privacy in LLM Agents
by: Das, Saswat, et al.
Published: (2025)

Decision Making with Differential Privacy under a Fairness Lens
by: Fioretto, Ferdinando, et al.
Published: (2021)

The Data Minimization Principle in Machine Learning
by: Ganesh, Prakhar, et al.
Published: (2024)

Constrained Discrete Diffusion
by: Cardei, Michael, et al.
Published: (2025)

UProp: Investigating the Uncertainty Propagation of LLMs in Multi-Step Agentic Decision-Making
by: Duan, Jinhao, et al.
Published: (2025)

LLM Unlearning Reveals a Stronger-Than-Expected Coreset Effect in Current Benchmarks
by: Pal, Soumyadeep, et al.
Published: (2025)

The Disparate Impacts of Speculative Decoding
by: Sandler, Jameson, et al.
Published: (2025)

GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations
by: Duan, Jinhao, et al.
Published: (2024)

On The Fairness Impacts of Hardware Selection in Machine Learning
by: Nelaturu, Sree Harsha, et al.
Published: (2023)

Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
by: Christopher, Jacob K, et al.
Published: (2024)

Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs
by: Betley, Jan, et al.
Published: (2025)

Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models
by: Duan, Jinhao, et al.
Published: (2023)

On the generalization of language models from in-context learning and finetuning: a controlled study
by: Lampinen, Andrew K., et al.
Published: (2025)

PreFT: Prefill-only finetuning for efficient inference
by: Lanpouthakoun, Andrew, et al.
Published: (2026)

AGR: Age Group fairness Reward for Bias Mitigation in LLMs
by: Cao, Shuirong, et al.
Published: (2024)

Badllama 3: removing safety finetuning from Llama 3 in minutes
by: Volkov, Dmitrii
Published: (2024)

Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence
by: McLeish, Sean, et al.
Published: (2025)

Transformers Learn Low Sensitivity Functions: Investigations and Implications
by: Vasudeva, Bhavya, et al.
Published: (2024)

Colosseum: Auditing Collusion in Cooperative Multi-Agent Systems
by: Nakamura, Mason, et al.
Published: (2026)

Learning Fair Ranking Policies via Differentiable Optimization of Ordered Weighted Averages
by: Dinh, My H., et al.
Published: (2024)

Scalable LLM Reasoning Acceleration with Low-rank Distillation
by: Dong, Harry, et al.
Published: (2025)

Shears: Unstructured Sparsity with Neural Low-rank Adapter Search
by: Muñoz, J. Pablo, et al.
Published: (2024)

Low-rank Optimization Trajectories Modeling for LLM RLVR Acceleration
by: Chen, Zhipeng, et al.
Published: (2026)

Differentially Private Data Release on Graphs: Inefficiencies and Unfairness
by: Fioretto, Ferdinando, et al.
Published: (2024)

Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processes
by: Ko, Joonhyuk, et al.
Published: (2024)

In-Context Occam's Razor: How Transformers Prefer Simpler Hypotheses on the Fly
by: Deora, Puneesh, et al.
Published: (2025)

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
by: Phan, Phuc, et al.
Published: (2024)

HiSpec: Hierarchical Speculative Decoding for LLMs
by: Kumar, Avinash, et al.
Published: (2025)

Chopping Trees: Semantic Similarity Based Dynamic Pruning for Tree-of-Thought Reasoning
by: Kim, Joongho, et al.
Published: (2025)

Improving Robustness In Sparse Autoencoders via Masked Regularization
by: Narayanaswamy, Vivek, et al.
Published: (2026)

Low-Rank Quantization-Aware Training for LLMs
by: Bondarenko, Yelysei, et al.
Published: (2024)

LoRA Fine-Tuning Without GPUs: A CPU-Efficient Meta-Generation Framework for LLMs
by: Arabpour, Reza, et al.
Published: (2025)

LoRMA: Low-Rank Multiplicative Adaptation for LLMs
by: Bihany, Harsh, et al.
Published: (2025)

Discrete-Guided Diffusion for Scalable and Safe Multi-Robot Motion Planning
by: Liang, Jinhao, et al.
Published: (2025)

Simulation-Informed Diffusion for Decentralized Multi-robot Motion Planning
by: Liang, Jinhao, et al.
Published: (2026)

SCALPEL: Selective Capability Ablation via Low-rank Parameter Editing for Large Language Model Interpretability Analysis
by: Fu, Zihao, et al.
Published: (2026)

Training Dynamics of Transformers to Recognize Word Co-occurrence via Gradient Flow Analysis
by: Yang, Hongru, et al.
Published: (2024)

Simple Self-Conditioning Adaptation for Masked Diffusion Models
by: Cardei, Michael, et al.
Published: (2026)