Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs
Fuente:
arXiv
Guardado en:
| Autores principales: | Panda, Ashwinee, Isik, Berivan, Qi, Xiangyu, Koyejo, Sanmi, Weissman, Tsachy, Mittal, Prateek |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
On Fairness of Low-Rank Adaptation of Large Models
por: Ding, Zhoujie, et al.
Publicado: (2024)
por: Ding, Zhoujie, et al.
Publicado: (2024)
Teach LLMs to Phish: Stealing Private Information from Language Models
por: Panda, Ashwinee, et al.
Publicado: (2024)
por: Panda, Ashwinee, et al.
Publicado: (2024)
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
por: Zhang, Juzheng, et al.
Publicado: (2025)
por: Zhang, Juzheng, et al.
Publicado: (2025)
Adaptive Compression in Federated Learning via Side Information
por: Isik, Berivan, et al.
Publicado: (2023)
por: Isik, Berivan, et al.
Publicado: (2023)
KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models
por: Yuan, Fei, et al.
Publicado: (2024)
por: Yuan, Fei, et al.
Publicado: (2024)
The Inadequacy of Offline LLM Evaluations: A Need to Account for Personalization in Model Behavior
por: Wang, Angelina, et al.
Publicado: (2025)
por: Wang, Angelina, et al.
Publicado: (2025)
GaussianVision: Vision-Language Alignment from Compressed Image Representations using 2D Gaussian Splatting
por: Omri, Yasmine, et al.
Publicado: (2025)
por: Omri, Yasmine, et al.
Publicado: (2025)
HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialogue
por: Iyer, Laya, et al.
Publicado: (2026)
por: Iyer, Laya, et al.
Publicado: (2026)
Scaling Laws for Downstream Task Performance of Large Language Models
por: Isik, Berivan, et al.
Publicado: (2024)
por: Isik, Berivan, et al.
Publicado: (2024)
Why Do Safety Guardrails Degrade Across Languages?
por: Zhang, Max, et al.
Publicado: (2026)
por: Zhang, Max, et al.
Publicado: (2026)
Logits are All We Need to Adapt Closed Models
por: Hiranandani, Gaurush, et al.
Publicado: (2025)
por: Hiranandani, Gaurush, et al.
Publicado: (2025)
Extracting books from production language models
por: Ahmed, Ahmed, et al.
Publicado: (2026)
por: Ahmed, Ahmed, et al.
Publicado: (2026)
Differentially Private Adaptation of Diffusion Models via Noisy Aggregated Embeddings
por: Peetathawatchai, Pura, et al.
Publicado: (2024)
por: Peetathawatchai, Pura, et al.
Publicado: (2024)
Alignment-Constrained Dynamic Pruning for LLMs: Identifying and Preserving Alignment-Critical Circuits
por: Patel, Dev, et al.
Publicado: (2025)
por: Patel, Dev, et al.
Publicado: (2025)
Reliable and Efficient Amortized Model-based Evaluation
por: Truong, Sang, et al.
Publicado: (2025)
por: Truong, Sang, et al.
Publicado: (2025)
A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization
por: Panda, Ashwinee, et al.
Publicado: (2022)
por: Panda, Ashwinee, et al.
Publicado: (2022)
Safety Alignment Should Be Made More Than Just a Few Tokens Deep
por: Qi, Xiangyu, et al.
Publicado: (2024)
por: Qi, Xiangyu, et al.
Publicado: (2024)
Private Fine-tuning of Large Language Models with Zeroth-order Optimization
por: Tang, Xinyu, et al.
Publicado: (2024)
por: Tang, Xinyu, et al.
Publicado: (2024)
From Passive to Active Reasoning: Can Large Language Models Ask the Right Questions under Incomplete Information?
por: Zhou, Zhanke, et al.
Publicado: (2025)
por: Zhou, Zhanke, et al.
Publicado: (2025)
The Model Hears You: Audio Language Model Deployments Should Consider the Principle of Least Privilege
por: He, Luxi, et al.
Publicado: (2025)
por: He, Luxi, et al.
Publicado: (2025)
In-Situ Behavioral Evaluation for LLM Fairness, Not Standardized-Test Scores
por: Tang, Zeyu, et al.
Publicado: (2026)
por: Tang, Zeyu, et al.
Publicado: (2026)
CURE: Cultural Understanding and Reasoning Evaluation - A Framework for "Thick" Culture Alignment Evaluation in LLMs
por: Vo, Truong, et al.
Publicado: (2025)
por: Vo, Truong, et al.
Publicado: (2025)
Lean-ing on Quality: How High-Quality Data Beats Diverse Multilingual Data in AutoFormalization
por: Chan, Willy, et al.
Publicado: (2025)
por: Chan, Willy, et al.
Publicado: (2025)
Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
por: Wei, Boyi, et al.
Publicado: (2024)
por: Wei, Boyi, et al.
Publicado: (2024)
Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updates
por: Yamaguchi, Atsuki, et al.
Publicado: (2025)
por: Yamaguchi, Atsuki, et al.
Publicado: (2025)
On the Sparsity of the Strong Lottery Ticket Hypothesis
por: Natale, Emanuele, et al.
Publicado: (2024)
por: Natale, Emanuele, et al.
Publicado: (2024)
SATBench: Benchmarking LLMs' Logical Reasoning via Automated Puzzle Generation from SAT Formulas
por: Wei, Anjiang, et al.
Publicado: (2025)
por: Wei, Anjiang, et al.
Publicado: (2025)
ZIP-FIT: Embedding-Free Data Selection via Compression-Based Alignment
por: Obbad, Elyas, et al.
Publicado: (2024)
por: Obbad, Elyas, et al.
Publicado: (2024)
Quantifying the Importance of Data Alignment in Downstream Model Performance
por: Chawla, Krrish, et al.
Publicado: (2025)
por: Chawla, Krrish, et al.
Publicado: (2025)
Is Pre-training Truly Better Than Meta-Learning?
por: Miranda, Brando, et al.
Publicado: (2023)
por: Miranda, Brando, et al.
Publicado: (2023)
Uncovering Critical Features for Deepfake Detection through the Lottery Ticket Hypothesis
por: Amin, Lisan Al, et al.
Publicado: (2025)
por: Amin, Lisan Al, et al.
Publicado: (2025)
Adding Chocolate to Mint: Mitigating Metric Interference in Machine Translation
por: Pombal, José, et al.
Publicado: (2025)
por: Pombal, José, et al.
Publicado: (2025)
Investigating Data Contamination for Pre-training Language Models
por: Jiang, Minhao, et al.
Publicado: (2024)
por: Jiang, Minhao, et al.
Publicado: (2024)
Do LLMs Follow Their Own Rules? A Reflexive Audit of Self-Stated Safety Policies
por: Mittal, Avni
Publicado: (2026)
por: Mittal, Avni
Publicado: (2026)
Privacy Auditing of Large Language Models
por: Panda, Ashwinee, et al.
Publicado: (2025)
por: Panda, Ashwinee, et al.
Publicado: (2025)
Mind the Confidence Gap: Overconfidence, Calibration, and Distractor Effects in Large Language Models
por: Chhikara, Prateek
Publicado: (2025)
por: Chhikara, Prateek
Publicado: (2025)
The Sound of Syntax: Finetuning and Comprehensive Evaluation of Language Models for Speech Pathology
por: Patel, Fagun, et al.
Publicado: (2025)
por: Patel, Fagun, et al.
Publicado: (2025)
Beyond Scale: The Diversity Coefficient as a Data Quality Metric for Variability in Natural Language Data
por: Miranda, Brando, et al.
Publicado: (2023)
por: Miranda, Brando, et al.
Publicado: (2023)
Does Safety Training of LLMs Generalize to Semantically Related Natural Prompts?
por: Addepalli, Sravanti, et al.
Publicado: (2024)
por: Addepalli, Sravanti, et al.
Publicado: (2024)
LOTUS: Improving Transformer Efficiency with Sparsity Pruning and Data Lottery Tickets
por: Upadhyay, Ojasw
Publicado: (2024)
por: Upadhyay, Ojasw
Publicado: (2024)
Ejemplares similares
-
On Fairness of Low-Rank Adaptation of Large Models
por: Ding, Zhoujie, et al.
Publicado: (2024) -
Teach LLMs to Phish: Stealing Private Information from Language Models
por: Panda, Ashwinee, et al.
Publicado: (2024) -
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
por: Zhang, Juzheng, et al.
Publicado: (2025) -
Adaptive Compression in Federated Learning via Side Information
por: Isik, Berivan, et al.
Publicado: (2023) -
KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models
por: Yuan, Fei, et al.
Publicado: (2024)