:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Xu, Shiyun, Bu, Zhiqi
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2505.12579
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Hessian-informed hyperparameter optimization for differential learning rate
by: Xu, Shiyun, et al.
Published: (2025)

Gradient descent with generalized Newton's method
by: Bu, Zhiqi, et al.
Published: (2024)

Convex Dominance in Deep Learning I: A Scaling Law of Loss and Learning Rate
by: Bu, Zhiqi, et al.
Published: (2026)

Quantum-PEFT: Ultra parameter-efficient fine-tuning
by: Koike-Akino, Toshiaki, et al.
Published: (2025)

AdaFish: Fast low-rank parameter-efficient fine-tuning by using second-order information
by: Hu, Jiang, et al.
Published: (2024)

Scaling depth capacity via zero/one-layer model expansion
by: Bu, Zhiqi
Published: (2025)

LayerNorm: A key component in parameter-efficient fine-tuning
by: ValizadehAslani, Taha, et al.
Published: (2024)

GeoLoRA: Geometric integration for parameter efficient fine-tuning
by: Schotthöfer, Steffen, et al.
Published: (2024)

Efficient and Private: Memorisation under differentially private parameter-efficient fine-tuning in language models
by: Ma, Olivia, et al.
Published: (2024)

AdaGradSelect: An adaptive gradient-guided layer selection method for efficient fine-tuning of SLMs
by: Kumar, Anshul, et al.
Published: (2025)

Differentially Private Bias-Term Fine-tuning of Foundation Models
by: Bu, Zhiqi, et al.
Published: (2022)

FLoRA: Fused forward-backward adapters for parameter efficient fine-tuning and reducing inference-time latencies of LLMs
by: Gowda, Dhananjaya, et al.
Published: (2025)

Train on Validation (ToV): Fast data selection with applications to fine-tuning
by: Jain, Ayush, et al.
Published: (2025)

Multi-task retriever fine-tuning for domain-specific and efficient RAG
by: Béchard, Patrice, et al.
Published: (2025)

Autotune: fast, accurate, and automatic tuning parameter selection for Lasso
by: Sadhukhan, Tathagata, et al.
Published: (2025)

Entropy-guided sequence weighting for efficient exploration in RL-based LLM fine-tuning
by: Vanlioglu, Abdullah
Published: (2025)

PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularization
by: Ni, Yao, et al.
Published: (2024)

LIFT: Interpretable truck driving risk prediction with literature-informed fine-tuned LLMs
by: Hu, Xiao, et al.
Published: (2025)

Sharp Trade-Offs in High-Dimensional Inference via 2-Level SLOPE
by: Bu, Zhiqi, et al.
Published: (2025)

Complexity-aware fine-tuning
by: Goncharov, Andrey, et al.
Published: (2025)

Physics-informed fine-tuning of foundation models for partial differential equations
by: Medvedev, Vlad, et al.
Published: (2026)

Towards hyperparameter-free optimization with differential privacy
by: Bu, Zhiqi, et al.
Published: (2025)

Does fine-tuning GPT-3 with the OpenAI API leak personally-identifiable information?
by: Sun, Albert Yu, et al.
Published: (2023)

LLMs for energy and macronutrients estimation using only text data from 24-hour dietary recalls: a parameter-efficient fine-tuning experiment using a 10-shot prompt
by: Carrillo-Larco, Rodrigo M
Published: (2025)

Learning from models beyond fine-tuning
by: Zheng, Hongling, et al.
Published: (2023)

DOPPLER: Differentially Private Optimizers with Low-pass Filter for Privacy Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks
by: Jain, Samyak, et al.
Published: (2023)

Adaptive Bandit Algorithms for Contextual Matching Markets
by: Lin, Shiyun, et al.
Published: (2026)

Hessian-informed machine learning interatomic potential towards bridging theory and experiments
by: Yin, Bangchen, et al.
Published: (2026)

Replaying pre-training data improves fine-tuning
by: Kotha, Suhas, et al.
Published: (2026)

Empirical influence functions to understand the logic of fine-tuning
by: Matelsky, Jordan K., et al.
Published: (2024)

On fine-tuning Boltz-2 for protein-protein affinity prediction
by: King, James, et al.
Published: (2025)

Anti-aliasing of neural distortion effects via model fine tuning
by: Carson, Alistair, et al.
Published: (2025)

Avoiding mode collapse in diffusion models fine-tuned with reinforcement learning
by: Barceló, Roberto, et al.
Published: (2024)

ReALLM: A general framework for LLM compression and fine-tuning
by: Leconte, Louis, et al.
Published: (2024)

Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach
by: Zhang, Xinwei, et al.
Published: (2023)

Reliable and efficient inverse analysis using physics-informed neural networks with normalized distance functions and adaptive weight tuning
by: Deguchi, Shota, et al.
Published: (2025)

Hybrid diffusion models: combining supervised and generative pretraining for label-efficient fine-tuning of segmentation models
by: Sauvalle, Bruno, et al.
Published: (2024)

Fast Unconstrained Optimization via Hessian Averaging and Adaptive Gradient Sampling Methods
by: O'Leary-Roseberry, Thomas, et al.
Published: (2024)

Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs
by: Zhong, Ziqian, et al.
Published: (2025)