Copertina

Mitigating Task-Order Sensitivity and Forgetting via Hierarchical Second-Order Consolidation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Nag, Protik, Raghavan, Krishnan, Narayanan, Vignesh
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Effective Planning Strategies for Dynamic Opinion Networks
di: Muppasani, Bharath, et al.
Pubblicazione: (2024)

MEGA: Second-Order Gradient Alignment for Catastrophic Forgetting Mitigation in GFSCIL
di: Pang, Jinhui, et al.
Pubblicazione: (2025)

Mitigating Privacy Risk via Forget Set-Free Unlearning
di: Newatia, Aviraj, et al.
Pubblicazione: (2026)

Towards Order Fairness: Mitigating LLMs Order Sensitivity through Dual Group Advantage Optimization
di: Chu, Xu, et al.
Pubblicazione: (2026)

Hierarchical Learning for Maze Navigation: Emergence of Mental Representations via Second-Order Learning
di: Manir, Shalima Binta, et al.
Pubblicazione: (2025)

More Than Memory Savings: Zeroth-Order Optimization Mitigates Forgetting in Continual Learning
di: Yu, Wanhao, et al.
Pubblicazione: (2025)

The Effect of Architecture During Continual Learning
di: Hahn, Allyson, et al.
Pubblicazione: (2026)

The Minimax Rate of Second-Order Calibration
di: Ciosek, Kamil, et al.
Pubblicazione: (2026)

Learning to Forget Attention: Memory Consolidation for Adaptive Compute Reduction
di: Shihab, Ibne Farabi, et al.
Pubblicazione: (2026)

On Understanding of the Dynamics of Model Capacity in Continual Learning
di: Chakraborty, Supriyo, et al.
Pubblicazione: (2025)

The Power of Second Order Methods for Sequence Preconditioning
di: Marsden, Annie, et al.
Pubblicazione: (2026)

Second Order Methods for Bandit Optimization and Control
di: Suggala, Arun, et al.
Pubblicazione: (2024)

FOSI: Hybrid First and Second Order Optimization
di: Sivan, Hadar, et al.
Pubblicazione: (2023)

SCM: Sleep-Consolidated Memory with Algorithmic Forgetting for Large Language Models
di: Shinde, Saish Sachin
Pubblicazione: (2026)

Second-Order Bounds for [0,1]-Valued Regression via Betting Loss
di: Li, Yinan, et al.
Pubblicazione: (2025)

From Order to Distribution: A Spectral Characterization of Forgetting in Continual Learning
di: Xu, Zonghuan, et al.
Pubblicazione: (2026)

Sampling Imbalanced Data with Multi-objective Bilevel Optimization
di: Medlin, Karen, et al.
Pubblicazione: (2025)

Second-Order Uncertainty Quantification: Variance-Based Measures
di: Sale, Yusuf, et al.
Pubblicazione: (2023)

On the Second-Order Convergence of Biased Policy Gradient Algorithms
di: Mu, Siqiao, et al.
Pubblicazione: (2023)

Second-Order Forward-Mode Automatic Differentiation for Optimization
di: Cobb, Adam D., et al.
Pubblicazione: (2024)

Second-Order Tensorial Partial Differential Equations on Graphs
di: Einizade, Aref, et al.
Pubblicazione: (2025)

Optimal Task Order for Continual Learning of Multiple Tasks
di: Li, Ziyan, et al.
Pubblicazione: (2025)

Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer
di: Zhao, Yanjun, et al.
Pubblicazione: (2024)

Why the Brain Consolidates: Predictive Forgetting for Optimal Generalisation
di: Fountas, Zafeirios, et al.
Pubblicazione: (2026)

Forget Less by Learning Together through Concept Consolidation
di: Kaushik, Arjun Ramesh, et al.
Pubblicazione: (2026)

Why Zeroth-Order Adaptation May Forget Less: A Randomized Shaping Theory
di: Shu, Yao, et al.
Pubblicazione: (2026)

Order-based Structure Learning with Normalizing Flows
di: Kamkari, Hamidreza, et al.
Pubblicazione: (2023)

AdaFisher: Adaptive Second Order Optimization via Fisher Information
di: Gomes, Damien Martins, et al.
Pubblicazione: (2024)

Scalable and Resource-Efficient Second-Order Federated Learning via Over-the-Air Aggregation
di: Ghalkha, Abdulmomen, et al.
Pubblicazione: (2024)

Comparing BFGS and OGR for Second-Order Optimization
di: Przybysz, Adrian, et al.
Pubblicazione: (2025)

Estimation and Deconvolution of Second Order Cyclostationary Signals
di: Makienko, Igor, et al.
Pubblicazione: (2024)

Mitigating Catastrophic Forgetting in Language Transfer via Model Merging
di: Alexandrov, Anton, et al.
Pubblicazione: (2024)

Policy Gradient with Second Order Momentum
di: Sun, Tianyu
Pubblicazione: (2025)

Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning
di: Huang, Wei, et al.
Pubblicazione: (2025)

ZEUS: Accelerating Diffusion Models with Only Second-Order Predictor
di: Wang, Yixiao, et al.
Pubblicazione: (2026)

On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width
di: Ishikawa, Satoki, et al.
Pubblicazione: (2023)

Learning to Order: Task Sequencing as In-Context Optimization
di: Kobiolka, Jan, et al.
Pubblicazione: (2026)

FUSE: First-Order and Second-Order Unified SynthEsis in Stochastic Optimization
di: Jiang, Zhanhong, et al.
Pubblicazione: (2025)

Mitigating Forgetting in Low Rank Adaptation
di: Sliwa, Joanna, et al.
Pubblicazione: (2025)

The Effectiveness of Random Forgetting for Robust Generalization
di: Ramkumar, Vijaya Raghavan T, et al.
Pubblicazione: (2024)