Cover Image

Vanishing Contributions: A Unified Framework for Smooth and Iterative Model Compression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nikiforos, Lorenzo, Prono, Luciano, Antoniadis, Charalampos, Pareschi, Fabio, Rovatti, Riccardo, Setti, Gianluca
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-Layer Confidence Scoring for Detection of Out-of-Distribution Samples, Adversarial Attacks, and In-Distribution Misclassifications
by: Capelli, Lorenzo, et al.
Published: (2025)

Unsupervised Transcript-assisted Video Summarization and Highlight Detection
by: Barbakos, Spyros, et al.
Published: (2025)

On-board Telemetry Monitoring in Autonomous Satellites: Challenges and Opportunities
by: Capelli, Lorenzo, et al.
Published: (2026)

On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning
by: Arroyo, Álvaro, et al.
Published: (2025)

NoWag: A Unified Framework for Shape Preserving Compression of Large Language Models
by: Liu, Lawrence, et al.
Published: (2025)

RDD: Pareto Analysis of the Rate-Distortion-Distinguishability Trade-off
by: Enttsel, Andriy, et al.
Published: (2025)

Vanishing Feature: Diagnosing Model Merging and Beyond
by: Qu, Xingyu, et al.
Published: (2024)

Predictive Modeling of Homeless Service Assignment: A Representation Learning Approach
by: Rahman, Khandker Sadia, et al.
Published: (2024)

One Shot vs. Iterative: Rethinking Pruning Strategies for Model Compression
by: Janusz, Mikołaj, et al.
Published: (2025)

A Unifying Framework for Learning Argumentation Semantics
by: Mileva, Zlatina, et al.
Published: (2023)

A Universal Banach--Bregman Framework for Stochastic Iterations: Unifying Stochastic Mirror Descent, Learning and LLM Training
by: Zhang, Johnny R., et al.
Published: (2025)

On Vanishing Variance in Transformer Length Generalization
by: Li, Ruining, et al.
Published: (2025)

Mixture of Masters: Sparse Chess Language Models with Player Routing
by: Frisoni, Giacomo, et al.
Published: (2026)

Efficient Deterministic Renewable Energy Forecasting Guided by Multiple-Location Weather Data
by: Symeonidis, Charalampos, et al.
Published: (2024)

Iterative Amortized Inference: Unifying In-Context Learning and Learned Optimizers
by: Mittal, Sarthak, et al.
Published: (2025)

Vanishing Gradients in Reinforcement Finetuning of Language Models
by: Razin, Noam, et al.
Published: (2023)

Iterative Data Smoothing: Mitigating Reward Overfitting and Overoptimization in RLHF
by: Zhu, Banghua, et al.
Published: (2024)

Low-Rank Compression of Pretrained Models via Randomized Subspace Iteration
by: Pourkamali-Anaraki, Farhad
Published: (2026)

From Parameters to Behaviors: Unsupervised Compression of the Policy Space
by: Tenedini, Davide, et al.
Published: (2025)

A Unified Framework for Model Editing
by: Gupta, Akshat, et al.
Published: (2024)

Lessons for Editors of AI Incidents from the AI Incident Database
by: Paeth, Kevin, et al.
Published: (2024)

REMA: A Unified Reasoning Manifold Framework for Interpreting Large Language Model
by: Li, Bo, et al.
Published: (2025)

An Iterative Approach to Topic Modelling
by: Wong, Albert, et al.
Published: (2024)

Vanishing Bias Heuristic-guided Reinforcement Learning Algorithm
by: Li, Qinru, et al.
Published: (2023)

Toward a Unified Lyapunov-Certified ODE Convergence Analysis of Smooth Q-Learning with p-Norms
by: Lee, Donghwan, et al.
Published: (2024)

A Unified Framework for Locality in Scalable MARL
by: Chakraborty, Sourav, et al.
Published: (2026)

From Growing to Looping: A Unified View of Iterative Computation in LLMs
by: Kapl, Ferdinand, et al.
Published: (2026)

UniQL: Unified Quantization and Low-rank Compression for Adaptive Edge LLMs
by: Chiang, Hung-Yueh, et al.
Published: (2025)

EEGAgent: A Unified Framework for Automated EEG Analysis Using Large Language Models
by: Zhao, Sha, et al.
Published: (2025)

Unsupervised Behavioral Compression: Learning Low-Dimensional Policy Manifolds through State-Occupancy Matching
by: Fraschini, Andrea, et al.
Published: (2026)

Mirror Learning: A Unifying Framework of Policy Optimisation
by: Kuba, Jakub Grudzien, et al.
Published: (2022)

A Unified Framework for Heterogeneous Semi-supervised Learning
by: Heidari, Marzi, et al.
Published: (2025)

UGMAE: A Unified Framework for Graph Masked Autoencoders
by: Tian, Yijun, et al.
Published: (2024)

A Unified Invariant Learning Framework for Graph Classification
by: Sui, Yongduo, et al.
Published: (2025)

ChronosAD: Leveraging Time Series Foundation Models for Accurate Anomaly Detection
by: Khan, Uzair, et al.
Published: (2026)

UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration
by: Chen, Xingsheng, et al.
Published: (2026)

How Many Heads Make an SSM? A Unified Framework for Attention and State Space Models
by: Ghodsi, Ali
Published: (2025)

DeepFaith: A Domain-Free and Model-Agnostic Unified Framework for Highly Faithful Explanations
by: Guo, Yuhan, et al.
Published: (2025)

A Unified Industrial Large Knowledge Model Framework in Industry 4.0 and Smart Manufacturing
by: Lee, Jay, et al.
Published: (2023)

A New Approach to Backtracking Counterfactual Explanations: A Unified Causal Framework for Efficient Model Interpretability
by: Fatemi, Pouria, et al.
Published: (2025)