Saved in:
Bibliographic Details
Main Authors: Wang, Shuhuan, Xie, Yuzhen, Li, Jiayi, Diao, Yinliang
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.23068
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912793327828992
author Wang, Shuhuan
Xie, Yuzhen
Li, Jiayi
Diao, Yinliang
author_facet Wang, Shuhuan
Xie, Yuzhen
Li, Jiayi
Diao, Yinliang
contents Selective State Space Models (SSMs) achieve linear-time inference, yet their gradient-based sensitivity analysis remains bottlenecked by O(L) memory scaling during backpropagation. This memory constraint precludes genomic-scale modeling (L > 10^5) on consumer-grade hardware. We introduce Phase Gradient Flow (PGF), a framework that computes exact analytical derivatives by operating directly in the state-space manifold, bypassing the need to materialize the intermediate computational graph. By reframing SSM dynamics as Tiled Operator-Space Evolution (TOSE), our method delivers O(1) memory complexity relative to sequence length, yielding a 94% reduction in peak VRAM and a 23x increase in throughput compared to standard Autograd. Unlike parallel prefix scans that exhibit numerical divergence in stiff ODE regimes, PGF ensures stability through invariant error scaling, maintaining near-machine precision across extreme sequences. We demonstrate the utility of PGF on an impulse-response benchmark with 128,000-step sequences - a scale where conventional Autograd encounters prohibitive memory overhead, often leading to out-of-memory (OOM) failures in multi-layered models. Our work enables chromosome-scale sensitivity analysis on a single GPU, bridging the gap between theoretical infinite-context models and practical hardware limitations.
format Preprint
id arxiv_https___arxiv_org_abs_2512_23068
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Breaking the Memory Wall: Exact Analytical Differentiation via Tiled Operator-Space Evolution
Wang, Shuhuan
Xie, Yuzhen
Li, Jiayi
Diao, Yinliang
Machine Learning
Selective State Space Models (SSMs) achieve linear-time inference, yet their gradient-based sensitivity analysis remains bottlenecked by O(L) memory scaling during backpropagation. This memory constraint precludes genomic-scale modeling (L > 10^5) on consumer-grade hardware. We introduce Phase Gradient Flow (PGF), a framework that computes exact analytical derivatives by operating directly in the state-space manifold, bypassing the need to materialize the intermediate computational graph. By reframing SSM dynamics as Tiled Operator-Space Evolution (TOSE), our method delivers O(1) memory complexity relative to sequence length, yielding a 94% reduction in peak VRAM and a 23x increase in throughput compared to standard Autograd. Unlike parallel prefix scans that exhibit numerical divergence in stiff ODE regimes, PGF ensures stability through invariant error scaling, maintaining near-machine precision across extreme sequences. We demonstrate the utility of PGF on an impulse-response benchmark with 128,000-step sequences - a scale where conventional Autograd encounters prohibitive memory overhead, often leading to out-of-memory (OOM) failures in multi-layered models. Our work enables chromosome-scale sensitivity analysis on a single GPU, bridging the gap between theoretical infinite-context models and practical hardware limitations.
title Breaking the Memory Wall: Exact Analytical Differentiation via Tiled Operator-Space Evolution
topic Machine Learning
url https://arxiv.org/abs/2512.23068