Programming Backpropagation with Reverse Handlers for Arrows

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sanada, Takahiro, Hoshino, Keisuke, Hirai, Kenshin, Katsumata, Shin-ya
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910027972870144
author Sanada, Takahiro
Hoshino, Keisuke
Hirai, Kenshin
Katsumata, Shin-ya
author_facet Sanada, Takahiro
Hoshino, Keisuke
Hirai, Kenshin
Katsumata, Shin-ya
contents We introduce a new programming language and its categorical semantics in order to design and implement neural networks within the framework of algebraic effects and handlers for arrows. Our language enables us to construct neural networks symbolically, in the same manner as algebraic effects, and to assign implementations -- such as backpropagation computations -- to them via handlers. The advantage of this language design is that network descriptions become abstract and high-level, while implementations can be flexibly assigned to networks. We establish a rigorous foundation for our language by developing a type system, an operational semantics, a categorical semantics, and soundness and adequacy theorems. The technical core is the introduction of \emph{reverse handlers}, a novel handler mechanism for arrows for implementing backpropagation, together with new algebras of strong promonads on reverse differential restriction categories (RDRCs), whose string diagrams provide a formal graphical syntax and semantics for neural networks.
format Preprint
id arxiv_https___arxiv_org_abs_2602_18090
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Programming Backpropagation with Reverse Handlers for Arrows
Sanada, Takahiro
Hoshino, Keisuke
Hirai, Kenshin
Katsumata, Shin-ya
Programming Languages
We introduce a new programming language and its categorical semantics in order to design and implement neural networks within the framework of algebraic effects and handlers for arrows. Our language enables us to construct neural networks symbolically, in the same manner as algebraic effects, and to assign implementations -- such as backpropagation computations -- to them via handlers. The advantage of this language design is that network descriptions become abstract and high-level, while implementations can be flexibly assigned to networks. We establish a rigorous foundation for our language by developing a type system, an operational semantics, a categorical semantics, and soundness and adequacy theorems. The technical core is the introduction of \emph{reverse handlers}, a novel handler mechanism for arrows for implementing backpropagation, together with new algebras of strong promonads on reverse differential restriction categories (RDRCs), whose string diagrams provide a formal graphical syntax and semantics for neural networks.
title Programming Backpropagation with Reverse Handlers for Arrows
topic Programming Languages
url https://arxiv.org/abs/2602.18090