Saved in:
Bibliographic Details
Main Authors: Koledoye, Abidemi, Unachukwu, Chinemerem, Nwobu, Gold, Rana, Hasin
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.01237
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915707043708928
author Koledoye, Abidemi
Unachukwu, Chinemerem
Nwobu, Gold
Rana, Hasin
author_facet Koledoye, Abidemi
Unachukwu, Chinemerem
Nwobu, Gold
Rana, Hasin
contents State Space Models (SSMs) have emerged as a promising alternative to Transformers for long-context sequence modeling, offering linear $O(N)$ computational complexity compared to the Transformer's quadratic $O(N^2)$ scaling. This paper presents a comprehensive benchmarking study comparing the Mamba SSM against the LLaMA Transformer on long-context sequences, using dyadic therapy sessions as a representative test case. We evaluate both architectures across two dimensions: (1) computational efficiency, where we measure memory usage and inference speed from 512 to 8,192 tokens, and (2) representational efficiency, where we analyze hidden state dynamics and attention patterns. Our findings provide actionable insights for practitioners working with long-context applications, establishing precise conditions under which SSMs offer advantages over Transformers.
format Preprint
id arxiv_https___arxiv_org_abs_2601_01237
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Benchmarking the Computational and Representational Efficiency of State Space Models against Transformers on Long-Context Dyadic Sessions
Koledoye, Abidemi
Unachukwu, Chinemerem
Nwobu, Gold
Rana, Hasin
Machine Learning
Artificial Intelligence
State Space Models (SSMs) have emerged as a promising alternative to Transformers for long-context sequence modeling, offering linear $O(N)$ computational complexity compared to the Transformer's quadratic $O(N^2)$ scaling. This paper presents a comprehensive benchmarking study comparing the Mamba SSM against the LLaMA Transformer on long-context sequences, using dyadic therapy sessions as a representative test case. We evaluate both architectures across two dimensions: (1) computational efficiency, where we measure memory usage and inference speed from 512 to 8,192 tokens, and (2) representational efficiency, where we analyze hidden state dynamics and attention patterns. Our findings provide actionable insights for practitioners working with long-context applications, establishing precise conditions under which SSMs offer advantages over Transformers.
title Benchmarking the Computational and Representational Efficiency of State Space Models against Transformers on Long-Context Dyadic Sessions
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2601.01237