Saved in:
Bibliographic Details
Main Author: Hilsenbek, Kalle
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2406.10906
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929387379621888
author Hilsenbek, Kalle
author_facet Hilsenbek, Kalle
contents Attention-based transformers have become the standard architecture in many deep learning fields, primarily due to their ability to model long-range dependencies and handle variable-length input sequences. However, the attention mechanism with its quadratic complexity is a significant bottleneck in the transformer architecture. This algorithm is only uni-directional in the decoder and converges to a static pattern in over-parametrized decoder-only models. I address this issue by developing a generative function as attention or activation replacement. It still has the auto-regressive character by comparing each token with the previous one. In my test setting with nanoGPT this yields a smaller loss while having a smaller model. The loss further drops by incorporating an average context vector. This concept of attention replacement is distributed under the GNU AGPL v3 license at https://gitlab.com/Bachstelze/causal_generation.
format Preprint
id arxiv_https___arxiv_org_abs_2406_10906
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Breaking the Attention Bottleneck
Hilsenbek, Kalle
Machine Learning
Computation and Language
Attention-based transformers have become the standard architecture in many deep learning fields, primarily due to their ability to model long-range dependencies and handle variable-length input sequences. However, the attention mechanism with its quadratic complexity is a significant bottleneck in the transformer architecture. This algorithm is only uni-directional in the decoder and converges to a static pattern in over-parametrized decoder-only models. I address this issue by developing a generative function as attention or activation replacement. It still has the auto-regressive character by comparing each token with the previous one. In my test setting with nanoGPT this yields a smaller loss while having a smaller model. The loss further drops by incorporating an average context vector. This concept of attention replacement is distributed under the GNU AGPL v3 license at https://gitlab.com/Bachstelze/causal_generation.
title Breaking the Attention Bottleneck
topic Machine Learning
Computation and Language
url https://arxiv.org/abs/2406.10906