Cover Image

Assessing the Impact of Sequence Length Learning on Classification Tasks for Transformer Encoder Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Baillargeon, Jean-Thomas, Lamontagne, Luc
Format:	Preprint
Published:	2022
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Assessing The Impact of CNN Auto Encoder-Based Image Denoising on Image Classification Tasks
by: Hami, Mohsen, et al.
Published: (2024)

Geographic ratemaking with spatial embeddings
by: Blier-Wong, Christopher, et al.
Published: (2021)

Comparative Study on the Performance of Categorical Variable Encoders in Classification and Regression Tasks
by: Zhu, Wenbin, et al.
Published: (2024)

Parallelizing Linear Transformers with the Delta Rule over Sequence Length
by: Yang, Songlin, et al.
Published: (2024)

Memory Sequence Length of Data Sampling Impacts the Adaptation of Meta-Reinforcement Learning Agents
by: Zhang, Menglong, et al.
Published: (2024)

What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks
by: Chen, Xingwu, et al.
Published: (2024)

Automated Classification of Volcanic Earthquakes Using Transformer Encoders: Insights into Data Quality and Model Interpretability
by: Suzuki, Y., et al.
Published: (2025)

The Impact of Feature Scaling In Machine Learning: Effects on Regression and Classification Tasks
by: Pinheiro, João Manoel Herrera, et al.
Published: (2025)

GLiClass: Generalist Lightweight Model for Sequence Classification Tasks
by: Stepanov, Ihor, et al.
Published: (2025)

Sequence Length Scaling in Vision Transformers for Scientific Images on Frontier
by: Tsaris, Aristeidis, et al.
Published: (2024)

Structure-Preserving Transformers for Sequences of SPD Matrices
by: Seraphim, Mathieu, et al.
Published: (2023)

AbbIE: Autoregressive Block-Based Iterative Encoder for Efficient Sequence Modeling
by: Aleksandrov, Preslav, et al.
Published: (2025)

Sequence-to-Image Transformation for Sequence Classification Using Rips Complex Construction and Chaos Game Representation
by: Ali, Sarwan, et al.
Published: (2025)

Learning to Order: Task Sequencing as In-Context Optimization
by: Kobiolka, Jan, et al.
Published: (2026)

Introduction to Sequence Modeling with Transformers
by: Kämäräinen, Joni-Kristian
Published: (2025)

Assessing Episodic Memory in LLMs with Sequence Order Recall Tasks
by: Pink, Mathis, et al.
Published: (2024)

Dual-Encoders for Extreme Multi-Label Classification
by: Gupta, Nilesh, et al.
Published: (2023)

Position Specific Scoring Is All You Need? Revisiting Protein Sequence Classification Tasks
by: Ali, Sarwan, et al.
Published: (2024)

Looped Transformers for Length Generalization
by: Fan, Ying, et al.
Published: (2024)

ParaDySe: A Parallel-Strategy Switching Framework for Dynamic Sequence Lengths in Transformer
by: Ou, Zhixin, et al.
Published: (2025)

Scaling Parallel Sequence Models to Foundation-Scale Vision Encoders
by: Jiang, Yitong, et al.
Published: (2026)

User-Based Sequential Modeling with Transformer Encoders for Insider Threat Detection
by: Elbasheer, Mohamed, et al.
Published: (2025)

HT-Transformer: Event Sequences Classification by Accumulating Prefix Information with History Tokens
by: Karpukhin, Ivan, et al.
Published: (2025)

Variational Graph Auto-Encoder Based Inductive Learning Method for Semi-Supervised Classification
by: Yang, Hanxuan, et al.
Published: (2024)

Adapting Decoder-Based Language Models for Diverse Encoder Downstream Tasks
by: Suganthan, Paul, et al.
Published: (2025)

Exploring Task Performance with Interpretable Models via Sparse Auto-Encoders
by: Wang, Shun, et al.
Published: (2025)

Quantitative Bounds for Length Generalization in Transformers
by: Izzo, Zachary, et al.
Published: (2025)

Transformer Encoder Satisfiability: Complexity and Impact on Formal Reasoning
by: Sälzer, Marco, et al.
Published: (2024)

Gecko: An Efficient Neural Architecture Inherently Processing Sequences with Arbitrary Lengths
by: Ma, Xuezhe, et al.
Published: (2026)

Approximation Rate of the Transformer Architecture for Sequence Modeling
by: Jiang, Haotian, et al.
Published: (2023)

Evaluating the Sensitivity of BiLSTM Forecasting Models to Sequence Length and Input Noise
by: Albelali, Salma, et al.
Published: (2025)

PackMamba: Efficient Processing of Variable-Length Sequences in Mamba training
by: Xu, Haoran, et al.
Published: (2024)

Position Coupling: Improving Length Generalization of Arithmetic Transformers Using Task Structure
by: Cho, Hanseul, et al.
Published: (2024)

Graph Regularized Encoder Training for Extreme Classification
by: Mittal, Anshul, et al.
Published: (2024)

Traditional Machine Learning Models and Bidirectional Encoder Representations From Transformer (BERT)-Based Automatic Classification of Tweets About Eating Disorders: Algorithm Development and Validation Study
by: Benítez-Andrades, José Alberto, et al.
Published: (2024)

Hybrid Adaptive Modeling in Process Monitoring: Leveraging Sequence Encoders and Physics-Informed Neural Networks
by: Elaarabi, Mouad, et al.
Published: (2025)

TEE4EHR: Transformer Event Encoder for Better Representation Learning in Electronic Health Records
by: Karami, Hojjat, et al.
Published: (2024)

Understanding the Expressive Power and Mechanisms of Transformer for Sequence Modeling
by: Wang, Mingze, et al.
Published: (2024)

Emergence and Effectiveness of Task Vectors in In-Context Learning: An Encoder Decoder Perspective
by: Han, Seungwook, et al.
Published: (2024)

Automatic Differential Diagnosis using Transformer-Based Multi-Label Sequence Classification
by: Sadi, Abu Adnan, et al.
Published: (2024)