Applying MambaAttention, TabPFN, and TabTransformers to Classify SAE Automation Levels in Crashes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Somvanshi, Shriyank, Tusti, Anannya Ghosh, Mimi, Mahmuda Sultana, Islam, Md Monzurul, Polock, Sazzad Bin Bashar, Dutta, Anandi, Das, Subasish
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912412638117888
author Somvanshi, Shriyank
Tusti, Anannya Ghosh
Mimi, Mahmuda Sultana
Islam, Md Monzurul
Polock, Sazzad Bin Bashar
Dutta, Anandi
Das, Subasish
author_facet Somvanshi, Shriyank
Tusti, Anannya Ghosh
Mimi, Mahmuda Sultana
Islam, Md Monzurul
Polock, Sazzad Bin Bashar
Dutta, Anandi
Das, Subasish
contents The increasing presence of automated vehicles (AVs) presents new challenges for crash classification and safety analysis. Accurately identifying the SAE automation level involved in each crash is essential to understanding crash dynamics and system accountability. However, existing approaches often overlook automation-specific factors and lack model sophistication to capture distinctions between different SAE levels. To address this gap, this study evaluates the performance of three advanced tabular deep learning models MambaAttention, TabPFN, and TabTransformer for classifying SAE automation levels using structured crash data from Texas (2024), covering 4,649 cases categorized as Assisted Driving (SAE Level 1), Partial Automation (SAE Level 2), and Advanced Automation (SAE Levels 3-5 combined). Following class balancing using SMOTEENN, the models were trained and evaluated on a unified dataset of 7,300 records. MambaAttention demonstrated the highest overall performance (F1-scores: 88% for SAE 1, 97% for SAE 2, and 99% for SAE 3-5), while TabPFN excelled in zero-shot inference with high robustness for rare crash categories. In contrast, TabTransformer underperformed, particularly in detecting Partial Automation crashes (F1-score: 55%), suggesting challenges in modeling shared human-system control dynamics. These results highlight the capability of deep learning models tailored for tabular data to enhance the accuracy and efficiency of automation-level classification. Integrating such models into crash analysis frameworks can support policy development, AV safety evaluation, and regulatory decisions, especially in distinguishing high-risk conditions for mid- and high-level automation technologies.
format Preprint
id arxiv_https___arxiv_org_abs_2506_03160
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Applying MambaAttention, TabPFN, and TabTransformers to Classify SAE Automation Levels in Crashes
Somvanshi, Shriyank
Tusti, Anannya Ghosh
Mimi, Mahmuda Sultana
Islam, Md Monzurul
Polock, Sazzad Bin Bashar
Dutta, Anandi
Das, Subasish
Machine Learning
The increasing presence of automated vehicles (AVs) presents new challenges for crash classification and safety analysis. Accurately identifying the SAE automation level involved in each crash is essential to understanding crash dynamics and system accountability. However, existing approaches often overlook automation-specific factors and lack model sophistication to capture distinctions between different SAE levels. To address this gap, this study evaluates the performance of three advanced tabular deep learning models MambaAttention, TabPFN, and TabTransformer for classifying SAE automation levels using structured crash data from Texas (2024), covering 4,649 cases categorized as Assisted Driving (SAE Level 1), Partial Automation (SAE Level 2), and Advanced Automation (SAE Levels 3-5 combined). Following class balancing using SMOTEENN, the models were trained and evaluated on a unified dataset of 7,300 records. MambaAttention demonstrated the highest overall performance (F1-scores: 88% for SAE 1, 97% for SAE 2, and 99% for SAE 3-5), while TabPFN excelled in zero-shot inference with high robustness for rare crash categories. In contrast, TabTransformer underperformed, particularly in detecting Partial Automation crashes (F1-score: 55%), suggesting challenges in modeling shared human-system control dynamics. These results highlight the capability of deep learning models tailored for tabular data to enhance the accuracy and efficiency of automation-level classification. Integrating such models into crash analysis frameworks can support policy development, AV safety evaluation, and regulatory decisions, especially in distinguishing high-risk conditions for mid- and high-level automation technologies.
title Applying MambaAttention, TabPFN, and TabTransformers to Classify SAE Automation Levels in Crashes
topic Machine Learning
url https://arxiv.org/abs/2506.03160