Saved in:
Bibliographic Details
Main Authors: Tang, Boyan, Zeng, Yilong, Ren, Xuanhao, Xiao, Peng, Zhao, Yuhan, Lee, Raymond, Wu, Jianghua
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.06273
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908639110889472
author Tang, Boyan
Zeng, Yilong
Ren, Xuanhao
Xiao, Peng
Zhao, Yuhan
Lee, Raymond
Wu, Jianghua
author_facet Tang, Boyan
Zeng, Yilong
Ren, Xuanhao
Xiao, Peng
Zhao, Yuhan
Lee, Raymond
Wu, Jianghua
contents Accurate prediction of financial and electricity markets, especially under extreme conditions, remains a significant challenge due to their intrinsic nonlinearity, rapid fluctuations, and chaotic patterns. To address these limitations, we propose the Chaotic Oscillatory Transformer Network (COTN). COTN innovatively combines a Transformer architecture with a novel Lee Oscillator activation function, processed through Max-over-Time pooling and a lambda-gating mechanism. This design is specifically tailored to effectively capture chaotic dynamics and improve responsiveness during periods of heightened volatility, where conventional activation functions (e.g., ReLU, GELU) tend to saturate. Furthermore, COTN incorporates an Autoencoder Self-Regressive (ASR) module to detect and isolate abnormal market patterns, such as sudden price spikes or crashes, thereby preventing corruption of the core prediction process and enhancing robustness. Extensive experiments across electricity spot markets and financial markets demonstrate the practical applicability and resilience of COTN. Our approach outperforms state-of-the-art deep learning models like Informer by up to 17% and traditional statistical methods like GARCH by as much as 40%. These results underscore COTN's effectiveness in navigating real-world market uncertainty and complexity, offering a powerful tool for forecasting highly volatile systems under duress.
format Preprint
id arxiv_https___arxiv_org_abs_2511_06273
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle COTN: A Chaotic Oscillatory Transformer Network for Complex Volatile Systems under Extreme Conditions
Tang, Boyan
Zeng, Yilong
Ren, Xuanhao
Xiao, Peng
Zhao, Yuhan
Lee, Raymond
Wu, Jianghua
Machine Learning
Artificial Intelligence
Accurate prediction of financial and electricity markets, especially under extreme conditions, remains a significant challenge due to their intrinsic nonlinearity, rapid fluctuations, and chaotic patterns. To address these limitations, we propose the Chaotic Oscillatory Transformer Network (COTN). COTN innovatively combines a Transformer architecture with a novel Lee Oscillator activation function, processed through Max-over-Time pooling and a lambda-gating mechanism. This design is specifically tailored to effectively capture chaotic dynamics and improve responsiveness during periods of heightened volatility, where conventional activation functions (e.g., ReLU, GELU) tend to saturate. Furthermore, COTN incorporates an Autoencoder Self-Regressive (ASR) module to detect and isolate abnormal market patterns, such as sudden price spikes or crashes, thereby preventing corruption of the core prediction process and enhancing robustness. Extensive experiments across electricity spot markets and financial markets demonstrate the practical applicability and resilience of COTN. Our approach outperforms state-of-the-art deep learning models like Informer by up to 17% and traditional statistical methods like GARCH by as much as 40%. These results underscore COTN's effectiveness in navigating real-world market uncertainty and complexity, offering a powerful tool for forecasting highly volatile systems under duress.
title COTN: A Chaotic Oscillatory Transformer Network for Complex Volatile Systems under Extreme Conditions
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2511.06273