Cover Image

Sequence Length Scaling in Vision Transformers for Scientific Images on Frontier

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tsaris, Aristeidis, Zhang, Chengming, Wang, Xiao, Yin, Junqi, Liu, Siyan, Ashfaq, Moetasim, Fan, Ming, Choi, Jong Youl, Wahib, Mohamed, Lu, Dan, Balaprakash, Prasanna, Wang, Feiyi
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability
by: Wang, Xiao, et al.
Published: (2024)

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models
by: Tsaris, Aristeidis, et al.
Published: (2025)

ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling
by: Wang, Xiao, et al.
Published: (2025)

Pretraining Billion-scale Geospatial Foundational Models on Frontier
by: Tsaris, Aristeidis, et al.
Published: (2024)

Scalable Artificial Intelligence for Science: Perspectives, Methods and Exemplars
by: Brewer, Wesley, et al.
Published: (2024)

SciTrust 2.0: A Comprehensive Framework for Evaluating Trustworthiness of Large Language Models in Scientific Applications
by: Herron, Emily, et al.
Published: (2025)

The (R)evolution of Scientific Workflows in the Agentic AI Era: Towards Autonomous Science
by: Shin, Woong, et al.
Published: (2025)

Scaling Laws of Graph Neural Networks for Atomistic Materials Modeling
by: Li, Chaojian, et al.
Published: (2025)

How does ion temperature gradient turbulence depend on magnetic geometry? Insights from data and machine learning
by: Landreman, Matt, et al.
Published: (2025)

Decoding Memories: An Efficient Pipeline for Self-Consistency Hallucination Detection
by: Gao, Weizhi, et al.
Published: (2025)

FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving
by: Gao, Shouwei, et al.
Published: (2026)

Towards Scaling Law Analysis For Spatiotemporal Weather Data
by: Kiefer, Alexander, et al.
Published: (2026)

Multi-task parallelism for robust pre-training of graph foundation models on multi-source, multi-fidelity atomistic modeling data
by: Pasini, Massimiliano Lupo, et al.
Published: (2025)

Scaling Up Data Parallelism in Decentralized Deep Learning
by: Xie, Bing, et al.
Published: (2025)

Large Language Models Inference Engines based on Spiking Neural Networks
by: Balaji, Adarsha, et al.
Published: (2025)

FOCUS: Fused Observation of Channels for Unveiling Spectra
by: Xiao, Xi, et al.
Published: (2025)

Hierarchical Bayesian approach for adaptive integration of Bragg peaks in time-of-flight neutron scattering data
by: Reshniak, Viktor, et al.
Published: (2024)

Sequence Complementor: Complementing Transformers For Time Series Forecasting with Learnable Sequences
by: Chen, Xiwen, et al.
Published: (2025)

Modulated Diffusion: Accelerating Generative Modeling with Modulated Quantization
by: Gao, Weizhi, et al.
Published: (2025)

Decomposable Transformer Point Processes
by: Panos, Aristeidis
Published: (2024)

Scalable Training of Trustworthy and Energy-Efficient Predictive Graph Foundation Models for Atomistic Materials Modeling: A Case Study with HydraGNN
by: Pasini, Massimiliano Lupo, et al.
Published: (2024)

The Unreasonable Effectiveness Of Early Discarding After One Epoch In Neural Network Hyperparameter Optimization
by: Egele, Romain, et al.
Published: (2024)

Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modeling
by: Abulawi, Zaid, et al.
Published: (2024)

Evaluating the Efficacy of LLM-Based Reasoning for Multiobjective HPC Job Scheduling
by: Jadhav, Prachi, et al.
Published: (2025)

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery
by: Dias, Philipe, et al.
Published: (2024)

RAPTOR: Practical Numerical Profiling of Scientific Applications
by: Hoerold, Faveo, et al.
Published: (2025)

CSI-Inpainter: Enabling Visual Scene Recovery from CSI Time Sequences for Occlusion Removal
by: Chen, Cheng, et al.
Published: (2023)

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics
by: Yin, Junqi, et al.
Published: (2024)

Parallelizing Linear Transformers with the Delta Rule over Sequence Length
by: Yang, Songlin, et al.
Published: (2024)

A Selected and Annotated Guide to Business Reference Sources in the University of Cincinnati Libraries. Reference List in Business and Economics No. 2.
by: Nasrallah, Wahib, Comp.
Published: (1978)

ytopt: Autotuning Scientific Applications for Energy Efficiency at Large Scales
by: Xingfu Wu, et al.
Published: (2024)

SAFE: Improving LLM Systems using Sentence-Level In-generation Attribution
by: Batista, João Eduardo, et al.
Published: (2025)

Balanced and Elastic End-to-end Training of Dynamic LLMs
by: Wahib, Mohamed, et al.
Published: (2025)

Comparative Study of Large Language Model Architectures on Frontier
by: Yin, Junqi, et al.
Published: (2024)

Data-Driven Random Access Optimization in Multi-Cell IoT Networks with NOMA
by: Khairy, Sami, et al.
Published: (2021)

Adaptive Patching for High-resolution Image Segmentation with Transformers
by: Zhang, Enzhi, et al.
Published: (2024)

Instruction-Tuned LLMs for Parsing and Mining Unstructured Logs on Leadership HPC Systems
by: Karimi, Ahmad Maroof, et al.
Published: (2026)

Exploring the Frontiers of Energy Efficiency using Power Management at System Scale
by: Karimi, Ahmad Maroof, et al.
Published: (2024)

Data Readiness for Scientific AI at Scale
by: Brewer, Wesley, et al.
Published: (2025)

ProTransformer: Robustify Transformers via Plug-and-Play Paradigm
by: Hou, Zhichao, et al.
Published: (2024)