Cover Image

Understanding the Training and Generalization of Pretrained Transformer for Sequential Decision Making

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Hanzhao, Pan, Yu, Sun, Fupeng, Liu, Shang, Talluri, Kalyan, Chen, Guanting, Li, Xiaocheng
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

OMGPT: A Sequence Modeling Framework for Data-driven Operational Decision Making
by: Wang, Hanzhao, et al.
Published: (2025)

Reward Modeling with Ordinal Feedback: Wisdom of the Crowd
by: Liu, Shang, et al.
Published: (2024)

In-Context Curiosity: Distilling Exploration for Decision-Pretrained Transformers on Bandit Tasks
by: Yang, Huitao, et al.
Published: (2025)

Learning to Make Adherence-Aware Advice
by: Chen, Guanting, et al.
Published: (2023)

Risk Profiling and Modulation for LLMs
by: Wang, Yikai, et al.
Published: (2025)

Calibrating an Imperfect Auxiliary Predictor for Unobserved No-Purchase Choice
by: Xiong, Jiangkai, et al.
Published: (2026)

Decision Transformer vs. Decision Mamba: Analysing the Complexity of Sequential Decision Making in Atari Games
by: Yan, Ke
Published: (2024)

Online Sequential Decision-Making with Unknown Delays
by: Wu, Ping, et al.
Published: (2024)

Reinforced Sequential Decision-Making for Sepsis Treatment: The POSNEGDM Framework with Mortality Classifier and Transformer
by: Tamboli, Dipesh, et al.
Published: (2024)

Generative Sequential Notification Optimization via Multi-Objective Decision Transformers
by: Ocejo, Borja, et al.
Published: (2025)

Reward Design for Justifiable Sequential Decision-Making
by: Sukovic, Aleksa, et al.
Published: (2024)

Learning to Sell a Focal‐Ancillary Combination
by: Hanzhao Wang, et al.
Published: (2025)

Translating the Rashomon Effect to Sequential Decision-Making Tasks
by: Gross, Dennis, et al.
Published: (2025)

Beyond Autoregressive RTG: Conditioning via Injection Outside Sequential Modeling in Decision Transformer
by: Wang, Yongyi, et al.
Published: (2026)

When No-Rejection Learning is Consistent for Regression with Rejection
by: Li, Xiaocheng, et al.
Published: (2023)

Optimizing Sensor Redundancy in Sequential Decision-Making Problems
by: Nüßlein, Jonas, et al.
Published: (2024)

Towards Better Understanding of In-Context Learning Ability from In-Context Uncertainty Quantification
by: Liu, Shang, et al.
Published: (2024)

MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology
by: Vasilev, Kiril, et al.
Published: (2025)

Beyond the Known: Decision Making with Counterfactual Reasoning Decision Transformer
by: Nguyen, Minh Hoang, et al.
Published: (2025)

Generative Models in Decision Making: A Survey
by: Shao, Xinyu, et al.
Published: (2025)

VIPER: Visual Perception and Explainable Reasoning for Sequential Decision-Making
by: Aissi, Mohamed Salim, et al.
Published: (2025)

What Matters in Data for DPO?
by: Pan, Yu, et al.
Published: (2025)

Optimal Sequential Decision-Making in Geosteering: A Reinforcement Learning Approach
by: Muhammad, Ressi Bonti, et al.
Published: (2023)

Remembering to Be Fair: Non-Markovian Fairness in Sequential Decision Making
by: Alamdari, Parand A., et al.
Published: (2023)

MoralityGym: A Benchmark for Evaluating Hierarchical Moral Alignment in Sequential Decision-Making Agents
by: Rosen, Simon, et al.
Published: (2026)

A Pretrained Probabilistic Transformer for City-Scale Traffic Volume Prediction
by: Shen, Shiyu, et al.
Published: (2025)

HVAC-DPT: A Decision Pretrained Transformer for HVAC Control
by: Berkes, Anaïs
Published: (2024)

Inner Loop Inference for Pretrained Transformers: Unlocking Latent Capabilities Without Training
by: Lys, Jonathan, et al.
Published: (2026)

Fairness-Aware Reinforcement Learning (FAReL): A Framework for Transparent and Balanced Sequential Decision-Making
by: Cimpean, Alexandra, et al.
Published: (2025)

Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning
by: Zhang, Minmin, et al.
Published: (2026)

Towards Better Statistical Understanding of Watermarking LLMs
by: Cai, Zhongze, et al.
Published: (2024)

Return Augmented Decision Transformer for Off-Dynamics Reinforcement Learning
by: Wang, Ruhan, et al.
Published: (2024)

Self-supervised Pretraining for Decision Foundation Model: Formulation, Pipeline and Challenges
by: Liu, Xiaoqian, et al.
Published: (2023)

It Ain't That Bad: Understanding the Mysterious Performance Drop in OOD Generalization for Generative Transformer Models
by: Xu, Xingcheng, et al.
Published: (2023)

Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making
by: Hsu, Aliyah R., et al.
Published: (2023)

Towards Cost Sensitive Decision Making
by: Li, Yang, et al.
Published: (2024)

What Makes a Good Diffusion Planner for Decision Making?
by: Lu, Haofei, et al.
Published: (2025)

Generative Pre-Trained Transformer for Symbolic Regression Base In-Context Reinforcement Learning
by: Li, Yanjie, et al.
Published: (2024)

Learning a Decision Tree Algorithm with Transformers
by: Zhuang, Yufan, et al.
Published: (2024)

Transformers as Decision Makers: Provable In-Context Reinforcement Learning via Supervised Pretraining
by: Lin, Licong, et al.
Published: (2023)