Decision Transformer: Unifying sequence modelling and model-free, offline RL
"Decision Transformer: Reinforcement Learning via Sequence Modeling" - Research Paper Explained
Decision Transformer casts offline reinforcement learning (RL) as conditional sequence modeling. A causally masked GPT-style Transformer predicts each action from a desired return-to-go, the current state, and the recent trajectory. It avoids value-function bootstrapping and policy-gradient optimization during training, yet matches or exceeds several strong offline RL baselines on the benchmarks studied in the paper.
more ...
Michał Chromiak's blog