Dynamic optimization with side information

•We develop an approach for incorporating side information into dynamic optimization.•Our approach combines robust optimization with non-parametric machine learning methods.•We prove a new Wasserstein measure concentration result with machine learning.•We use our result to prove that the proposed approach is asymptotically optimal.•Our approach can be tractably approximated using overlapping linear decision rules.