We are looking at transformer models for time series prediction that incorporate exponential smoothing.