We establish theoretical results about the low frequency contamination (i.e., long memory effects) induced by general nonstationarity for estimates such as the sample autocovariance and the periodogram, and deduce consequences for heteroskedasticity and autocorrelation robust (HAR) inference. We present explicit expressions for the asymptotic bias of these estimates. We show theoretically that nonparametric smoothing over time is robust to low frequency contamination. Nonstationarity can have consequences for both the size and power of HAR tests. Under the null hypothesis there are larger size distortions than when data are stationary. Under the alternative hypothesis, existing LRV estimators tend to be inflated and HAR tests can exhibit dramatic power losses. Our theory indicates that long bandwidths or fixed-b HAR tests suffer more from low frequency contamination relative to HAR tests based on HAC estimators, whereas recently introduced double kernel HAC estimators do not suffer from this problem. We present second-order Edgeworth expansions under nonstationarity about the distribution of HAC and DK-HAC estimators and about the corresponding t-test in the regression model. The results show that the distortions in the rejection rates can be induced by time variation in the second moments even when there is no break in the mean.