We examine the Croatian Kuna, the Czech Koruna, the Hungarian Forint, the Polish Z loty, the Romanian Leu, and the Swedish Krona whether their Euro exchange rates volatility exhibits true or spurious long memory. Recent research reveals long memory in foreign exchange rate volatility and we confirm this finding for these currency pairs by examining the long memory behavior of squared residuals by means of the V/S test. However, by using the ICSS approach we also find structural breaks in the unconditional variance. Literature suggests that structural breaks might lead to spurious long memory behavior. In a refined test strategy, we distinguish true from spurious long memory for the six exchange rates. Our findings suggest that Czech Koruna and Hungarian Forint only feature spurious long memory, while the rest of the series have both structural breaks and true long memory. Lastly, we demonstrate how to extend existing models to jointly model both properties yielding superior fit and better Value-at-Risk forecasts. The results of our work help to avoid misspecification and provide a better understanding of the properties of the foreign exchange rate volatility.