Numerical systems used for weather and climate predictions have substantially improved over past decades. We argue that despite a continued need for further addressing remaining limitations of their key components, numerical prediction systems have reached a sufficient level of maturity to examine and critically assess the suitability of Earth's current observing systems -remote and in situ, for prediction purposes; and that they can provide evidence-based support for the deployment of future observational networks. We illustrate this point by presenting recent, co-ordinated international efforts focused on Arctic observing systems, led in the framework of the Year of Polar Prediction and the H2020 project APPLICATE. The Arctic, one of the world's most rapidly changing regions, is relatively poorly covered in terms of in situ data but richly covered in terms of satellite data. In this study, we demonstrate that existing state-of-the-art datasets and targeted sensitivity experiments produced with numerical prediction systems can inform us of the added value of existing or even hypothetical Arctic observations, in the context of predictions from hourly to interannual time-scales. Furthermore, we argue that these datasets and experiments can also inform us how the uptake of Arctic observations in numerical prediction systems can be enhanced to maximise predictive skill. Based on these efforts we suggest that (a) conventional in situ observations in the Arctic play a particularly important role in initializing numerical weather forecasts during the This is an open access article under the terms of the Creative Commons Attribution-NonCommercial License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.