Psychologists tend to rely on verbal descriptions of the environment over time, using terms like ‘unpredictable’, ‘variable’, and ‘unstable’. These terms are often open to different interpretations. This ambiguity blurs the match between constructs and measures, which creates confusion and inconsistency across studies. To better characterize the environment, the field needs a shared framework that organizes descriptions of the environment over time in clear terms: as statistical definitions. Here we first present such a framework, drawing on theory developed in other disciplines, such as biology, anthropology, ecology, and economics. Then we apply our framework by quantifying ‘unpredictability’ in a publicly available, longitudinal dataset of crime rates in New York City across 15 years. This case study shows that the correlations between different ‘unpredictability statistics’ across regions are only moderate. This means that regions within NYC rank differently on unpredictability depending on which definition is used and at which spatial scale statistics are computed. Additionally, we explore associations between unpredictability statistics and measures of unemployment, poverty, and educational attainment derived from publicly available NYC survey data. In our case study, these measures are associated with mean levels in crime rates but hardly with unpredictability in crime rates. Our case study illustrates the merits of using a formal framework for disentangling different properties of the environment. To facilitate use of our framework, we provide a friendly, step-by-step guide for identifying the structure of the environment in repeated measures datasets.