Skill assessment of spatial maps for oceanographic modeling

Rose, Kenneth A.; Roth, Brian M.; Smith, Eric P.

doi:10.1016/j.jmarsys.2008.05.013

Cited by 32 publications

(24 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In our study fuzzy kappa values were higher, indicating correspondence between the maps, according to the transitional zone. Rose et al (2009) found that aggregated cells was insensitive to search radius and it gave a higher level of similarity in our examinations as well.…”

Section: Methodological Evaluationsupporting

confidence: 67%

“…linear landscape elements and ecological corridors can be omitted from the analysis). However, distance-based weighting techniques have been considered a promising solution in comparisons (Rose et al 2009). In our study fuzzy kappa values were higher, indicating correspondence between the maps, according to the transitional zone.…”

Section: Methodological Evaluationmentioning

confidence: 99%

See 1 more Smart Citation

Possibilities of land use change analysis in a mountainous rural area: a methodological approach

Szabó

Bertalan

Kerekes

et al. 2015

International Journal of Geographical Information Science

View full text Add to dashboard Cite

Decreasing population density is a current trend in the European Union, and causes a lower environmental impact on the landscape. However, besides the desirable effect on the regeneration processes of semi-natural forest ecosystems, the lack of traditional management techniques can also lead to detrimental ecological processes. In this study we investigated the land use pattern changes in a micro-region (in North-Eastern Hungary) between 1952 and 2005, based on vectorised land use data from archive aerial photos. We also evaluated the methodology of comparisons using GIS methods, fuzzy sets and landscape metrics. We found that both GIS methods and statistical analysis of landscape metrics resulted in more or less the same findings. Differences were not as relevant as was expected considering the general tendencies of the past 60 years in Hungary. The change in the annual rate of forest recovery was 0.12%; settlements extended their area by an annual rate of 3.04%, while grasslands and arable lands had a net loss in their area within the studied period (0.60% and 0.89%, respectively). The kappa index showed a smaller similarity (~60%) between these dates but the fuzzy kappa and the aggregation index, taking into account both spatial and thematic errors, gave a more reliable result (~70-80% similarity). Landscape metrics on patch and class level ensured the possibility of a detailed analysis. We arrived at a similar outcome but were able to verify all the calculations through statistical tests. With this approach we were able to reveal significant (p < 0.05) changes; however, effect sizes did not show large magnitudes. Comparing the methods of revealing landscape change, the approach of landscape metrics was the most effective approach, as it was independent of spatial errors and ensuring a multiple way of interpretation. ARTICLE HISTORY

show abstract

Section: Methodological Evaluationsupporting

confidence: 67%

Section: Methodological Evaluationmentioning

confidence: 99%

Possibilities of land use change analysis in a mountainous rural area: a methodological approach

Szabó

Bertalan

Kerekes

et al. 2015

International Journal of Geographical Information Science

View full text Add to dashboard Cite

show abstract

“…In the typical objective evaluation and intercomparison of these models, a suite of standardized statistical metrics (e.g., correlation, root-mean-squared errors) are applied to quantify differences between modeled and observed variables (e.g., Doney et al, 2009;Rose et al, 2009;Stow et al, 2009;Romanou et al, 2013Romanou et al, , 2014. With the goal of constraining future projections, statistical metrics are often used for model ranking (e.g., Anav et al, 2013), weighting of model projections (e.g., Steinacher et al, 2010) or selection of the most skillful models across a wider ensemble (e.g., Massonnet et al, 2012;Wenzel et al, 2014).…”

Section: Contextmentioning

confidence: 99%

“…For this purpose, several statistical skill score metrics are computed following Rose et al (2009) and Stow et al (2009) from model fields interpolated on a regular 1 • grid and to fixed depth levels. The skill score metrics are (1) the globally averaged concentrations for overall drift; (2) the error or bias between modeled and observed fields at each grid cell; (3) spatial correlation between model and observations to assess mismatches between modeled and observed large-scale structures; (4) the root-mean squared error (RMSE) to assess the total cumulative errors between modeled and observed fields.…”

Section: Approach and Statistical Analysismentioning

confidence: 99%

Inconsistent strategies to spin up models in CMIP5: implications for ocean biogeochemical model performance assessment

et al. 2016

View full text Add to dashboard Cite

Abstract. During the fifth phase of the Coupled Model Intercomparison Project (CMIP5) substantial efforts were made to systematically assess the skill of Earth system models. One goal was to check how realistically representative marine biogeochemical tracer distributions could be reproduced by models. In routine assessments model historical hindcasts were compared with available modern biogeochemical observations. However, these assessments considered neither how close modeled biogeochemical reservoirs were to equilibrium nor the sensitivity of model performance to initial conditions or to the spin-up protocols. Here, we explore how the large diversity in spin-up protocols used for marine biogeochemistry in CMIP5 Earth system models (ESMs) contributes to model-to-model differences in the simulated fields. We take advantage of a 500-year spin-up simulation of IPSL-CM5A-LR to quantify the influence of the spin-up protocol on model ability to reproduce relevant data fields. Amplification of biases in selected biogeochemical fields (O 2 , NO 3 , Alk-DIC) is assessed as a function of spin-up duration. We demonstrate that a relationship between spin-up duration and assessment metrics emerges from our model results and holds when confronted with a larger ensemble of CMIP5 models. This shows that drift has implications for performance assessment in addition to possibly aliasing estimates of climate change impact. Our study suggests that differences in spin-up protocols could explain a substantial part of model disparities, constituting a source of modelto-model uncertainty. This requires more attention in future Published by Copernicus Publications on behalf of the European Geosciences Union. R. Séférian et al.: Inconsistent strategies to spin up models in CMIP5model intercomparison exercises in order to provide quantitatively more correct ESM results on marine biogeochemistry and carbon cycle feedbacks.

show abstract

“…One increasingly pressing topic affecting the modeling com munity as a whole is the requirement for continual and quantitative model validation. Recent publications (Allen and Sommerfield, 2009;Rose et al, 2009;Stow et al, 2009) give a description of available model-skill metrics that can be used to evaluate the performance of hydrodynamic models, in particu lar when compared with spatially available Earth Observation (EO) data. As an example, we have compared nighttime SST estimates from Advanced Along Track Scanning Radiometer (AATSR) data for May 2006 with the monthly SST composite simulated with WEC1.…”

Section: Polcoms Applied To the Western English Channelmentioning

confidence: 99%