Qualitative value of information provides a transparent and repeatable method for identifying critical uncertainty

Species status assessments are used to inform U.S. Fish and Wildlife Service (USFWS) decision making for Endangered Species Act (ESA) classification decisions, recovery planning, and more. The large number of species that require assessment and uncertainty in the data available impede the process of assigning and completing the assessments, which makes creating a multiyear work plan extremely difficult. An optimized triaging system that maximizes the use of the best available information while managing the complex ESA workload and meeting deadlines is necessary. We used a structured decision-making framework to approach the problem with the goal of creating a prioritization tool that would be effective at scheduling assessments, given the best information available and priorities of the USFWS. We collected data on the species awaiting assessment and developed a value function that incorporates existing deadlines, taxonomic uncertainty, controversy of the species, and population and habitat data availability and quality. We used a constrained linear optimization algorithm to maximize the value function and ensure that workload capacity was not exceeded. A comparison of model scenarios indicates that imposed deadlines impact the model more than capacity constraints. Additionally, differential weighting of the metrics significantly affected the outcome of the model. In the future, elicitation of metric weights should be done routinely before the model is run for use in official planning to ensure alignment with current USFWS priorities. Output from this optimization can be used to inform a five-year work plan, allocate resources, and discuss workforce decisions. History: This paper has been accepted for the Decision Analysis Special Issue on Decision Analysis to Further Environmental Sustainability. Funding: This work was funded via an inter-agency agreement between the USFWS and the USGS and subsequently by a Research Work Order contract between the USGS and the University of Florida [Grant G21AC00016].

show abstract

A Simplified Method for Value of Information Using Constructed Scales

Runge

Rushing

Lyons

et al. 2023

Decision Analysis

View full text Add to dashboard Cite

The value of information is a central concept in decision analysis, used to quantify how much the expected outcome of a decision would be improved if epistemic uncertainty could be resolved prior to committing to a course of action. One of the challenges, however, in quantitative analysis of the value of information is that the calculations are demanding, especially in requiring predictions of outcomes as a function of alternative actions and sources of uncertainty. However, the concept of value of information is important in early framing of some decisions, before such predictions are available. We propose a novel measure of the value of information based on constructed scales (CVOI), grounded in the algebra of the expected value of perfect information (EVPI), but requiring less of experts and analysts. The CVOI calculation decomposes EVPI into a contribution representing the relevance of the uncertainty to the decision and a contribution representing the magnitude of uncertainty; constructed ratio scales are then proposed for each contribution. We demonstrate the use of CVOI to identify research priorities related to migratory bird management in the face of climate change. Funding: This work was funded in part by the U.S. Geological Survey National Climate Adaptation Science Center.

show abstract

Qualitative value of information provides a transparent and repeatable method for identifying critical uncertainty

Cited by 6 publications

References 61 publications

Beyond expected values: Making environmental decisions using value of information analysis when measurement outcome matters

Beyond expected values: Making environmental decisions using value of information analysis when measurement outcome matters

Prioritization of Species Status Assessments for Decision Support

A Simplified Method for Value of Information Using Constructed Scales

Contact Info

Product

Resources

About