“…Essentially, this entails an augmented decision making system in which the human user semisupervises the algorithm by having opportunities to intervene, provide input, and have the final say. As described in the reviewed literature, such decision making systems can take shape in a variety of ways, such as interactive support systems (Lim & O'Connor, 1996), humanautomation systems (Patterson, 2017), engaged systems (Pagano et al, 2016), constructive dialog in expert systems (Eining, Jones, & Loebbecke, 1997), judgmental systems (Prahl & Van Swol, 2017), or procedural presentation in interfaces (Lamberti & Wallace, 1990). Nevertheless, Dietvorst et al (2016) highlight an important new consideration: that people are relatively insensitive to the amount by which they can modify the imperfect algorithm's forecasts as long as they are able to incorporate their own input and participate in the ultimate decision (p. 1161).…”