“Is something amiss?” Investigating individuals’ competence in estimating swarm degradation

Capiola, August; Hamdan, Izz Aldin; Fox, Elizabeth; Lyons, Joseph B.; Sycara, Katia; Lewis, Michael

doi:10.1080/1463922x.2021.1983887

Cited by 3 publications

(10 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Independent of swarm performance (i.e., number of targets acquired), asset degradation appears to be important for human trust. These variations manifest (in the current simulation) in terms of movement characteristics and asset cohesion-which were noted in qualitative data as factors important for swarm trust and degradation detection (see Capiola et al, 2020Capiola et al, , 2021. Given the potential for swarms to extend human capabilities, research should continue to examine the factors that shape HSwI.…”

Section: Discussionmentioning

confidence: 72%

“…When swarms experience degradation, their objective cohesiveness (uniformity of asset dispersal) and obstacle avoidance (avoiding nofly zones) is reduced (Capiola et al, 2020;Hamdan et al, 2021). People attend to visual features to derive swarm trustworthiness (Liu et al, 2019;Nam et al, 2018), and qualitative data show people do attend to swarm cohesiveness (Capiola et al, 2021) and obstacle avoidance (Capiola et al, 2020). As such, perceived cohesiveness and obstacle avoidance will be negatively related to objective degradation.…”

Section: Rq1: Controlling For Target Acquisition Whatmentioning

confidence: 99%

“…The simulator (Walker et al, 2012) was produced in Microsoft Visual Studio 2017. Simulator parameters were adapted to investigate the effects of asset degradation on HSwI (Capiola et al, 2020(Capiola et al, , 2021Hamdan et al, 2021). For all scenarios, the swarm comprised 256 assets per past work of Capiola et al and Hamdan et al Parameters (i.e., percent of asset degradation, time at which degradation occurred, targets, no-fly zone coordinates) were specified in a text file.…”

Section: Simulatormentioning

confidence: 99%

“…Perceptions of Swarms. Based on qualitative data from Capiola et al (2020Capiola et al ( , 2021, participant agreement on whether each swarm a) had assets that worked together as a cohesive unit (i.e., "The swarm had assets that worked together as a cohesive unit"), b) successfully avoided obstacles (i.e., "The swarm successfully avoided obstacles"), c) was effective in collecting targets (i.e., "The swarm was effective in collecting targets"), and d) explored the terrain efficiently (i.e., "The swarm explored the terrain efficiently") was assessed. These questions were administered after each trial.…”

Section: Dependent Variablesmentioning

confidence: 99%

“…For instance, humans can recognize patterns in complex dynamical systems such as swarm rendezvous behavior amidst 90% noise (Walker et al, 2016), and swarms trained to hide their leaders fool neural networks but are recognized by human observers at almost the same accuracy as without concealment (Deka et al, 2021). In other contexts, humans show little competence in detecting when and the extent to which swarms experience asset degradation (Capiola et al, 2021). One of the dangers associated with inaccurate swarm perceptions is that the human could engage in inefficient state transitions for the swarm (Lewis et al, 2012).…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

The Effect of Asset Degradation on Trust in Swarms: A Reexamination of System-Wide Trust in Human-Swarm Interaction

et al. 2022

Self Cite

View full text Add to dashboard Cite

Objective The effects of asset degradation on trust in human-swarm interaction were investigated through the lens of system-wide trust theory. Background Researchers have begun investigating contextual features that shape human interactions with robotic swarms—systems comprising assets that coordinate behavior based on their nearest neighbors. Recent work has begun investigating how human trust toward swarms is affected by asset degradation through the lens of system-wide trust theory, but these studies have been marked by several limitations. Method In an online study, the current work manipulated asset degradation and measured trust-relevant criteria in a within-subjects design and addressed the limitations of past work. Results Controlling for swarm performance (i.e., target acquisition), asset degradation and trust (i.e., reliance intentions) in swarms were negatively related. In addition, as degradation increased, perceptions of swarm cohesion, obstacle avoidance, target acquisition, and terrain exploration efficiency decreased, the latter two of which (coupled with the reliance intentions criterion) support the tenets of system-wide trust theory as well as replicate and extend past work on the effects of asset degradation on trust in swarms. Conclusion Human-swarm interaction is a context in which system-wide trust is relevant, and future work ought to investigate how to calibrate human trust toward swarm systems. Applications Based on these findings, design professionals should prioritize ways to depict swarm performance and system health such that humans do not abandon trust in systems that are still functional yet not over-trust those systems which are indeed performing poorly.

show abstract

Section: Discussionmentioning

confidence: 72%

Section: Rq1: Controlling For Target Acquisition Whatmentioning

confidence: 99%

Section: Simulatormentioning

confidence: 99%

Section: Dependent Variablesmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

The Effect of Asset Degradation on Trust in Swarms: A Reexamination of System-Wide Trust in Human-Swarm Interaction

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

Detecting Swarm Degradation: Measuring Human and Machine Performance

Capiola

Johnson

Hamdan

et al. 2023

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Is the Pull-Down Effect Overstated? An Examination of Trust Propagation Among Fighter Pilots in a High-Fidelity Simulation

Lyons,

Mator,

Orr

et al. 2024

Journal of Cognitive Engineering and Decision Making

Self Cite

View full text Add to dashboard Cite

Research on trust propagation has primarily been conducted with undergraduates using low-fidelity scenarios. It is unclear if the pull-down effect (e.g., system-wide trust) occurs in more applied domains with actual operators. A sample of experienced US Air Force fighter pilots ( n = 13) engaged in six trials using a high-fidelity simulation for Collaborative Combat Aircraft (CCA). The pilots were given command of four CCAs to complete realistic targeting missions. They were asked to monitor the CCAs, report any errors, evaluate a number of potential targets, select a valid target, and select one of the CCAs to perform a strike. One of the CCAs evidenced an error in four of the six trials (17% of all observations), and if the pilots did not report the error, they were prompted to it by an experimenter playing the role of Air Battle Manager. After each trial, reliance intentions and subjective workload were assessed for each of the four CCAs. The presence of an error reduced trust and increased workload for that CCA referent only. There was no evidence of a pull-down effect, nor did the composition of the CCA group (homogenous vs. heterogenous) influence trust propagation. Implications for trust research are discussed.

show abstract

“Is something amiss?” Investigating individuals’ competence in estimating swarm degradation

Cited by 3 publications

References 34 publications

The Effect of Asset Degradation on Trust in Swarms: A Reexamination of System-Wide Trust in Human-Swarm Interaction

The Effect of Asset Degradation on Trust in Swarms: A Reexamination of System-Wide Trust in Human-Swarm Interaction

Detecting Swarm Degradation: Measuring Human and Machine Performance

Is the Pull-Down Effect Overstated? An Examination of Trust Propagation Among Fighter Pilots in a High-Fidelity Simulation

Contact Info

Product

Resources

About