Real-Time Performance Feedback in a Manually-Controlled Spacecraft Inspection Task

Karasinski, John; Handley, Patrick M.; Duda, Kevin R.

doi:10.2514/6.2017-1314

Cited by 7 publications

(8 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The pseudorandom times and colors for the secondary task were identical for each participant. This secondary task has been validated in previous studies, which have shown it to correlate well with participants' subjective workload estimates (Hainley, Duda, Oman, & Natapoff, 2013;Karasinski et al, 2017). Participants were seated at a fixed-base simulator for the duration of the experiment, see Figure 2.…”

Section: Methods Taskmentioning

confidence: 94%

“…At UC Davis, our recent experiments with concurrent bandwidth feedback in complex manual tasks have resulted in large improvements in human performance with an added benefit of reduced workload. Our experiment with simulated spacecraft-piloting investigated the effects of concurrent bandwidth feedback on a complex, four-degree-of-freedom manually controlled on-orbit inspection task (Karasinski, Robinson, Handley, & Duda, 2017). We found that simple visual feedback on the controlled degrees of freedom improved initial and fully trained performance while reducing inferred and self-reported workload.…”

Section: Introductionmentioning

confidence: 93%

See 1 more Smart Citation

Utility of Concurrent Bandwidth Feedback in Training Aircraft Flight Tasks

Karasinski

2019

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

The effects of concurrent bandwidth feedback on operator performance and workload was analyzed in training an aircraft flight control task. In the experiment, participants completed a simulated flight task consisting of three complexity levels using traditional flight instruments. Thirty participants were divided into equal sized control and feedback groups. The control group controlled simulated aircraft motion with visual guidance for pitch, roll, and altitude provided by traditional flight instruments. The feedback group received additional visual concurrent bandwidth feedback for each controlled degree of freedom. For both groups, performance and workload measurements were evaluated to determine the effects of the feedback on subject learning rate and maximum skill level. To assess short-term retention of learned skill for the feedback group, the concurrent feedback was removed, and performance was again evaluated. Statistical analyses showed that participants in the feedback group immediately performed better than those in the control group, that the performance difference between the two groups was more pronounced for more complex tasks, and that final performance levels for the feedback group significantly exceeded that of the control group. We found that concurrent bandwidth feedback does not reduce workload in our flight tasks, and that for the short periods tested, participants continued to perform at the same performance and workload levels when the feedback was removed.

show abstract

Section: Methods Taskmentioning

confidence: 94%

Section: Introductionmentioning

confidence: 93%

Utility of Concurrent Bandwidth Feedback in Training Aircraft Flight Tasks

Karasinski

2019

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

show abstract

“…This work represents the first study to rigorously investigate a set of embedded measures of trust, workload, and SA by comparing those measures to commonly used subjective questionnaires. We also implemented three embedded measures (one each for TWSA) in a spaceflight-relevant scenario; previous studies had only implemented one or two embedded measures (Akash et al, 2018, 2020; Hainley et al, 2013; Karasinski et al, 2016, 2017; Petersen et al, 2019). Our results are consistent with studies showing the general utility of embedded measures of cognitive states (Hainley et al, 2013; Karasinski et al, 2016, 2017; Kunze et al, 2019; Petersen et al, 2019).…”

Section: Discussionmentioning

confidence: 99%

“…However, operator engagement on a required low-priority subtask can serve as an embedded measure of workload. Similarly, verbal callouts in which operators report vehicle state changes were introduced as an embedded measure of SA in previous studies (Hainley et al, 2013;Karasinski et al, 2016Karasinski et al, , 2017. While this measure likely only evaluates Level 1 SA (Endsley, 1995), in some environments, callouts integrate naturally into existing tasks or are already standard tasks that operators complete (e.g., aircraft cockpits).…”

Section: Background and Motivationmentioning

confidence: 99%

Estimation of Subjectively Reported Trust, Mental Workload, and Situation Awareness Using Unobtrusive Measures

et al. 2022

View full text Add to dashboard Cite

Objective We use a set of unobtrusive measures to estimate subjectively reported trust, mental workload, and situation awareness (henceforth “TWSA”). Background Subjective questionnaires are commonly used to assess human cognitive states. However, they are obtrusive and usually impractical to administer during operations. Measures derived from actions operators take while working (which we call “embedded measures”) have been proposed as an unobtrusive way to obtain TWSA estimates. Embedded measures have not been systematically investigated for each of TWSA, which prevents their operational utility. Methods Fifteen participants completed twelve trials of spaceflight-relevant tasks while using a simulated autonomous system. Embedded measures of TWSA were obtained during each trial and participants completed TWSA questionnaires after each trial. Statistical models incorporating our embedded measures were fit with various formulations, interaction effects, and levels of personalization to understand their benefits and improve model accuracy. Results The stepwise algorithm for building statistical models usually included embedded measures, which frequently corresponded to an intuitive increase or decrease in reported TWSA. Embedded measures alone could not accurately capture an operator’s cognitive state, but combining the measures with readily observable task information or information about participants’ backgrounds enabled the models to achieve good descriptive fit and accurate prediction of TWSA. Conclusion Statistical models leveraging embedded measures of TWSA can be used to accurately estimate responses on subjective questionnaires that measure TWSA. Application Our systematic approach to investigating embedded measures and fitting models allows for cognitive state estimation without disrupting tasks when administering questionnaires would be impractical.

show abstract

“…Others proposed some supplemental instruments for safety inspection, such as dynamic risk taxonomy [13], a real-time performance feedback system [14], and mobile computing methods [15]. The risk items were classified according to frequency or severity.…”

Section: The Development Of Navigated Inspection Vs Manual Inspectionmentioning

confidence: 99%

Efficiency improvement by navigated safety inspection involving visual clutter based on the random search model

Sun

Chong

2018

International Journal of Occupational Safety and Ergonomics

View full text Add to dashboard Cite

Navigated inspection seeks to improve hazard identification (HI) accuracy. With a tight inspection schedule, HI also requires efficiency. However, lacking quantification of HI efficiency, navigated inspection strategies cannot be comprehensively assessed. This work aims to determine inspection efficiency in navigated safety inspection, controlling for HI accuracy. Based on a cognitive method of the random search model (RSM), an experiment was conducted to observe the HI efficiency in navigation, for a variety of visual clutter (VC) scenarios, while using eye-tracking devices to record the search process and analyze the search performance. The results show that the RSM is an appropriate instrument, and VC serves as a hazard classifier for navigation inspection in improving inspection efficiency. This suggests a new and effective solution for addressing the low accuracy and efficiency of manual inspection through navigated inspection involving VC and the RSM. It also provides insights into the inspectors' safety inspection ability.

show abstract

Real-Time Performance Feedback in a Manually-Controlled Spacecraft Inspection Task

Cited by 7 publications

References 10 publications

Utility of Concurrent Bandwidth Feedback in Training Aircraft Flight Tasks

Utility of Concurrent Bandwidth Feedback in Training Aircraft Flight Tasks

Estimation of Subjectively Reported Trust, Mental Workload, and Situation Awareness Using Unobtrusive Measures

Efficiency improvement by navigated safety inspection involving visual clutter based on the random search model

Contact Info

Product

Resources

About