Putting the humanity into inhuman systems: How human factors and ergonomics can be used to manage the risks associated with artificial general intelligence

Abstract

The next generation of artificial intelligence, known as artificial general intelligence (AGI) could either revolutionize or destroy humanity. As the discipline which focuses on enhancing human health and wellbeing, human factors and ergonomics (HFE) has a crucial role to play in the conception, design, and operation of AGI systems. Despite this, there has been little examination as to how HFE can influence and direct this evolution. This study uses a hypothetical AGI system, Tegmark's “Prometheus,” to frame the role of HFE in managing the risks associated with AGI. Fifteen categories of HFE method are identified and their potential role in AGI system design is considered. The findings suggest that all categories of HFE method can contribute to AGI system design; however, areas where certain methods require extension are identified. It is concluded that HFE can and should contribute to AGI system design and immediate effort is required to facilitate this goal. In closing, we explicate some of the work required to embed HFE in wider multi‐disciplinary efforts aiming to create safe and efficient AGI systems.

The risks associated with Artificial General Intelligence: A systematic review

“…Stanton et al, 2019), they do not, at present, pose a significant threat to humanity (Bentley, 2018). This is not the case with AGI, with many scholars discussing potential existential threats (Salmon et al, 2021). The risks associated with AGI are generated by the challenge of controlling an agent that is substantially more intelligent than us (Baum, 2017).…”

“…At this point, which is estimated to occur between 2040 to 2070 (Baum et al, 2011;Müller & Bostrom, 2016), it is hypothesised that an AGI will have the capability to recursively self-improve by creating more intelligent versions of itself, as well as altering their preprogrammed goals (Tegmark, 2017). The emergence of AGI could bring about numerous societal challenges, from AGI's replacing the workforce, manipulation of political and military systems, through to the extinction of humans (Bostrom, 2002(Bostrom, , 2014Salmon et al, 2021;Sotala & Yampolskiy, 2015). Given the many known and unknown risks regarding AGI, the scientific community holds concerns regarding the threats that an AGI may have on humanity (Bradley, 2020;Yampolskiy, 2012).…”

“…Given the many known and unknown risks regarding AGI, the scientific community holds concerns regarding the threats that an AGI may have on humanity (Bradley, 2020;Yampolskiy, 2012). These concerns include malevolent groups creating AGI for malicious use, as well as catastrophic unintended consequences brought about by apparently well-meaning AGI's (Salmon et al, 2021). There is much scepticism among experts as to whether AGI will ever eventuate, and responses to the AGI debate are broad and range from doing nothing, as an AGI may never be created (Bringsjord et al, 2012), to the extremes of allowing AGI to destroy humanity and take our place in an evolutionary process (Garis, 2005).…”

“…This is highly problematic when considering risk management, as the initial risk controls may also be ineffective as the AGI redesigns and selfimproves. As such, there is an urgent need to understand and develop appropriate risk controls now, to ensure the creation of safe AGI's and continued and effective management of associated risks as they develop (Salmon et al, 2021;Sotala & Yampolskiy, 2015). Salmon et al (2021), for example, recently outlined a research agenda designed to ensure that appropriate design and risk management methods are immediately embedded in AGI design.…”

“…As such, there is an urgent need to understand and develop appropriate risk controls now, to ensure the creation of safe AGI's and continued and effective management of associated risks as they develop (Salmon et al, 2021;Sotala & Yampolskiy, 2015). Salmon et al (2021), for example, recently outlined a research agenda designed to ensure that appropriate design and risk management methods are immediately embedded in AGI design. Despite calls such as this, the extent to which the research community is actively exploring the risks associated with AGI in scientific research is not clear (Baum, 2017).…”