A sociotechnical view of algorithmic fairness

Abstract

Algorithmic fairness (AF) has been framed as a newly emerging technology that mitigates systemic discrimination in automated decision-making, providing opportunities to improve fairness in information systems (IS). However, based on a state-of-the-art literature review, we argue that fairness is an inherently social concept and that technologies for AF should therefore be approached through a sociotechnical lens. We advance the discourse on AF as a sociotechnical phenomenon. Our research objective is to embed AF in the sociotechnical view of IS. Specifically, we elaborate on why outcomes of a system that uses algorithmic means to assure fairness depend on mutual influences between technical and social structures. This perspective can generate new insights that integrate knowledge from both technical fields and social studies. Further, it spurs new directions for IS debates. We contribute as follows:First, we problematize fundamental assumptions in the current discourse on AF based on a systematic analysis of 310 articles. Second, we respond to these assumptions by theorizing AF as a sociotechnical construct. Third, we propose directions for IS researchers to enhance their impacts by pursuing a unique understanding of sociotechnical AF. We call for and undertake a holistic approach to AF.A sociotechnical perspective on AF can yield holistic solutions to systemic biases and discrimination.

A Multi-Perspective Framework for Research on (Sustainable) Autonomous Systems

“…For example, as unintended and unforeseen second-order or spillover effects can result from the deployment of SAS, the question must be answered if we really want to rely on systems that are on 'autopilot.' Here, critical ethical questions arise (Tang et al 2020), including questions of fairness regarding the decision rules according to which AS act (Dolata et al 2021); for instance, how a driverless car should react to unforeseen circumstances affecting humans (Kirkpatrick 2015).…”

Algorithmic Fairness and Structural Injustice: Insights from Feminist Political Philosophy

“…The resource allocation algorithm is not only developed within an ecosystem of socio-political and ethical values, but it is also a proper component of the institutions in which it operates. We take algorithmic fairness in general to be concerned with such sociotechnical systems [14,33]. Thus, fairness of algorithms is inherently (and therefore inescapably) connected with its reception in its social context of utilization and its response to the social injustice at work.…”

Algorithmic Fairness in Business Analytics: Directions for Research and Practice

“…Fairness concerns the allocation of goods and burdens, and thus is a property of the decisions that may be made or informed by algorithms. As such, bias in algorithmic-informed decisions may stem from biased algorithmic outputs, or from other portions of the sociotechnical system that the algorithm is embedded on (Dolata et al 2022). In this section, we provide a taxonomy of common sources of algorithmic bias-understood as biased algorithmic outputs-with an emphasis on business operations problems.…”