Corporations gather massive amounts of personal data to predict how individuals will behave so that they can profitably price goods and allocate resources. This article investigates the moral foundations of such increasingly prevalent market practices. I leverage the case of credit scores in car insurance pricing—an early and controversial use of algorithmic prediction in the U.S. consumer economy—to unpack the premise that predictive data are fair to use and to understand the conditions under which people are likely to challenge that moral logic. Policymaker resistance to credit-based insurance scores reveals that contention arises when predictions depend on mathematical distinctions that do not align with broader understandings of good and bad behavior, and when theories about why predictions work point to the market holding people accountable for actions that are not really their fault. Via a de-commensuration process, policymakers realign the market with their own notions of moral deservingness. This article thus demonstrates the importance of causal understanding and moral categorization for people accepting markets as fair. As data and analytics permeate markets of all sorts, as well as other domains of social life, these findings have implications for how social scientists understand the novel forms of stratification that result.
Half of U.S. employers consider credit history when deciding whom to hire. The practice has become a contentious policy issue, with multiple jurisdictions limiting the use of credit reports in employment. Yet to date, there has been no test of how the introduction of credit history influences the way employers make decisions. Recent qualitative research finds that employers evaluate credit reports in contingent and person-specific ways, which opens the door to bias according to applicant characteristics, such as race and sex. To test for potential disparate impact in employment outcomes from the use of credit reports, we conduct a survey experiment with 1,050 hiring professionals. We find that including a bad credit report in an applicant’s file reduces respondents’ likelihood of hiring female (vs. male) applicants and reduces the recommended starting salary offered to black (vs. white) applicants. We discuss the implications of this study for research and public policy.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.