What Do Hackathons Do? Understanding Participation in Hackathons Through Program Theory Analysis

Abstract

Hackathons are increasingly embraced across diverse sectors as a way of democratizing the design of technology. Several attempts have been made to redefine the format and desired end goal of hackathons in recent years thereby warranting closer methodological scrutiny. In this paper, we apply program theory to analyze the processes and effects of 16 hackathon case studies through published research literature. Building upon existing research on hackathons, our work offers a critical perspective examining the methodological validity of hackathons and exemplifies how specific processes for organizing hackathons are modified for different purposes. Our main contribution is a program theory analysis of hackathon formats that provides an exploration and juxtaposition of 16 case studies in terms of causal relations between the input, process and the effects of hackathons. Our cataloguing of examples can serve as an inspirational planning resource for future organizers of hackathons.CCS Concepts: • Human-centered computing → Interaction design process and methods.

Hackathons as extracurricular activities: Unraveling the motivational orientation behind student participation

“…Finally, it is also worth exploring the possibilities of using hackathons in non‐computing and nonengineering degrees, especially in programs where innovation should be highlighted as part of the core curriculum. As argued by Falk et al [18], carefully designed activities and mechanisms are necessary to encourage broader and more diverse participation. Future works therefore should draft a guideline on transforming hackathons into an ECA that is more inclusive, diverse, and welcoming to everyone.…”

The Future of Hackathon Research and Practice

“…Proactive strategies for mitigation then hinge on organizers to set the tone of the event and lead by example. In an analysis of 16 hackathons described in research literature, Falk et al [22] identified nine hackathons which were specifically tailored towards broadening participation. As they discuss "By modifying the processes and desired end goal of hackathons, researchers 9 https://hackcodeofconduct.org/ [and hackathon organizers] have the opportunity to include those who have been historically marginalized when considering the design of technology mediated futures" [22].…”

“…In an analysis of 16 hackathons described in research literature, Falk et al [22] identified nine hackathons which were specifically tailored towards broadening participation. As they discuss "By modifying the processes and desired end goal of hackathons, researchers 9 https://hackcodeofconduct.org/ [and hackathon organizers] have the opportunity to include those who have been historically marginalized when considering the design of technology mediated futures" [22]. Related to this, it has been discussed how hackathons [21] can be a way of facilitating participation in design processes with low investment in order to include vulnerable people [46].…”

“…Despite a number of works on the topic of equity in the context of hackathons, this space remains underexplored with respect to many axes of diversity and equity, such as ethnicity, culture, socioeconomic background, gender, sexuality and neurodiversity. As Falk et al [22] The rapid shift towards virtual and hybrid meetings in response to the COVID-19 pandemic opens up both opportunities and challenges with respect to equitable participation in hackathons that should be the focus of future work. In this context, one might ask whether virtual hackathons where participants are anonymous facilitate or hinder equitable participation.…”

“…Different communities organize and study events with little exchange between them which poses significant risks, such as repeating poor or, in worst cases, even harmful practices, leading to sub-optimal experiences and outcomes for not only researchers but also for participants, organizers and connected stakeholders. These poor practices include repeating and amplifying not only superficial but even technosolutionist approaches to complex social and societal issues [22], or inadvertently contribute to bad experiences or limited access of participation for minoritized people, wishing to participate [74].…”