Methods to Evaluate Health information Systems in Healthcare Settings: A Literature Review

The Hackathon concept is attracting interest as a vehicle for participatory development in both Health and Information systems. Publically available datasets, cloud based data storage, and increasingly sophisticated analytical methods, combined with user friendly development tools for mobile devices are inspiring innovation in the participatory medicine space. This has the potential to disrupt traditional methods and deliver solutions more rapidly, and in a form more likely to meet requirements. In health applications this involves putting the patient and their supports at the centre of design. This work contributes to solving the challenges involved in bringing a diverse cohort of designers, developers, problem owners, healthcare providers, patients, and citizens together to solve user-driven self-care problems using technology. We use a descriptive case study approach focussing on two weekend-long hackathons dubbed "Health Hackathon: Solving Self-care". We gather thick data from multiple sources according to the process defined by Geertz (1994) first, to provide a rich picture of the role of hackathons in participatory medicine and second, to contribute evidence to the practise of running a hackathon. Some key originalities of our work include seeking more candid responses via selfserve interviews. Through this, controversially, we noted a marked emphasis on the creative process over concerns for privacy and ethics around the personal data cloud created by hackathon products. We build on existing theories of participatory medicine and emerging methodologies for conducting hackathons to provide evidence of the efficacy of the hacking approach both in terms of outcome and team dynamics. Through interviews, observation, twitter feeds and a pre-survey, we identify a number of success factors including (1) group size, (2) maturity of the idea, (3) level of involvement of a mentor, and (4) involvement of students. In addition we identify five skills identified by successful health hackathon participants; knowledge, patient focussed skills, analytical skills, software design skills and professional perspective. In common with previous studies we find that there are considerable social benefits that accrue in running a hackathon. Participants meet new people and learn first-hand of the challenges and opportunities provided by the skill sets and work environments of others. This work builds on the existing body of research concerning hackathons and in particular work in the context of participatory medicine

show abstract

“…Typically clinicians are considered to be end users (B. Rahimi & Vimarland, 2007). In hackathons citizens and clinicians share the end user role.…”

Section: Discussionmentioning

confidence: 99%

How do the design features of health hackathons contribute to participatory medicine?

Day

Humphrey

Cockcroft

2017

AJIS

View full text Add to dashboard Cite

show abstract

“…However, in spite of the enormous investment in IS/IT, no convincing evidence of their overall benefits has been produced (Littlejohns et al 2003). The study of the success, or failure of these initiatives has become vitally important for the performance of these organisations (Delpierre et al, 2004;Rahimi & Vimarlund, 2007). Since the 1990´s, the health sector has sought to improve its effectiveness and efficiency by adopting IS/IT to increase the levels of quality of healthcare (Raghupathi & Tan, 1999).…”

Section: The Healthcare Sectormentioning

confidence: 99%

Investments in information systems and technology in the healthcare: Project management mediation

Gomes

Rom�ão

2016

Journal of Information Systems Engineering & Management

View full text Add to dashboard Cite

Healthcare organisations must improve their business practices and internal procedures in order to answer the increasing demand of health professionals and the general public for more and better information. Hospitals invest massively in information systems and technology (IS/IT) in the hope that these investments will improve healthcare and meet patients' demands. The main objective of our research is to study how organisational maturity, enhanced by investments in IS/IT, project management and best practices, leads to successful projects in public healthcare organisations. The rational of our model is that organisational maturity has a positive effect on IS/IT project success, and that this success is also positively enhanced by the use of project management practices. We emphasise that this combination of approaches can increase the effectiveness of projects. Furthermore, it can also improve the confidence that the results of investments will meet stakeholders' expectations. Keywordshealth information systems, IT healthcare, health IS/IT projects, project success, project management, maturity models.

show abstract

“…it is required to diagnose eventual usability problems and evaluate the achievement of the objectives. Testers often do not have the knowledge, instruments and/or time available to test for usability [40].…”

Section: User Centered Designmentioning

confidence: 99%

“…However, introducing ICT in clinical settings should be done cautiously, namely to support clinicians tasks and augment the services' delivery to patients [40], [43]. The main idea is to replace pen and paper for computers and digital media, having most of these services provided to the citizens through the Internet [37].…”

Section: Patient Centered Design For Mental Health Contextsmentioning

confidence: 99%

Patient Centered Design: Challenges and Lessons Learned from Working with Health Professionals and Schizophrenic Patients in e-Therapy Contexts

Reis

Freire

Fernandez

et al. 2011

Communications in Computer and Information Science

View full text Add to dashboard Cite

Abstract. Patient Centered Design (PCD) is a particular type of User CenteredDesign (UCD) where the end-user is a patient that will use an Information and Communications Technology (ICT) solution for healthcare. It focuses on needs, wants and skills of the product's primary user and implies involving end-users in the decision-making and development process of the solution. e-Therapy aims to provide support to therapy sessions through ICT solutions. It has grown in the last years and in the mental health arena is being used for specific therapeutic contexts. It is an especially difficult environment due to specificities of the patients' conditions and where the physical access to patients is restricted and, sometimes, not even possible. Thus, a PCD approach can be accomplished through the health professionals involved, applying some of the most wellknown methods of UCD: interviews, questionnaires, focus groups and participatory design. eSchi is an e-Therapy tool that complements traditional practices for the cognitive rehabilitation and training of schizophrenic patients. It was successfully developed using a PCD approach.

show abstract

Methods to Evaluate Health information Systems in Healthcare Settings: A Literature Review

Cited by 100 publications

References 51 publications

How do the design features of health hackathons contribute to participatory medicine?

How do the design features of health hackathons contribute to participatory medicine?

Investments in information systems and technology in the healthcare: Project management mediation

Patient Centered Design: Challenges and Lessons Learned from Working with Health Professionals and Schizophrenic Patients in e-Therapy Contexts

Contact Info

Product

Resources

About