A proposal for minimum reusability evaluation of design principles

Iivari, Juhani; Hansen, Magnus Paulsen; Haj-Bolouri, Amir

doi:10.1080/0960085x.2020.1793697

Cited by 54 publications

(65 citation statements)

References 60 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Steps such as the facilitated formulation of a design principle, data collection strategies, data processing steps, and the selection of models to use are relevant issues for every designer facing a similar challenge. Additionally, by using the schema proposed by Gregor et al [45], our design principle also meets the five criteria for reusability: accessibility, importance, novelty, and effectiveness [87]. Therefore, we expect that other DSS designers can build from this experience when defining intervention groups.…”

Section: Discussionmentioning

confidence: 96%

Improving healthcare access management by predicting patient no-show behaviour

Barrera

Brailsford

Bravo

et al. 2020

Decision Support Systems

View full text Add to dashboard Cite

Low attendance levels in medical appointments have been associated with poor health outcomes and efficiency problems for service providers. To address this problem, healthcare managers could aim at improving attendance levels or minimizing the operational impact of no-shows by adapting resource allocation policies. However, given the uncertainty of patient behaviour, generating relevant information regarding no-show probabilities could support the decision-making process for both approaches. In this context many researchers have used multiple regression models to identify patient and appointment characteristics than can be used as good predictors for no-show probabilities. This work develops a Decision Support System (DSS) to support the implementation of strategies to encourage attendance, for a preventive care program targeted at underserved communities in Bogotá, Colombia. Our contribution to literature is threefold. Firstly, we assess the effectiveness of different machine learning approaches to improve the accuracy of regression models. In particular, Random Forest and Neural Networks are used to model the problem accounting for non-linearity and variable interactions. Secondly, we propose a novel use of Layer-wise Relevance Propagation in order to improve the explainability of neural network predictions and obtain insights from the modelling step. Thirdly, we identify variables explaining no-show probabilities in a developing context and study its policy implications and potential for improving healthcare access. In addition to quantifying relationships reported in previous studies, we find that income and neighbourhood crime statistics affect no-show probabilities. Our results will support patient prioritization in a pilot behavioural intervention and will inform appointment planning decisions.

show abstract

Section: Discussionmentioning

confidence: 96%

Improving healthcare access management by predicting patient no-show behaviour

Barrera

Brailsford

Bravo

et al. 2020

Decision Support Systems

View full text Add to dashboard Cite

show abstract

“…The first version of the design principles, a method under development, was evaluated in three semi-structured interviews with four representatives of future providers (two small municipalities) and three members of a team of experienced intermediaries (a Belgian digital start-up that developed an OGD based application for the group of users whose information needs were investigated in iteration 1 and 2) (see Appendix E). As the design principles were reaching their final form in the artifact V.3., as presented in this paper and the current popular science article, they were evaluated based on the design principles evaluation framework of Iivari et al (2020). The popular science article, together with a questionnaire (online form) was sent to six experienced data providers, as a way to complement the feedback got from less experienced data providers (respondents of the first evaluation and participants of the iteration 3).…”

Section: Discussionmentioning

confidence: 99%

“…For research, the conceptual schema of Gregor et al (2020) and evaluation framework of Iivari et al (2020) offered a relevant structure to write and evaluate design principles. Moreover, more research of OGD from an information needs perspective is needed.…”

Section: Discussionmentioning

confidence: 99%

“…It moves the knowledge contribution from the specific case to the generalization. Design principles should be evaluated based on their reusability and utility in their environment (Iivari, Hansen, & Haj-Bolouri, 2020).…”

Section: Design Principles In Design Science Researchmentioning

confidence: 99%

“…Following the evaluation framework of Iivari et al (2020), the design principles were perceived by the experienced providers (OGD managers) as accessible (understandable with the provided examples and tools), important as they address a real problem in their practice (lack of reuse and understanding of users' needs), novel in their approach and useful. However, they perceived their actionability differently.…”

Section: Perceived Usefulness and Relevance By The Audience: Data Providers And Intermediariesmentioning

confidence: 99%

See 2 more Smart Citations

Methods to Capture User Information Needs: Design Principles for Open Data Intermediaries and Data Providers

Gebka

Crusoe

Ahlin

2021

CODATA

View full text Add to dashboard Cite

Data providers share open government data (OGD) to be transformed by intermediaries into products and services (solutions). OGD is believed to lead to many benefits. However, OGD is not reaching its expected level of reuse, which can come from a lack of awareness, interest to fulfil the user's needs, or novel perspectives to understand them. This paper presents a set of design principles to develop tailored mixed methods that capture activity-based information needs of users which could be satisfied by building information products based on OGD. The produced insights can help data providers and intermediaries to realign ideas of solutions to the user's information needs. The set of nine design principles are developed using design science research and are based on previous research and empirical testing. They have been implemented with two groups of users and three groups of data providers as participants of, respectively, face-to-face and digital workshops. The design principles and the produced insights were evaluated with practitioners. Implications for practice are that starting with the users' information needs can open a broader range of solutions and potential paths of OGD reuses, while following the design principles can help the practitioners cope with the fuzziness of the information needs and ideation process. For research, we propose a novel method that goes beyond the exclusive data provider-intermediary interaction to study new paths to improve the realization of OGD benefits.

show abstract

Design Principles Exposition: A Framework for Problematizing Knowledge and Practice in DSR

Hansen

Haj-Bolouri

2020

Designing for Digital Transformation. Co-Creating Services With Citizens and Industry

Self Cite

View full text Add to dashboard Cite

Design principles (DPs) have been recognized as a central contribution in Design Science Research and the research community has begun acknowledging their importance. Much of this work implicitly assumes that design principles are natural components of contributions that can easily be derived by researchers without a need for criteria for their proposal, application or evaluation. In this paper we infer a framework for how to expose the conceptual structure of DPs as both components and sole contributions. We find a danger in assuming that design principles alone are contributions as they are very broadly used to propose utility yet the specific target audience or the explicit use of them as components of design theory occur less frequent. Furthermore, by applying our framework to a set of DPs, we offer four parts of their conceptual structure that can be used to convey the nature of design principle contributions and further identify potential areas for improvement or further research. We derive 8 questions that offer a guiding hand to researchers who attempt to embed DPs as components of their contribution either to research or to practice.

show abstract

A proposal for minimum reusability evaluation of design principles

Cited by 54 publications

References 60 publications

Improving healthcare access management by predicting patient no-show behaviour

Improving healthcare access management by predicting patient no-show behaviour

Methods to Capture User Information Needs: Design Principles for Open Data Intermediaries and Data Providers

Design Principles Exposition: A Framework for Problematizing Knowledge and Practice in DSR

Contact Info

Product

Resources

About