Quality of Research Practice – An interdisciplinary face validity evaluation of a quality model

Abstract

There are few acknowledged multidisciplinary quality standards for research practice and evaluation. This study evaluates the face validity of a recently developed comprehensive quality model that includes 32 defined concepts based on four main areas (credible, contributory, communicable, and conforming) describing indicators of research practice quality. Responses from 42 senior researchers working within 18 different departments at three major universities showed that the research quality model was–overall–valid. The vast majority believed all concepts in the model to be important, and did not indicate the need for further development. However, some of the sub-concepts were indicated as being slightly less important. Further, there were significant differences concerning ‘communicable’ between disciplines and academic levels, and for ‘conforming’ between genders. Our study indicates that the research quality model proposes the opportunity to move to a more systematic and multidisciplinary approach to research quality improvement, which has implications for how scientific knowledge is obtained.

The Use of Augmented Reality in Latin-American Engineering Education: A Scoping Review

“…Hence, we iteratively designed and tested a weighted quality index for each report based on three components: an indicator of the quality of technology design presentations (based on the principles set by Isaksson et al (2020), Petersen (2020) and Schön et al (2017)), an indicator of the quality of the empirical testing or evaluation of the technology earlier presented, excluding design-only papers (Liu et al, 2016;Mårtensson et al, 2019), and an independent indicator of the quality of quasi-experimental designs (drawn mostly from Cochrane criteria). The final criteria list with weights and requirements is shown in Table 3.…”

Driving Logistics Change in the Pharmaceutical Industry

“…This research adopted a qualitative approach in which the formulation of the framework is useful for discussing the research practice and discussions on research quality. The dimension framework in this study can be useful in the different research process or project and also can be used as as a guiding principle in different evaluation processes such as review processes [6] as the following figure;…”

What should we evaluate when we use technology in education?

“…Face validity is defined as the degree that respondents or users judge that the items of an assessment instrument are appropriate to the targeted construct and assessment objectives (Mårtensson et al, 2019; Song & Herman, 2010). Content validity refers to the extent to which the items on a measure are fairly representative of the entire domain the test seeks to measure (DeVellis, 2017; Salkind, 2010).…”