Although higher education institutions across Europe and beyond are paying more and more attention to research integrity training, there are few studies and little evidence on what works and what does not work in such training. One way to overcome this challenge is to evaluate such training with standardised instruments. Experts/trainers have used qualitative approaches to evaluate their research integrity training's successes, but it is difficult to compare their results with others. Sometimes they conduct standardised tests drawn from ethics education or other related fields, but these tests do not assess research integrity's core themes. At present, there is a lack of standardised instruments designed to specifically evaluate success in research integrity training. This article presents a pre-validated instrument for this purpose. Named the P2I questionnaire, it is designed as a four-tier test and based on the European Code of Conduct for Research Integrity; in it, testees choose a (scientific) practice to address an issue, justify their decision, and describe how confident they are with their decisions. The development of the P2I questionnaire is outlined in three steps. After describing the research integrity (alternatively, the responsible conduct of research) training successes, the article notes scientific and non-scientific patterns and then concludes with a pre-validated and revised version of the P2I questionnaire. This questionnaire is intended as a first step in a discourse on standardised research integrity measurements and is one step towards an evidence-based improvement of research integrity training.

Although higher education institutions across Europe and beyond are paying more and more attention to research integrity (RI) and responsible conduct of research (RCR) training, there are few studies and little evidence on what works and what does not work in these training sessions. One way to overcome this challenge is to evaluate such training with standardised instruments. Experts and trainers have used qualitative approaches to evaluate their training's successes, but it is difficult to compare their results with others. Sometimes they conduct standardised tests drawn from ethics education or other related fields, but these tests do not assess core themes of research integrity as outlined in the European Code of Conduct for Research Integrity (ECoC, 2017). At present, there is a lack of available standardised instruments designed to specifically evaluate success in this training. This article presents a pre-validated instrument for this purpose. The P2I questionnaire is a four-tier test based on the European Code of Conduct for Research Integrity. In it, testees choose a practice in line with research integrity to address an issue, justify their choice, and describe how confident they are with their answers. The development of the P2I questionnaire is outlined in three steps. First we describe the status quo and gaps in evaluating training success, then we illustrate how we designed the P2I questionnaire using practices and justifications in line (and not in line) with research integrity.  In the third step, this P2I questionnaire is pre-validated and revised. This questionnaire is a first attempt to engage in a discourse on standardised research integrity instruments and is one step towards an evidence-based improvement of training sessions.

No abstract

Trainers often use information from previous learning sessions to design or redesign a course. Although universities conducted numerous research integrity training in the past decades, information on what works and what does not work in research integrity training are still scattered. The latest meta-reviews offer trainers some information about effective teaching and learning activities. Yet they lack information to determine which activities are plausible for specific target groups and learning outcomes and thus do not support course design decisions in the best possible manner. This article wants to change this status quo and outlines an easy-to-use taxonomy for research integrity training based on Kirkpatrick’s four levels of evaluation to foster mutual exchange and improve research integrity course design. By describing the taxonomy for research integrity training (TRIT) in detail and outlining three European projects, their intended training effects before the project started, their learning outcomes, teaching and learning activities, and their assessment instruments, this article introduces a unified approach. This article gives practitioners references to identify didactical interrelations and impacts and (knowledge) gaps in how to (re-)design an RI course. The suggested taxonomy is easy to use and enables an increase in tailored and evidence-based (re-)designs of research integrity training.

No abstract