Conducting the Pilot Study: A Neglected Part of the Research Process? Methodological Findings Supporting the Importance of Piloting in Qualitative Research Studies

Abstract

During the development of research to compare the processes and impact of inclusive education in Sweden with results obtained from a study undertaken in Ireland, a pilot study was conducted and documented. The pilot study had three aims: (1) to gather data to provide guidance for a substantive study adapted to Swedish conditions through modification of Irish research procedures and instruments, (2) to critically interrogate how we as researchers could most effectively conduct a pilot study utilizing observational and video-recorded data, and (3) to use the Irish theoretical model as a tool of analysis for studying inclusion in two Swedish schools. Although pilot studies are frequently conducted to assess the efficacy of research instruments for use in qualitative research projects, few publications have drawn upon empirical findings related to such studies. Additionally, while methodological texts recommend the use of pilot studies in qualitative research, there is a lack of reported research focusing on how to conduct such pilot studies. We argue that our methodological findings may contribute to greater awareness of the important role that a pilot study may have for full-scale qualitative research projects, for example, in case study research where semi-structured qualitative interviews are used. This argument is based on the assumption that researchers, and especially novice researchers, having conducted a pilot study will be better informed and prepared to face the challenges that are likely to arise in the substantive study and more confident in the instruments to be used for data collection. A proper analysis of the procedures and results from the pilot study facilitates the identification of weaknesses that may be addressed. A carefully organized and managed pilot study has the potential to increase the quality of the research as results from such studies can inform subsequent parts of the research process.

Development of a psychosocial intervention to support informal caregivers of people with end-stage kidney disease receiving haemodialysis

“…Development of the interview schedule by the researcher / corresponding author and supervisory team is ongoing and is based on findings from the systematic review. The semi-structured interview will be piloted with 5 informal caregivers to elicit ease of understanding [21]. A topic guide will be prepared covering a list of issues to be covered with each participant.…”

Portraits of HIV: a pilot photovoice study of adolescent experiences with HIV treatment in South Africa

“…We analyzed the data using strategies of theme analysis, to capture major ideas across and within participant stories. 15 The first author, who also co-facilitated the sessions, and the second author reviewed every transcript and created a list of key themes and topics arising in the data independently. Then, they discussed their findings and narrowed the themes down to five major categories.…”

The Experience of Adults Bereaved by the Suicide of a Close Elderly Relative: A Qualitative Pilot Study

“…However, it also appears relevant to include an internal pilot in the design of our main study in order to see if adjustments are necessary to the methodology since it might be difficult to recruit participants due to the stigma and feelings of shame associated with suicide (Cerel et al, 2008;Janghorban et al, 2014). Moreover, since the aim of the main study is to make an insightful analysis of the experience of the bereaved, it is necessary to verify the suitability of the instrument to increase confidence in the trustworthiness of the data that may be obtained (Malmqvist et al, 2019). In addition, the pilot study could provide a ground for self-assessment of the main researcher's preparation and capacity to practice a qualitative inquiry, for improving skills in conducting an in-depth interview and seizing opportunities for probing emerging topics during the interview process; all of which would enhance the credibility of the research (Nunes et al, 2010;Padgett, 2016).…”

“…In addition, the pilot study could provide a ground for self-assessment of the main researcher's preparation and capacity to practice a qualitative inquiry, for improving skills in conducting an in-depth interview and seizing opportunities for probing emerging topics during the interview process; all of which would enhance the credibility of the research (Nunes et al, 2010;Padgett, 2016). In fact, a well-planned and thoroughly conducted internal pilot study would ensure higher research quality when a depth of understanding is sought (Malmqvist et al, 2019). Thus, the objective was to have a preliminary overview of the psychosocial experience of adults bereaved by the suicide of an elderly relative and to assess the feasibility of a qualitative research on this topic in order to improve the efficiency and quality of the forthcoming main study.…”