The Delphi Technique as a Method for Increasing Inclusion in the Evaluation Process

Christie, Christina A.; Barela, Eric

doi:10.3138/cjpe.020.005

Cited by 53 publications

(17 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Rounds 2 and 3 responses were imported into SPSS Statistics software for analysis. To assess whether the panel reached consensus on an item, the researchers adhered to Christie and Barela's (2005) recommendations, with consensus achieved when 75% of responses fell within two points of the item's mean score. Upon analyzing Round 2 data, the researchers redistributed items that did not achieve consensus to the panel through the Round 3 questionnaire.…”

Section: Methodsmentioning

confidence: 99%

What Makes Collegiate Sport Club Programs Successful? Exploration of How Success Is Measured and Perceived

Lower-Hoppe,

Talcott,

Cioletti

et al. 2023

Recreational Sports Journal

View full text Add to dashboard Cite

Collegiate sport club programs are increasingly expected to demonstrate effectiveness and impact, as such the evaluation of program success is critical. Current evaluation methods are often subjective and lack standardization across programs. Unlike other recreational programs, sport clubs have unique organizational structures, with student officers responsible for various tasks related to club operations with unclear measurable outcomes. This study aimed to address this gap by investigating how collegiate recreation departments evaluate sport club program success and identifying critical success indicators. A Delphi design was used to gather expert opinions, and qualitative and quantitative data analysis was employed. The findings highlight various evaluation methods employed by administrators, including annual assessments, participant interviews, and point systems. Furthermore, indicators of success encompassed club activities, operations, and status, as well as participants’ experiences and development. These findings provide valuable insights for program administrators to tailor support and enhance the effectiveness of collegiate sport club programs.

show abstract

Section: Methodsmentioning

confidence: 99%

What Makes Collegiate Sport Club Programs Successful? Exploration of How Success Is Measured and Perceived

Lower-Hoppe,

Talcott,

Cioletti

et al. 2023

Recreational Sports Journal

View full text Add to dashboard Cite

show abstract

“…However, different analyses are suggested to decide whether rounds are complete or a new Delphi round is needed. Since a seven-point Likert scale was used in the study, the difference between quartiles for consensus should be less than 1.5 (Christie & Barela, 2005). Seventeen experts were given 2 weeks to review the RPV-OLC and were briefed on the Delphi panels' planning.…”

Section: Methodsmentioning

confidence: 99%

University students' digital spaces in online learning communities: Implications for understanding, protecting and maintaining privacy

Özer Şanal,

Çiçek

2023

Brit J Educational Tech

View full text Add to dashboard Cite

In addition to learning effectively and effectively in online learning communities (OLCs), students must be in a secure environment and privacy must be respected. The study aimed to identify privacy violations that university students encounter in OLCs, and identify recommendations and some strategies to implement to ensure privacy at the OLC. A qualitative research method was applied in the study. First, focus group interviews were conducted with a total of 108 students who participated actively in the OLC. After analysing the interview data, a privacy violations report (RPV‐OLC) was prepared at the OLC. According to the RPV‐OLC, a problem description for the Delphi technique was designed and 17 experts were identified for the interview. Delphi panels with experts were completed in 5 months. The content analysis process was used for the data obtained. Students said they encountered information sharing and access, access to information, system/course settings, resistance to negotiations, communication problems and lack of knowledge. On the other hand, experts suggest that different suggestions and strategies could be implemented to ensure privacy in the OLC, such as partial privacy, mutual trust, contextual privacy agreements, role‐based or anonymous identity use, and privacy education. The study focused on defining the concept of privacy and student privacy violations in online learning environments and providing solutions for educators, students and system administrators. Practitioner notesWhat is already known about this topic Digital learning environments pose a threat to the privacy of students. The fact that privacy violations in the OLC can trigger concerns among students has a negative impact on learning processes. There is high interest at the moment in how to plan the most effective teaching in online learning environments—but privacy is being neglected. What this paper adds This article explains the privacy violations university students encounter at the OLC. This document contains guidelines on how to mitigate and prevent privacy violations in OLC. The results of the study also provide suggestions for privacy protection at the OLC. Implications for practice and/or policy It is important that the instructors who participate in the OLC are informed about the necessary measures, rules, principles, activities and follow‐up measures to protect their personal privacy. If we can overcome students' concerns about privacy violations at the OLC, we can create more comfortable learning spaces. The aim of learning should not only be to peak performance; the most important responsibility of educators or system administrators is to preserve each student's private space, while at the same time achieving the best performance.

show abstract

“…Based on this, S.D . ≤ 1 is used as a cut-off point based on the 5-point Likert scale as it represents the high level of interexpert consensus (Christie & Barela, 2005). Another judgment of interexpert consensus is determined if the items are rated with a median value of ≥4.0 (Foster et al, 2009).…”

Section: Methodsmentioning

confidence: 99%

Developing an Evaluation Model for Monitoring Country-Based Tourism Competitiveness

Liu

Chiang

2021

Sage Open

View full text Add to dashboard Cite

Using pillars and sub-index from the Travel and Tourism Competitiveness Index (T & TCI) to measure a destination’s competitiveness is popular. Still, its methodology underlying the calculation has been criticized. So the T&TCI Index has not been regarded as a reliable measure of a destination’s competitiveness. In this regard, this paper sought to set out a country-based tourism competitiveness evaluation model with various statistical methods to indicate how important tourism policy development has to design. We used data from an expert survey to examine the attributes and sub-attributes and shape the decision-making. We addressed a theoretical six-step procedure to ensure the evaluation model’s rigor in the model development context. The first was to do data collection. The second was to examine construct underrepresentation. The third was to examine common method bias. The fourth was to examine construct-irrelevant variances. The fifth was to evaluate intergroup consistency. And the sixth was to develop attribute weight. Our study showed that a country-based tourism competitiveness evaluation model encompassed 8 attributes and 28 sub-attributes. We identified cultural uniqueness, ecology and the environment as the two most important attributes. In the end, we addressed the practical contributions of this study and methods to policy-makers and researchers.

show abstract

The Delphi Technique as a Method for Increasing Inclusion in the Evaluation Process

Cited by 53 publications

References 0 publications

What Makes Collegiate Sport Club Programs Successful? Exploration of How Success Is Measured and Perceived

What Makes Collegiate Sport Club Programs Successful? Exploration of How Success Is Measured and Perceived

University students' digital spaces in online learning communities: Implications for understanding, protecting and maintaining privacy

Developing an Evaluation Model for Monitoring Country-Based Tourism Competitiveness

Contact Info

Product

Resources

About