Modeling unit non-response and validity of online teaching evaluation in higher education using generalizability theory approach

Abstract

IntroductionUnit non-response is a common phenomenon in online teaching evaluation in higher education institutions. However, little is known about the relationship between the rates of unit non-response and the quality of online teaching evaluation exercise. This study explored the incidence of unit non-response and how this phenomenon relates to the reliability of students’ responses to online teaching evaluation.MethodsAdopting the generalizability theory approach, students’ evaluation of teaching data from a university in Ghana was analyzed by conducting both generalizability study (G-study)- and decision study (D-study) analyses.ResultsThe results revealed that unit non-response among students was predominant in online teaching evaluation exercise. The study demonstrated that higher rates of non-response among students were associated with high levels of measurement errors and low reliability of responses.DiscussionThe findings of this study have implications for the accuracy of online evaluation data obtained for decision-making in higher education contexts. The study calls on higher education administrators to embark on sensitization and awareness campaigns that target students on the need to actively participate in the appraisal of teaching at the university to address the issue of unit non-response.

Association between adult attachment and mental health states among health care workers: the mediating role of social support

“…Additionally, it is worth noting that this investigation was conducted exclusively among medical staff and students in a large tertiary general hospital. Therefore, the generalizability of the results to other populations should be approached with caution ( Dzakadzie and Quansah, 2023 ). Additionally, while all subjects experienced the same quarantine, it is important to acknowledge that the pandemic may have various other stressful factors, such as increased frequency of deaths, loss of relatives, working in non-professional fields, etc.…”

The risk and protective factors on the mental health of healthcare workers during the lockdown period due to covid-19 pandemic

“…Additionally, the survey only targeted healthcare workers in one large tertiary general hospital. Hence, caution should be exercised when generalizing the results to other populations 21 , and further research is needed to determine its applicability to other populations. Moreover, although all subjects underwent the same quarantine, it is crucial to recognize that the pandemic may have introduced additional stressors, such as a higher incidence of deaths, loss of loved ones, employment in non-professional sectors, and so forth.…”

Prospective association of eHealth literacy and health literacy with physical activity among Chinese college students: a multiple mediation analysis

“…Second, the results are only based on the responses among Chinese college students, therefore its application in other groups or areas needs to be examined. Third, online self-report questionnaires were applied, which may result in unreliability and inaccuracy because of the inherent drawbacks of self-reporting (i.e., recall bias, over- or under-reporting, non-response error, and social desirability) ( 118 , 119 ). Fourth, it was valuable that the findings give new insights into the antecedents of behavior intention (>60%), yet the whole model only explained 6% of PA, hinting that more components and covariates need to be identified in the future (e.g., volitional factors between intention and behavior) ( 120 ).…”