National Student Survey: Reliability and prediction of overall satisfaction scores with special reference to UK Dental Schools

Abstract

Introduction The aim of this study was to assess the reliability of the UK National Student Survey (NSS) (2018) and explore the predictive values of individual questions and question domains on the overall satisfaction score. Methods UK NSS result data (for 2018) were assessed for all those providers that award an undergraduate degree in dentistry. To analyse the correlation of each question item to the overall satisfaction question (question 27), a bivariate 2‐tailed Pearson correlation test was conducted, where a P value of <.05 was considered statistically significant. The same test was used to assess such correlation at question domain level. Cronbach's alpha was used to assess the test reliability of the NSS data. Results Question 5 (“My course has provided me with opportunities to explore ideas or concepts in depth”) had the highest predictive value, explaining 85% of the correlation data to the overall satisfaction question. The strongest positive correlation could be seen at the “teaching on my course” and “learning opportunities” domains, whereby 84% of the data can be explained by each of these variables. The worst predictor domain was assessment and feedback, whereby only 40% of the data could be explained by the correlation line. Cronbach's alpha was 0.952‐0.976. Conclusions The NSS is a highly reliable test, both at question and domain levels. The highest predictors of overall satisfaction are teaching, learning opportunities and academic support domains. Assessment and feedback has weak predictive value towards the overall satisfaction score. Question 5 is highly predictive of the overall outcome.

Subscales in the National Student Survey (NSS): Some considerations on their structure

“…However, these ideas cannot explain why we found different results from more recent studies (HEFCE, 2016;Satterthwaite & Vahid Roudsari, 2020). One possible reason for this is that the solution that is found may depend on the way that the analysis is undertaken.…”

“…For example, one study found that the NSS questions were reliable when assessing the data from dentistry courses (Satterthwaite & Vahid Roudsari, 2020). Moreover, smaller-scale pilot studies have been undertaken to analyse the structure data at a holistic level across a variety of courses (HEFCE, 2015(HEFCE, , 2016.…”

Metrics of student dissatisfaction and disagreement: longitudinal explorations of a national survey instrument

“…In addition, we explored long-term data from the original UK survey instrument, and this instrument has now been modified. Satterthwaite and Roudsari ( 2020 ) explored the UK’s updated NSS instrument and found that, together with the perceived value of teaching quality, a new category of ‘learning opportunities’ was of significant importance. Parapadakis ( 2020 ) used related artificial intelligence approaches to explore NSS metrics from Computer Science courses and agreed generally with our predictors, whilst also highlighting differences in predictive factors between institutional typologies and institutional rankings.…”

Online laboratory practices and assessment using training and learning activities as teaching methodologies adapted to remote learning. Student satisfaction and improved academic performance

“…The questions were the same for all the subjects involved in this experience: subjects 1, 3, 4, and 2, the latter only for the academic year 2020–21, from Table 1 . The Likert-type questions sought students’ assessment of the new teaching methodology of online practices, as well as their degree of satisfaction [ 41 , 42 ], while the multi-choice question was intended for students to point out what, in their opinions, were the advantages and disadvantages of the new methodology.…”