An Examination and Evaluation of Question Preparation for Computer-based Testing in Dental Education

Abstract

Faculty members of each university are responsible for preparing and implementing shared testing. While the questions for computer-based testing(CBT)are publicly gathered and prepared by each university every year, the effort to prepare questions for CBT is said to be meaningful not only in improving the question preparation skill of the faculty members but also in improving educational awareness and strengthening collaborations among different fields. In the present study, we evaluated the effects on educational activities and the awareness of the faculty members responsible for question preparation. A survey was conducted among faculty subjects who were responsible for CBT question preparation. The rates of positive responses received regarding question preparation for CBT were high, and no significant rate difference was observed between the items. The scores in the basic department group and the clinical department group regarding the level of understanding of the dental education model core curriculum, the level of understanding of the importance of education, and the effect on improving the awareness of education were each significantly higher in the basic department group than in the clinical department group (p < 0.05). Among the overall positive responses, there were no significant differences between the basic department group and the clinical department group, while the negative responses (items needing study and improvement) were significantly different(p < 0.05)between the two groups. These results suggest that the preparation of questions for CBT contributes to increased effects on and consciousness of educational activities, and the effects were particularly high in the basic department group. In addition, in the clinical departments, there was a high rate of items needing study and improvement, as clinical department faculty members have clinical practice as well as education and research to manage, which requires considerable effort and hinders the pursuit of other tasks. The study results also indicated that our facultyʼs system for the preparation of questions needs to be not only maintained but also further improved to increase the understanding and consciousness of education and to reduce the burden of education, as there were some items showing less educational effects, understanding, and change.