Ontology-Based Generation of Multilingual Questions for Assessment in Medical Education

Abstract

The requirements of state-of-the-art curricula and teaching processes in medical education have brought both new and improved the existing assessment methods. Recently, several promising methods have emerged, among them the Comprehensive Integrative Puzzle (CIP), which shows great potential. However, the construction of such questions requires high efforts of a team of experts and is time-consuming. Furthermore, despite the fact that English language is accepted as an international language, for educational purposes there is also a need for representing data and knowledge in native language. In this paper, we present an approach for automatic generation of CIP assessment questions based on using ontologies for knowledge representation. In this way, it is possible to provide multilingual support in the teaching and learning process because the same ontological concept can be applied to corresponding language expressions in different languages. The proposed approach shows promising results indicated by dramatic speeding up of construction of CIP questions compared to manual methods. The presented results represent a strong indication that adoption of ontologies for knowledge representation may enable scalability in multilingual domain-specific education regardless of the language used. High level of automation in the assessment process proven on the CIP method in medical education as one of the most challenging domains, promises high potential for new innovative teaching methodologies in other educational domains as well.

Systematic Review: AI's Impact on Higher Education - Learning, Teaching, and Career Opportunities

“…This study undertook a comprehensive evaluation of the influence of artificial intelligence (AI) on higher education, with a particular focus on critical aspects such as educational quality, learning and teaching processes, assessment methods, ethical implications, and prospective career opportunities [10], [23], [40], [43]. The analysis findings highlight a growing body of research that underscores the significance of AI in higher education and the potential advantages associated with its integration into the educational framework.…”

“…Similarly, Campos [10] used AI to validate the academic credits of higher education institutions, with the system meeting its objectives and effectively validating the academic credit analysis in 89.4% of cases. Additionally, Radović [40] emphasised the need for an effective curriculum and revised assessment procedures, highlighting the potential of AI-based automated assessment in medical education [40].…”

La ontología como herramienta de representación terminológica: consideraciones para su construcción

“…Radovic et al (2020) 25 todos los campos del conocimiento, incluida la educación en ciencias de la salud. Una ontología va más allá de una lista ordenada de palabras y definiciones, se postula como un "vocabulario controlado", un sistema complejo, una propuesta documental con reglas bien establecidas, validadas y reconocidas.…”

An Ontology-Driven Learning Assessment Using the Script Concordance Test

“…The adoption of ontologies and semantic knowledge graphs (SKGs) for knowledge representation has become the cornerstone technology [22] that could enable SCT to advance further. Ontologies have been used for over a decade, for automatic question generation, and its successful application is presented in a number of research papers [23][24][25][26], etc.…”