Question paper generation through progressive model and difficulty calculation on the Promexa Mobile Application

Abstract

Mobile learning has been increased in past years and has attracted the interests of academicians and educators in the past many years especially in higher education. The mobile-based online test is the buzzing in the current pandemic time. Institutions need to use online learning as a powerful tool for conducting exams and assess the students effectively. Integrating technology in education can be advantageous for universities and help engage better results for students. Therefore, it is important to understand each student their capacities and create a different test based on the required difficulty. Students should be graded based on their capabilities. The purpose of the research study is to develop the progressive model with the calibration of difficulty level according to the student capacity. To achieve the goal, a test of 20 python questions was conducted on 120 students with each question having difficulty given by 8 field experts. To verify the model, 5 categories were formed with different difficulty levels which in turn gave satisfactory results. To find a relation between the initial difficulty and the calculative difficulty based on the student response, a correlation test was conducted. After careful analysis of the question difficulty and student responses, it was observed that both are highly dependent on each other wherein the difficulty level of any question can be calculated using incorrect answers. The correlation coefficient obtained between them was 0.9833. Upon collecting the difficulty of the questions and student responses, respective grading could be done using the stated formula. Later on, the progressive model was simulated with five different cases (Best case, above-average case, below average case, the average case, worst case). The model outperformed in all the cases with appropriate difficulty levels. Online Tests have ushered a revolution in the assessment of students but yet they tend to be unpopular in India as the evaluation based on pen-paper approach is preferred. The main reasons for this are difficult to grade everyone at the same level, susceptible to cheating, and transition to open books. Using our study, universities can identify obstacles, and prepare an appropriate result-driven plan of action for implementing the mobile-based online test and make easy migration from paper-based test to online test.

A Systematic Review on AI-based Proctoring Systems: Past, Present and Future

“…Nonetheless, the above analysis revealed that Remote Proctoring platforms raise ethical concerns over-and-above those affecting live and in-person exam invigilation. These concerns include an uncertain risk of academic unfairness associated with AI-informed judgement (Singh et al, 2021 ), further diminution of student privacy and autonomy, and increased distrust towards institutions that are bastions of social values. Another fear, partially dependent on these former fears, is that these platforms could contribute to the issues of growing surveillance, liberty and privacy loss, mining of massed personal data, and dubious instances of AI decision-making.…”

Assessment of The Difficulty of Mathematics High-Level Reasoning Using Focus Group Discussion and Program Item Approaches

“…The categorization of the DL of the questions makes it easier to interpret, for example, easy, medium, and difficult questions. A lot of literature refers to this interpretation by making other criteria (Singh et al, 2021) and (Turkmen & Caner, 2020). The DL is classified as follows.…”

Moving Learning: A Systematic Review of Mobile Learning Applications for Online Higher Education

“…The first introduced a mobile educational application providing theoretical knowledge and question-based tests for computer engineering undergraduate students (Kayaalp & Dinc, 2022). Singh et al (2021) devel-oped a progressive model calibrating the difficulty level based on learner understanding in Computer Science education, which will prepare institutions for the transition from paper-based to mobile-based online tests. Voshaar et al (2022) measured how a gamified mobile learning application influenced exam success on a course in the field of Business and Administration Studies.…”