A Data-Based Simulation Study of Reliability for an Adaptive Assessment Based on Knowledge Space Theory

Doble, Christopher; Matayoshi, Jeffrey; Cosyn, Eric; Uzun, Hasan; Karami, Arash

doi:10.1007/s40593-019-00176-0

Cited by 28 publications

(6 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…There is no standard approach to assess the reliability of adaptive tests [9], let alone the reliability of student models that account for learning. In contrast, there is a standard approach to assess the validity of student models: through the performance on the next answer correctness prediction task [27].…”

Section: Evaluation Of Student Modelsmentioning

confidence: 99%

Validity and Reliability of Student Models for Problem-Solving Activities

Effenberger

Pelánek

2021

LAK21: 11th International Learning Analytics and Knowledge Conference

View full text Add to dashboard Cite

Student models are typically evaluated through predicting the correctness of the next answer. This approach is insufficient in the problem-solving context, especially for student models that use performance data beyond binary correctness. We propose more comprehensive methods for validating student models and illustrate them in the context of introductory programming. We demonstrate the insufficiency of the next answer correctness prediction task, as it is neither able to reveal low validity of student models that use just binary correctness, nor does it show increased validity of models that use other performance data. The key message is that the prevalent usage of the next answer correctness for validating student models and binary correctness as the only input to the models is not always warranted and limits the progress in learning analytics. CCS CONCEPTS• Human-centered computing → User models; • Applied computing → Interactive learning environments.

show abstract

Section: Evaluation Of Student Modelsmentioning

confidence: 99%

Validity and Reliability of Student Models for Problem-Solving Activities

Effenberger

Pelánek

2021

LAK21: 11th International Learning Analytics and Knowledge Conference

View full text Add to dashboard Cite

show abstract

“…The hardware includes servers, servers, and network equipment. Through the mining, storage, analysis, and processing of sports education resource data, the correctness and security of rich information resources are guaranteed [ 10 ]. Virtual resource layer This layer is adjacent to the physical layer.…”

Section: Construction Of a Distance Multimedia Sports Teaching Platfomentioning

confidence: 99%

Design of Distance Multimedia Physical Education Teaching Platform Based on Artificial Intelligence Technology

Qin

2020

Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

View full text Add to dashboard Cite

The traditional neural network-based education platform has the problem of slow access to resources, which affects teaching efficiency. To this end, artificial intelligence technology is introduced for the design of distance multimedia sports teaching platforms. Through system hardware and software design, enhance the integration capability of the teaching platform, improve the controllability of the teaching platform, help the physical education platform to obtain more educational resources, accelerate the processing and integration analysis of educational information, and better assist teachers in developing physical education jobs. In order to verify the effectiveness of the method in this paper, the method in this paper is compared with the teaching platform based on neural network,the experimental results show that the platform can obtain resources quickly and has broad application prospects.

show abstract

“…Avaliação Adaptativa, também conhecida como Teste Adaptativo Computadorizado (do inglês Computerized Adaptive Tests -CAT), é uma forma de avaliar indivíduos na qual as perguntas, atividades ou tarefas solicitadas em uma avaliação se adaptam ao conhecimento e/ou às habilidades do indivíduo (Doble, 2019). As atividades aplicadas dependem, portanto, das respostas das atividades anteriores, permitindo que a avaliação se adeque às características de quem está sendo avaliado.…”

Section: Avaliação Adaptativaunclassified

“…A Teoria do Espaço do Conhecimento (KST) é uma abordagem de avaliação de aprendizagem baseada em um modelo combinatório e probabilístico que permite representar o conhecimento de uma pessoa em um determinado domínio (Doignon, 1985). Vários artigos e livros foram publicados sobre o assunto, porém as duas monografias Doignon e Falmagne (2011) e Falmagne e Doignon (2012) têm maior visibilidade no assunto (Doble, 2019).…”

Section: Knowledge Spaces Theory -Kstunclassified

“…O foco principal do sistema é avaliação adaptativa usada para determinar quais tópicos específicos de matemática um aluno já conhece e quais outros precisa apŕender. Uma extensão do sistema ALEKS é o Placement, Preparation and Learning ALEKS (ALEKS PPL), que visa determinar o domínio de matemática do ensino médio, além de recomendar a preparação para um curso superior de matemática (Doble, 2019).…”

Section: Assessment and Learning In Knowledge Spaces -Aleksunclassified

See 1 more Smart Citation

Avaliação adaptativa utilizando espaço de conhecimento baseado em competência

Alencar¹,

Aranha²,

Campos³

2019

VIII Jornada De Atualização Em Informática Na Educação

View full text Add to dashboard Cite

This work addresses the theme of adaptive assessment, whose objective is to make the evaluation process more efficient. This work presents the main adaptive assessment techniques currently used, their history and their importance in the educational context. Among the techniques used the work is deepened in the Theory Space Knowledge (KST). The application of KST allows to represent the knowledge of a given domain within a learning system. An extension of KST, called Competence-Based Knowledge Space Theory (CbKST), favors the creation of an adaptive assessment system that models competencies and skills, building a more personalized training itinerary. It will be presented the basic concepts of the theory, the techniques for building the knowledge space and later some systems that use the CbKST as a base. A step-by-step description of how to create an adaptive system based on the CbKST will be described, from the construction of the dependencies between competences to the construction of the knowledge structure, in which all possible states of knowledge of a given domain are represented. ResumoEste trabalho aborda o tema de avaliação adaptativa, cujo objetivo é tornar o processo de avaliação mais eficiente. Este trabalho apresenta as principais técnicas de avaliação adaptativa atualmente utilizadas, seu histórico e sua importância no contexto educacional. Dentre as técnicas utilizadas o trabalho aprofunda-se na teoria do espaço do conhecimento (KST). A aplicação do KST permite representar o conhecimento de um determinado domínio dentro de um sistema de aprendizado. Uma extensão do KST, chamada de Teoria do Espaço do Conhecimento baseadas em competência (CbKST), favorece a criação de um sistema de avaliação adaptativa que modela competências e habilidades, construindo um itinerário formativo mais personalizado. Serão apresentados os conceitos básicos da teoria, as técnicas para construção do espaço do conhecimento e posteriormente alguns sistemas que utilizam o CbKST como base. Será descrito um passo a

show abstract

A Data-Based Simulation Study of Reliability for an Adaptive Assessment Based on Knowledge Space Theory

Cited by 28 publications

References 21 publications

Validity and Reliability of Student Models for Problem-Solving Activities

Validity and Reliability of Student Models for Problem-Solving Activities

Design of Distance Multimedia Physical Education Teaching Platform Based on Artificial Intelligence Technology

Avaliação adaptativa utilizando espaço de conhecimento baseado em competência

Contact Info

Product

Resources

About