ESAS: Towards Practical and Explainable Short Answer Scoring (Student Abstract)

Goenka, Palak; Piplani, Mehak; Sawhney, Ravinder Singh; Mathur, Puneet; Shah, Rajiv Ratn

doi:10.1609/aaai.v34i10.7170

Cited by 4 publications

(1 citation statement)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…e most prominent dataset for Automated Essay scoring is the Automated Student Assessment Prize (ASAP) dataset 1 . AES systems using the ASAP dataset o en model as a regression problem [9,11] and then convert it into categorical variables, due to the narrow range of scoring values within the dataset. Our dataset has much larger sequence length compared to essays, as well as a wider scoring range (0-100), which makes it a more challenging problem to solve.…”

Section: Related Workmentioning

confidence: 99%

An Interpretable Deep Learning System for Automatically Scoring Request for Proposals

Maji,

Appe,

Bali

et al. 2020

Preprint

View full text Add to dashboard Cite

e Managed Care system within Medicaid (US Healthcare) uses Request For Proposals (RFP) to award contracts for various healthcare and related services. RFP responses are very detailed documents (hundreds of pages) submi ed by competing organisations to win contracts. Subject ma er expertise and domain knowledge play an important role in preparing RFP responses along with analysis of historical submissions. Automated analysis of these responses through Natural Language Processing (NLP) systems can reduce time and e ort needed to explore historical responses, and assisting in writing be er responses. Our work draws parallels between scoring RFPs and essay scoring models, while highlighting new challenges and the need for interpretability. Typical scoring models focus on word level impacts to grade essays and other short writeups. We propose a novel Bi-LSTM based regression model, and provide deeper insight into phrases which latently impact scoring of responses. We contend the merits of our proposed methodology using extensive quantitative experiments. We also qualitatively asses the impact of important phrases using human evaluators. Finally, we introduce a novel problem statement that can be used to further improve the state of the art in NLP based automatic scoring systems.

show abstract

Section: Related Workmentioning

confidence: 99%