Ontology-based Activity Intention Recognition via Human-in-the-loop Framework

Abstract

Human intention recognition is crucial for various human-centered settings.Existing approaches can be categorized into data-driven and knowledge-drivenmethods. While data-driven methods have shown promising performance withlarge training sets, they face challenges in data collection and limited interpretability.In contrast, knowledge-driven methods have the advantage of notrequiring training data and being interpretable, but acquiring high-qualitydomain knowledge is time-consuming and costly. To address these challenges,we propose OntoIR, a novel Ontology-based human activity Intention Recognitionsystem with a human-in-the-loop rule generation and refinement framework.OntoIR involves an ontology and human-guided logical rules to recognize humanactivities and intentions. By Leveraging rule mining model, the OntoIR extractscandidate rules enriches them with contextual information. Human experts thencurate meaningful rules and supplement insufficient context information. Thisallows us to obtain explainable human intention recognition results throughexpressive rules in situations where data is scarce. To evaluate our system,we collect an Activity/Intention recognition dataset, AICar, in a car showroomenvironment. Comprehensive experiments are conducted on the AICar,demonstrating that the collaboration of rule-mining models and domain expertsimproves the performance of activity intention recognition without lowering theinterpretability of recognition results.