Intellectual classifier development of citizens' messages on the «Our St. Petersburg» portal: experience in using machine learning methods

Abstract

Functional features are investigated and shortcomings in the existing process of sending messages about city problems on the portal «Our St. Petersburg» are revealed. The approach to the development of automatic classification of citizens ' messages by existing on the portal categories is described. Based on the reports submitted by citizens in the amount of 1.5 million, training and test samples were formed in the ratio of 80% and 20% of the main volume of texts, respectively. Based on the training data sample and 194 categories, the algorithm of automatic classification was trained using such classical methods of machine learning as naive Bayes classifier, decision trees and artificial neural networks. Using the method of determining the effectiveness of the classification and the test sample, the trained algorithm was tested and checked. The analysis revealed that the algorithm based on the use of artificial neural networks shows the best result among the other methods used. The average classification accuracy of the algorithm was 82%. The trained algorithm was used in the development of an intelligent classifier, which is a web application and implements API mechanisms for interaction with the main modules of the portal information system.

The Use of Artificial Intelligence in eParticipation: Mapping Current Research

“…Paper ID F-measure [44,45,47,48,57,58,60,64,66,73,77,80,82,86] Precision [43,45,57,60,62,66,67,73,[76][77][78]80,82,86] Accuracy [43,44,46,62,63,69,70,73,[76][77][78]80,82] Recall [45,52,57,60,62,66,73,77,78,80,82,…”

“…Finally, the collection of citizens' opinions, termed eConsultation, constitutes another category of eParticipation activities that is present in the studies. Most studies in this cluster focus on data analysis from eConsultation platforms [43,46,47]. Additionally, exploration into game design principles to enhance eConsultation initiatives [55] and optimize AI utilization in governance through eConsultation platform data [45] is noted.…”

“…In addition, reference is made to European Union policies concerning the principle of explainable AI [50]. In two papers, legal factors are briefly discussed [46,53]. Lastly, a study addressing challenges in the implementation of an eParticipation initiative highlights the ambiguous legal framework, which partially obstructs activity implementation, compounded by official bodies' inability to furnish clear guidance [81].…”