OL-JCMSR: A Joint Coding Monitoring Strategy Recommendation Model Based on Operation Log

Abstract

A surveillance system with more than hundreds of cameras and much fewer monitors strongly relies on manual scheduling and inspections from monitoring personnel. A monitoring method which improves the surveillance performance by analyzing and learning from a large amount of manual operation logs is proposed in this paper. Compared to fixed rules or existing computer-vision methods, the proposed method can more effectively learn from the operators’ behaviors and incorporate their intentions into the monitoring strategy. To the best of our knowledge, this method is the first to apply a monitoring-strategy recommendation model containing a global encoder and a local encoder in monitoring systems. The local encoder can adaptively select important items in the operating sequence to capture the main purpose of the operator, while the global encoder is used to summarize the behavior of the entire sequence. Two experiments are conducted on two data sets. Compared with att-RNN and att-GRU, the joint coding model in experiment 1 improves the Recall@20 by 9.4% and 4.6%, respectively, and improves the MRR@20 by 5.49% and 3.86%, respectively. In experiment 2, compared with att-RNN and att-GRU, the joint coding model improves by 11.8% and 6.2% on Recall@20, and improves by 7.02% and 5.16% on MRR@20, respectively. The results illustrate the effectiveness of the our model in monitoring systems.

Machine Learning-Supported Designing of Human–Machine Interfaces

“…Although there are solutions for data-driven optimisation of industrial HMIs [9], systems containing parallel and overlapping processes require a more sophisticated method. Operator behaviour models were explored from the operation log [11] or based on semi-Markovian models [12]. The mentioned techniques are essential for developing an adaptive and interactive HMI, but are insufficient on their own.…”