RUMBA-Mouse: Rapid User Mouse-Behavior Authentication Using a CNN-RNN Approach

Applications of Recurrent Neural Network for Biometric Authentication & Anomaly Detection

“…The goal was to click on static targets around the screen 8 times per trial. The best results came from the fusion CNN-RNN model [23], which was able to authenticate users with an accuracy of 99.39%. Similar techniques to a mouse-based approach are keystroke-based authentication systems, which are the focus of [24][25][26].…”

“…Novel Smartphone Authentication Techniques [19] Mouse and Keyboard Based Authentication Methods [23] Handwritten Authentication Methods [27] Model for Facial Expression Recognition Using LSTM RNN [29] Multimodal Expression Recognition Implementing an RNN Approach [32] Motion History Image Expression Recognition [34] Using an RNN to authenticate users through inertial gait recognition or identify users based on their physical movement patterns. Gait recognition also requires gyroscope and accelerameter sensor data to track movement, Authenticate uses a CNN+RNN fusion to detect behavioral patterns in mouse movement.…”

Machine and Deep Learning Applications to Mouse Dynamics for Continuous User Authentication

“…RNNs in general have seen their fair share of exposure in the mouse dynamics literature [29,30] and with the advent of LSTM-RNNs, continue to produce excellent results across many research domains. Mouse dynamics, generally, can be represented as a sequence of distinct actions over a variable period of time, thus making LSTM-RNNs a strong candidate as a model choice time-series related data.…”

“…For example, due to the spatiotemporal attributes of the data, mouse dynamics can be framed as a time-series problem yet integrate deep learning through different modalities. There are multiple ways to leverage CNNs for mouse dynamics [23], such (a) as using the X and Y coordinates from the raw data to create user mouse maps, as observed in [12], and evaluate their spatial features using a two-dimensional CNN [24]. By focusing on and extracting the spatial features of mouse dynamics data, the image processing capabilities of CNNs can be similarly applied to user authentication.…”

Data driven user authentication with multi-level behavior profiling

“…Rather, we aim to demonstrate that artificiallyinduced motor expertise can complement and enhance the performance of traditional biometric authentication. We do indeed demonstrate this for two existing state-of-the-art mouse based authentication approaches Fu et al (2020); Qin et al (2020). To do so, we design and run a multipleweek IRB-approved experiment on human subjects, and prove that merging artificial intelligence with kinesthetic intelligence provides statistically significant performance benefits.…”