A switched dynamic model for pointing tasks with a computer mouse

Abstract

In this paper, we study one of the most fundamental tasks in human-computer interaction, the pointing task. It can be described simply as reaching a target with a cursor starting from an initial position (e.g. executing a movement using a computer mouse to select an icon). In this paper, a switched dynamic model is proposed to handle cursor movements in indirect pointing tasks. The model contains a ballistic movement phase governed by a nonlinear model in Lurie form and a corrective movement phase described by a linear visual-feedback system. The stability of the model is first established and the derived model is then validated with experimental data acquired in a pointing task with a mouse. It is established that the measured data of pointing movements of different types can be fitted within the proposed model. Numerical comparison against pointing models available in the literature is also provided.

Intermittent Control as a Model of Mouse Movements

“…The switching characteristic separates the movement into an open-loop initial surge phase and a later continuous current control phase. This switching behaviour has also been modelled by Aranovskiy et al [2016] and further in Aranovskiy et al [2020]. Based on the optimised dualsubmovement model and the surge model, they develop a two-phase model that takes into account non-linear pointing transfer functions (PTFs) which map from mouse movement to cursor movement.…”

On Computer Mouse Pointing Model Online Identification and Endpoint Prediction

“…First, the chosen model in the correction phase was evaluated in the simulation, where the model parameters were assigned artificially: b 1 = 4, b 2 = 7, T x = 600 pxl and PTF= arctan (it can be any bounded function according to [15]). The model identification results are presented in Fig.…”

“…Another feature of this model was the possibility of modeling the multiple open-loop phases (also called sub-movements). More recently, based on this principle and the VITE model, a united switched dynamical model was created in [15], verified on experimental data of [16], and whose closed-loop stability has been proven. Another line of research was based on Todorov's optimal feedback control of motor coordination [17], [18], [19].…”

“…Both problems described above are usually separated and not considered together in a single model-based prediction algorithm, which could be more advantageous for description and analysis. We fill the indicated gap in the present work, and an endpoint prediction algorithm is presented, based on a new simplified version of the dynamical model given in [15]. The aim of simplifying the model from [15] is to improve the possibility of online parameter identification and allow the process characteristics to be adjusted or modified online.…”

“…We fill the indicated gap in the present work, and an endpoint prediction algorithm is presented, based on a new simplified version of the dynamical model given in [15]. The aim of simplifying the model from [15] is to improve the possibility of online parameter identification and allow the process characteristics to be adjusted or modified online. Another advantage of the presented model is its portability since we do not suppose to know the used surfaces that the computer mouse operates on, the Pointing Transfer Function (PTF) of the operating systems (which will be introduced later in the text), or other varying setup conditions.…”