This paper is devoted to the analysis of a bilinear optimal control problem subject to the Fokker-Planck equation. The control function depends on time and space and acts as a coefficient of the advection term. For this reason, suitable integrability properties of the control function are required to ensure well-posedness of the state equation. Under these low regularity assumptions and for a general class of objective functionals, we prove the existence of optimal controls. Moreover, for common quadratic cost functionals of tracking and terminal type, we derive the system of first order necessary optimality conditions.

Among the infinite number of possible movements that can be produced, humans are commonly assumed to choose those that optimize criteria such as minimizing movement time, subject to certain movement constraints like signal-dependent and constant motor noise. While so far these assumptions have only been evaluated for simplified point-mass or planar models, we address the question of whether they can predict reaching movements in a full skeletal model of the human upper extremity. We learn a control policy using a motor babbling approach as implemented in reinforcement learning, using aimed movements of the tip of the right index finger towards randomly placed 3D targets of varying size. We use a state-of-the-art biomechanical model, which includes seven actuated degrees of freedom. To deal with the curse of dimensionality, we use a simplified second-order muscle model, acting at each degree of freedom instead of individual muscles. The results confirm that the assumptions of signal-dependent and constant motor noise, together with the objective of movement time minimization, are sufficient for a state-of-the-art skeletal model of the human upper extremity to reproduce complex phenomena of human movement, in particular Fitts’ Law and the $$\frac{2}{3}$$ 2 3 Power Law. This result supports the notion that control of the complex human biomechanical system can plausibly be determined by a set of simple assumptions and can easily be learned.

This paper presents first results for the stability analysis of Model Predictive Control schemes applied to the Fokker-Planck equation for tracking probability density functions. The analysis is carried out for linear dynamics and Gaussian distributions, where the distance to the desired reference is measured in the L 2 -norm. We present results for general such systems with and without control penalization. Refined results are given for the special case of the Ornstein-Uhlenbeck process. Some of the results establish stability for the shortest possible (discrete time) optimization horizon N = 2. X t (t = 0) = X 0 a.s.,

Optimal feedback control (OFC) is a theory from the motor control literature that explains how humans move their body to achieve a certain goal, e.g., pointing with the finger. OFC is based on the assumption that humans aim to control their body optimally, within the constraints imposed by body, environment, and task. In this paper, we explain how this theory can be applied to understanding Human-Computer Interaction (HCI) in the case of pointing. We propose that the human body and computer dynamics can be interpreted as a single dynamical system. The system state is controlled by the user via muscle control signals, and estimated from observations. Between-trial variability arises from signal-dependent control noise and observation noise. We compare four different models from optimal control theory and evaluate to what degree these models can replicate movements in the case of mouse pointing. We introduce a procedure to identify parameters that best explain observed user behavior. To support HCI researchers in simulating, analyzing, and optimizing interaction movements, we provide the Python toolbox OFC4HCI . We conclude that OFC presents a powerful framework for HCI to understand and simulate motion of the human body and of the interface on a moment by moment basis.

No abstract