This paper deals with a natural stochastic optimization procedure derived from the so-called Heavy-ball method differential equation, which was introduced by Polyak in the 1960s with his seminal contribution [Pol64]. The Heavy-ball method is a second-order dynamics that was investigated to minimize convex functions f . The family of second-order methods recently received a large amount of attention, until the famous contribution of Nesterov [Nes83], leading to the explosion of large-scale optimization problems. This work provides an in-depth description of the stochastic heavy-ball method, which is an adaptation of the deterministic one when only unbiased evalutions of the gradient are available and used throughout the iterations of the algorithm. We first describe some almost sure convergence results in the case of general non-convex coercive functions f . We then examine the situation of convex and strongly convex potentials and derive some non-asymptotic results about the stochastic heavy-ball method. We end our study with limit theorems on several rescaled algorithms.
We study some recursive procedures based on exact or approximate Euler schemes with decreasing step to compute the invariant measure of Lévy driven SDEs. We prove the convergence of these procedures toward the invariant measure under weak conditions on the moment of the Lévy process and on the mean-reverting of the dynamical system. We also show that an a.s. CLT for stable processes can be derived from our main results. Finally, we illustrate our results by several simulations.
As a continuation of a recent paper, dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to the (possibly weighted) empirical occupation measure of its past positions. General conditions are given ensuring the convergence of this measure to the quasi-stationary distribution of the chain. We then apply this method to the numerical approximation of the quasi-stationary distribution of a diffusion process killed on the boundary of a compact set. Finally, the sharpness of the assumptions is illustrated through the study of the algorithm in a non-irreducible setting.
We study the rate of convergence of some recursive procedures based on some "exact" or "approximate" Euler schemes which converge to the invariant measure of an ergodic SDE driven by a Lévy process. The main interest of this work is to compare the rates induced by "exact" and "approximate" Euler schemes. In our main result, we show that replacing the small jumps by a Brownian component in the approximate case preserves the rate induced by the exact Euler scheme for a large class of Lévy processes.
This paper is concerned with the estimation of the volatility process in a stochastic volatility model of the following form: dX t = a t dt + σ t dW t , where X denotes the log-price and σ is a càdlàg semi-martingale. In the spirit of a series of recent works on the estimation of the cumulated volatility, we here focus on the instantaneous volatility for which we study estimators built as finite differences of the power variations of the log-price. We provide central limit theorems with an optimal rate depending on the local behavior of σ. In particular, these theorems yield some confidence intervals for σ t .
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.