Iterative Alpha Expansion for Estimating Gradient-Sparse Signals from Linear Measurements

Abstract

We consider estimating a piecewise‐constant image, or a gradient‐sparse signal on a general graph, from noisy linear measurements. We propose and study an iterative algorithm to minimize a penalized least‐squares objective, with a penalty given by the “ℓ0‐norm” of the signal’s discrete graph gradient. The method uses a non‐convex variant of proximal gradient descent, applying the alpha‐expansion procedure to approximate the proximal mapping in each iteration, and using a geometric decay of the penalty parameter across iterations to ensure convergence. Under a cut‐restricted isometry property for the measurement design, we prove global recovery guarantees for the estimated signal. For standard Gaussian designs, the required number of measurements is independent of the graph structure, and improves upon worst‐case guarantees for total‐variation (TV) compressed sensing on the 1‐D line and 2‐D lattice graphs by polynomial and logarithmic factors respectively. The method empirically yields lower mean‐squared recovery error compared with TV regularization in regimes of moderate undersampling and moderate to high signal‐to‐noise, for several examples of changepoint signals and gradient‐sparse phantom images.

A Novel Nonlinear Filter-Based Robust Adaptive Control Method for a Class of Nonlinear Discrete-Time Systems

“…where γ(k) is a monotonic increasing function of p(k), and its values range from 1 to 4, i.e., γ(k) ∈ [1,4]. Thus, it is concluded that γ(k) is a non-decreasing, bounded, and positive tuning factor.…”

“…In past years, a substantial amount of research has been devoted to advancing the field of adaptive control for continuous-time nonlinear systems. Numerous industrial processes exhibit nonlinear behavior, and various methods have been developed for identifying nonlinear systems, which can be applied to input nonlinear systems, output nonlinear systems, and systems with both input and output nonlinearities [1][2][3][4].…”