A Discrete Empirical Interpolation Method for Interpretable Immersion and Embedding of Nonlinear Manifolds

Abstract

Manifold learning techniques seek to discover structure-preserving mappings of high-dimensional data into low-dimensional spaces. While the new sets of coordinates specified by these mappings can closely parameterize the data, they are generally complicated nonlinear functions of the original variables. This makes them difficult to interpret physically. Furthermore, in data-driven model reduction applications the governing equations may have structure that is destroyed by nonlinear mapping into coordinates on an inertial manifold, creating a computational bottleneck for simulations. Instead, we propose to identify a small collection of the original variables which are capable of uniquely determining all others either locally via immersion or globally via embedding of the underlying manifold. When the data lies on a low-dimensional subspace the existing discrete empirical interpolation method (DEIM) accomplishes this with recent variants employing greedy algorithms based on pivoted QR (PQR) factorizations. However, low-dimensional manifolds coming from a variety of applications, particularly from advection-dominated PDEs, do not lie in or near any low-dimensional subspace. Our proposed approach extends DEIM to data lying near nonlinear manifolds by applying a similar pivoted QR procedure simultaneously on collections of patches making up locally linear approximations of the manifold, resulting in a novel simultaneously pivoted QR (SimPQR) algorithm. An optimization problem is solved at each stage to greedily select a coordinate and the manifold patches over which the coordinate is used for pivoting. The immersion provided by applying Sim-PQR to the tangent spaces can be extended to an embedding by applying SimPQR a second time to a modified collection of vectors. The SimPQR method for computing these "nonlinear DEIM" (NLDEIM) coordinates for immersion and embedding is successfully applied to real-world data lying near an inertial manifold in a cylinder wake flow as well as data coming from a viscous Burgers equation with different initial conditions.

Adaptive sparse interpolation for accelerating nonlinear stochastic reduced-order modeling with time-dependent bases

“…One of the most widely used algorithms is the discrete empirical interpolation method (DEIM) [25], in which the nonlinear terms are discretely sampled at O(r) points in online calculations. Other methods that aim to extend this idea include the Q-DEIM method [26], the Weighted DEIM (W-DEIM) [27], Nonlinear DEIM (NLDEIM) [28], and Randomized DEIM (R-DEIM) [29]. The localized discrete empirical interpolation method [30] was introduced to calculate a number of local subspaces, each tailored to a special part of a dynamical system.…”