We derive and analyse a scheme for the approximation of order d tensors A ∈ R n 1 ×···×n d in the hierarchical (H-) Tucker format, a dimension-multilevel variant of the Tucker format and strongly related to the TT (tensor train) format. For a fixed rank parameter k, the storage complexity of a tensor in H-Tucker format is O dk 3 + k d i=1 n i and we present a (heuristic) algorithm that finds an approximation to a tensor in the H-Tucker format in O dk 4 + log(d)k 2 d i=1 n i by inspection of only O dk 3 + log(d)k 2 d i=1 n i entries. Under mild assumptions, tensors in the H-Tucker format are reconstructed. For general tensors we derive error bounds that are based on the approximability of matrices (matricizations of the tensor) by few outer products of its rows and columns. The construction parallelizes with respect to the order d and we also propose an adaptive approach that aims at finding the rank parameter for a given target accuracy ε automatically.
We consider the problem of fitting a low rank tensor A ∈ R I , I = {1, . . . , n} d , to a given set of data points {M i ∈ R | i ∈ P }, P ⊂ I. The low rank format under consideration is the hierarchical or TT or MPS format. It is characterized by rank bounds r on certain matricizations of the tensor. The number of degrees of freedom is in O(r 2 dn). For a fixed rank and mode size n we observe that it is possible to reconstruct random (but rank structured) tensors as well as certain discretized multivariate (but rank structured) functions from a number of samples that is in O(log N ) for a tensor having N = n d entries. We compare an alternating least squares fit (ALS) to an overrelaxation scheme inspired by the LMaFit method for matrix completion. Both approaches aim at finding a tensor A that fulfils the first order optimality conditions by a nonlinear Gauss-Seidel type solver that consists of an alternating fit cycling through the directions µ = 1, . . . , d. The least squares fit is of complexity O(r 4 d#P ) per step, whereas each step of ADF is in O(r 2 d#P ), albeit with a slightly higher number of necessary steps. In the numerical experiments we observe robustness of the completion algorithm with respect to noise and good reconstruction capability. Our tests provide evidence that the algorithm is suitable in higher dimension (>10) as well as for moderate ranks.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.