Tensor Decomposition for Signal Processing and Machine Learning

Abstract

Tensors or {\em multi-way arrays} are functions of three or more indices $(i,j,k,\cdots)$ -- similar to matrices (two-way arrays), which are functions of two indices $(r,c)$ for (row,column). Tensors have a rich history, stretching over almost a century, and touching upon numerous disciplines; but they have only recently become ubiquitous in signal and data analytics at the confluence of signal processing, statistics, data mining and machine learning. This overview article aims to provide a good starting point for researchers and practitioners interested in learning about and working with tensors. As such, it focuses on fundamentals and motivation (using various application examples), aiming to strike an appropriate balance of breadth {\em and depth} that will enable someone having taken first graduate courses in matrix algebra and probability to get started doing research and/or developing tensor algorithms and software. Some background in applied optimization is useful but not strictly required. The material covered includes tensor rank and rank decomposition; basic tensor factorization models and their relationships and properties (including fairly good coverage of identifiability); broad coverage of algorithms ranging from alternating optimization to stochastic gradient; statistical performance analysis; and applications ranging from source separation to collaborative filtering, mixture and topic modeling, classification, and multilinear subspace learning.Comment: revised version, overview articl

Review of Polynomial Chaos-Based Methods for Uncertainty Quantification in Modern Integrated Circuits

“…Indeed, the application of such techniques has grown rapidly: micromagnetics [96][97][98], model order reduction [99,100], big data [101][102][103], signal processing [104][105][106][107], control design [108,109], and electronic design automation [93].…”

Joint Range‐Doppler‐Angle Estimation for OFDM‐Based RadCom System via Tensor Decomposition

“…The uniqueness under mild conditions is a key feature of CP decomposition. The CP decomposition of the tensor D is essentially unique when the following sufficient condition is satisfied ( [21], Theorem 10)…”

“…It is clear that when there exists coherent targets, e.g., targets with the same range but different velocities and angles, (13) will not satisfy any more. In fact, the CP decomposition cannot ensure uniqueness and correctness in this case with third-order tensors even under a much milder condition ( [21], Theorem 9). To improve the percentage of successful decomposition, we utilize inherent structures of the factor matrices.…”

“…Note that, in order to obtain the approximate global optimal solution, the operator in (20) is different from that in (21). Tensor rank-1 approximation via TPM algorithm is summarised in Algorithm 1.…”

Freeway Driving Cycle Construction Based on Real-Time Traffic Information and Global Optimal Energy Management for Plug-In Hybrid Electric Vehicles

“…Tensor, also known as N-mode matrix, is a high-order generalization of scalar, vector and matrix [22][23][24][25]. The scalar can be regarded as a zero-order tensor, the vector can be regarded as a first-order tensor and the matrix can be regarded as a second-order tensor.…”