Filter bank-based multicarrier (FBMC) systems have attracted increasing attention recently in view of their many advantages over the classical cyclic prefix (CP)-based orthogonal frequency division multiplexing (CP-OFDM) modulation. However, their more advanced structure (resulting in, for example, self interference) complicates signal processing tasks at the receiver, including synchronization, channel estimation and equalization. In a multiple-input multiple-output (MIMO) configuration, the multi-antenna interference has also to be taken into account. (Semi-) blind receivers, of increasing interest in (massive) MIMO systems, have been little studied so far for FBMC and mainly for the single-antenna case only. The design of such receivers for flexible MIMO FBMC systems, unifying a number of existing FBMC schemes, is considered in this paper through a tensorbased approach, which is shown to encompass existing joint channel estimation and data detection approaches as special cases, adding to their understanding and paving the way to further developments. Simulation-based results are included, for realistic transmission models, demonstrating the estimation and detection performance gains from the adoption of these receivers over their training only-based counterparts.
I. INTRODUCTIONF ILTER bank-based multicarrier (FBMC) systems [1] have recently attracted increasing attention as a competent alternative to the classical cyclic prefix (CP)-based orthogonal frequency division multiplexing (CP-OFDM) modulation, in a wide range of applications, including both wireless (e.g., ad-hoc public safety) and wired (e.g., fiber optics) communications [2]. The potential of FBMC transmission stems from its increased ability to carrying a flexible spectrum shaping, along with a major increase in spectral efficiency and robustness to synchronization requirements, features of fundamental importance in modern and future networks. However, its more advanced structure (resulting in, for example, self interference) complicates signal processing tasks at the receiver, including synchronization, channel estimation and equalization [2]. In a multiple-input multiple-output (MIMO) configuration, the multi-antenna interference has also to be taken into account, which can be a challenge in, for example, offset quadrature amplitude modulation (OQAM)-based FBMC [3]. Nevertheless FBMC(/OQAM) is being also considered for massive MIMO systems [4], [5] and has also shown its potential in the envisaged millimeter wave (mmWave) communications [6].