In this work we present RAPID, a Joint Communication & Radar (JCR) system based on next generation IEEE 802.11ay WiFi networks in the 60 GHz band, which retrofits existing communication hardware to perform zerocost monitoring of human movement and activities in indoor spaces. Most of the available approaches for human sensing at millimeter-waves employ special-purpose radar devices, which are utilized to retrieve and analyze the small-scale Doppler effect (micro-Doppler) caused by human motion. This is key to achieve fine-grained sensing applications such as simultaneous activity recognition and person identification. We show that IEEE 802.11ay Access Points (APs) can be retrofitted to perform radar-like extraction of micro-Doppler effects of multiple human subjects. While radar systems entail the deployment of additional hardware, our framework performs activity recognition and person identification using IEEE 802.11ay wireless networks with no modifications to the transmitted packet structure specified by the standard. We leverage the in-packet beam training capability of IEEE 802.11ay to accurately localize and track multiple individuals using the estimated Channel Impulse Response (CIR), while the beam tracking mechanism embedded in data packets allows to extract the desired micro-Doppler (µD) signatures of the subjects. We implement our system on an IEEE 802.11aycompatible full-duplex FPGA platform with phased antenna arrays, which can estimate the CIR from the reflections of transmitted packets. Using two access points, we achieve reliable positioning and tracking of multiple subjects, and an accuracy of 93% and 90% for activity recognition and person identification, respectively.

The commercial availability of low-cost millimeterwave (mmWave) communication and radar devices is starting to improve the adoption of such technologies in consumer markets, paving the way for large-scale and dense deployments in fifthgeneration (5G)-and-beyond as well as 6G networks. At the same time, pervasive mmWave access will enable device localization and device-free sensing with unprecedented accuracy, especially with respect to sub-6 GHz commercial-grade devices.This paper surveys the state of the art in device-based localization and device-free sensing using mmWave communication and radar devices, with a focus on indoor deployments. We overview key concepts about mmWave signal propagation and system design, detailing approaches, algorithms and applications for mmWave localization and sensing. Several dimensions are considered, including the main objectives, techniques, and performance of each work, whether they reached an implementation stage, and which hardware platforms or software tools were used.We analyze theoretical (including signal processing and machine learning), technological, and implementation (hardware and prototyping) aspects, exposing under-performing or missing techniques and items towards enabling a highly effective sensing of human parameters, such as position, movement, activity and vital signs. Among many interesting findings, we observe that device-based localization systems would greatly benefit from commercial-grade hardware that exposes channel state information, as well as from a better integration between standardcompliant mmWave initial access and localization algorithms, especially with multiple access points (APs). Moreover, more advanced algorithms requiring zero-initial knowledge of the environment would greatly help improve the adoption of mmWave simultaneous localization and mapping (SLAM). Machine learning (ML)-based algorithms are gaining momentum, but still require the collection of extensive training datasets, and do not yet generalize to any indoor environment, limiting their applicability. Manuscript received xxxx xx, xxxx . . .

We address the use of backscattered mm-wave radio signals to track humans as they move within indoor environments. The common approach in the literature leverages the extended Kalman filter (EKF) method, which however undergoes a severe performance degradation when the system evolution model is highly non-linear or presents long-term time dependencies among the system states. In this work, we propose an original model-free tracking procedure based on denoising autoencoders and sequence-to-sequence neural networks, showing its superior performance with respect to state-of-the-art methods. Our architecture can be trained in either a supervised or unsupervised manner, trading tracking accuracy for flexibility. The proposed system is tested on our own measurements, obtained with a 77 GHz radar on single and multiple subjects simultaneously moving in an indoor space. The results are compared against the ground truth trajectories from a motion tracking system, obtaining average tracking errors as low as 12 cm.

No abstract

No abstract