Ultra-high bandwidth, negligible latency and seamless communication for devices and applications are envisioned as major milestones that will revolutionize the way by which societies create, distribute and consume information. The remarkable expansion of wireless data traffic that we are witnessing recently has advocated the investigation of suitable regimes in the radio spectrum to satisfy users' escalating requirements and allow the development and exploitation of both massive capacity and massive connectivity of heterogeneous infrastructures. To this end, the Terahertz (THz) frequency band (0.1-10 THz) has received noticeable attention in the research community as an ideal choice for scenarios involving high-speed transmission. Particularly, with the evolution of technologies and devices, advancements in THz communication is bridging the gap between the millimeter wave (mmW) and optical frequency ranges. Moreover, the IEEE 802.15 suite of standards has been issued to shape regulatory frameworks that will enable innovation and provide a complete solution that crosses between wired and wireless boundaries at 100 Gbps. Nonetheless, despite the expediting progress witnessed in THz wireless research, the THz band is still considered one of the least probed frequency bands. As such, in this work, we present an up-to-date review paper to analyze the fundamental elements and mechanisms associated with the THz system architecture. THz generation methods are first addressed by highlighting the recent progress in the electronics, photonics as well as plasmonics technology. To complement the devices, we introduce the recent channel models available for indoor, outdoor as well as nanoscale propagation at THz band frequencies. A comprehensive comparison is then presented between the THz wireless communication and its other contenders by treating in depth the limitations associated with each communication technology. In addition, several applications of THz wireless communication are discussed taking into account the various length scales at which such applications occur. Further, as standardization is a fundamental aspect in regulating wireless communication systems, we highlight the milestones achieved regarding THz standardization activities. Finally, a future outlook is provided by presenting and envisaging several potential use cases and attempts to guide the deployment of the THz frequency band and mitigate the challenges related to high frequency transmission. ). Fig. 1. Wireless Roadmap Outlook up to the year 2035.