Airborne base stations (carried by drones) have a great potential to enhance coverage and capacity of 6G cellular networks. However, one of the main challenges facing the deployment of airborne BSs is the limited available energy at the drone, which limits the flight time. In fact, most of the currently used unmanned aerial vehicles (UAVs) can only operate for one hour maximum. This limits the performance of the UAV-enabled cellular network due to the need to frequently visit the ground station to recharge, leaving the UAV's coverage area temporarily out of service. In this article, we propose a UAV-enabled cellular network setup based on tethered UAVs (tUAVs). In the proposed setup, the tUAV is connected to a ground station (GS) through a tether, which provides the tUAV with both energy and data. This enables a flight that can stay for days. We describe in detail the components of the proposed system. Furthermore, we enlist the main advantages of a tUAV-enabled cellular network compared to typical untethered UAVs (uUAVs). Next, we discuss the potential applications and use cases for tUAVs. We also provide Monte-Carlo simulations to compare the performance of tUAVs and uUAVs in terms of coverage probability. For instance, for a uUAV that is available 70% of the time (while unavailable charging or changing battery for 30% of the time), the simulation results show that tUAVs with 120 m tether length can provide upto 30% increase in the coverage probability, compared to uUAVs. Finally, we discuss the challenges, design considerations, and future research directions to realize the proposed setup.