With the rapidly evolving mobile technologies, the number of cellular base stations (BSs) has significantly increased to meet the explosive demand for mobile services and applications. In turn, this has significantly increased the capital and operational expenses, due to the increased electricity prices and energy consumption. To generate electricity, power plants mainly rely on fossil fuels, which are non-renewable energy resources. As a result, CO2 emissions also increase, which adversely affect health and environment. For wireless access technologies and cellular networks, BSs are the largest power consumer, and the network energy consumption is mainly dominated by the network infrastructure, which makes the telecommunications sector liable for energy consumption as well as CO2 emissions around the globe. Alternatively, solar energy is considered as an eco-friendly and economically attractive solution, due to its cost-effectiveness and sustainability. In this paper, the potentials of photovoltaic (PV) solar power to energize cellular BSs in Kuwait are studied, with the focus on the design, implementation, and analysis of off-grid solar PV systems. Specifically, system components, such as the number of PV panels, batteries, and converters needed for the design are determined and evaluated via HOMER software, with the focus on minimizing the net present cost (NPC). A comparison between various PV, diesel generator (DG), and battery bank (BB) system configurations is also performed. Moreover, a comparison of system deployment area will be presented for different PV panels that have different output power and panel sizes, in addition to utilizing a solar tracking system. It is revealed that utilizing a hybrid system configuration (i.e., PV-DG-BB) decreases fuel consumption per year by almost 95% in comparison to the conventional DG-only based electric systems. Not only that, but utilizing a pure off-grid solar PV system (i.e., PV-BB) can significantly reduce the total NPC while completely eliminating CO2 emissions; however, at the expense of more land.