A comprehensive review of uncertainties in power systems, covering modeling, impact, and mitigation, is essential to understand and manage the challenges faced by the electric grid. Uncertainties in power systems can arise from various sources and can have significant implications for grid reliability, stability, and economic efficiency. Australia, susceptible to extreme weather such as wildfires and heavy rainfall, faces vulnerabilities in its power network assets. The decentralized distribution of population centers poses economic challenges in supplying power to remote areas, a crucial consideration for emerging technologies emphasized in this paper. In addition, the evolution of modern power grids, facilitated by deploying the advanced metering infrastructure (AMI), has also brought new challenges to the system due to the risk of cyber-attacks via communication link. However, the existing literature lacks a comprehensive review and analysis of uncertainties in modern power systems, encompassing uncertainties related to weather events, cyberattacks, and asset management, as well as the advantages and limitations of various mitigation approaches. To fill this void, this review covers a broad spectrum of uncertainties considering their impacts on the power system and explores conventional robust control, and modern probabilistic and data-driven approaches for modelling and correlating the uncertainty events to the state of the grid for optimal decision making. This article also investigates the development of robust and scenario-based operations, control technologies for microgrids (MGs) and energy storage systems (ESSs), and demand-side frequency control ancillary service (D-FCAS) and reserve provision for frequency regulation to ensure a design of uncertainty-tolerance power system. This review delves into the trade-offs linked with the implementation of mitigation strategies, such as reliability, computational speed, and economic efficiency. It also explores how these strategies may influence the planning and operation of future power grids.