In the realm of bridge structural engineering, it is customary to meticulously contemplate the material’s strength and rigidity attributes during the dimensioning phase. In recent years, there has been a burgeoning interest in employing Ultrahigh-Performance Concrete (abbreviated as UHPC) for the construction of bridge decks and wet joints. However, the large self-shrinkage of UHPC can easily lead to shrinkage cracking and affect its service life. This study delves into the utilization of a blend of basalt coarse aggregate and high-modulus aggregate (HMA) in the formulation of Ultrahigh-Performance Concrete (UHPC) with the objectives of achieving exceptional strength (>180 MPa), superior modulus of elasticity (>56 GPa), and synergistic effect of using prewetted internal curing aggregate (ICA), metallurgical ore sand (MOS), and calcium–magnesium composite-based expansion agent (EA) to reduce the shrinkage of UHPC. Furthermore, the mechanical properties, shrinkage, hydration process, and microstructure of UHPC prepared with EA and ICA were studied. The results show that UHPC prepared with both 3% EA and 20% ICA had the optimal volume stability (the shrinkage was only 273 με at 180 d). In contrast, the 180 d shrinkage of UHPC with 3% EA and 20% ICA separately was 287 με and 373 με, respectively. In addition, the incorporation of EA and ICA can effectively improve the flexural strength of UHPC, although it affects the compressive strength and modulus of elasticity of UHPC (small decrease).