This paper discusses accuracy improvements to Reynolds-Averaged Navier–Stokes (RANS) modeling of supersonic flow by assessing a wide range of factors for physics capture. Numerical simulations reveal complex flow behavior resulting from shock and expansion waves and so, a supersonic jet emanating from rectangular nozzle is considered. PIV based experimental data for the jet is available from literature and is used for validation purposes. Effect of various boundary conditions and turbulence modeling approaches is assessed qualitatively and quantitatively. Of particular interest are the inlet conditions considering the turbulence intensity and the effect of upstream air supply duct, the effect of nozzle wall surface roughness on nozzle internal flow and downstream, wall y+ sensitivity for boundary layer resolution and laminar to turbulent transition modeling. In addition to mesh sensitivity, domain dependency is conducted to evaluate the appropriate domain size to capture the kinetic energy dissipation downstream of the nozzle. To further improve the flow characteristics, accounting for the anisotropy of Reynolds stresses is also one of the focuses. Therefore, non-linear eddy viscosity-based two-equation model and Reynolds stress transport model are also investigated. Additionally, the results of baseline linear (Boussinesq) RANS are compared. Corresponding comparisons with high-fidelity LES are presented. Jet self-similar behavior resulting from all simulation fidelities is assessed and it appears that turbulent flow in LES becomes self-similar, but not in RANS. Finally, various factors such as the nozzle geometry and numerical modeling choices influencing the anisotropy in jet turbulence are discussed.