The tendency of the display market is towards displays with higher resolutions. Therefore, patterned retarder‐based stereoscopic displays require smaller front glass thickness to maintain good vertical viewing angle and limited crosstalk. To properly design these stereoscopic displays and quantify these requirements, we developed a simulation platform to predict radiance, polarization profile, and crosstalk over viewing angles and over wavelengths. Tunable parameters such as the distance between the pixels and the patterned retarder, and the optical properties of the patterned retarder are included. The simulation platform has been validated by comparing outcomes of simulations with measurements. We predict crosstalk accounting for both the human eye field of view and the diameter of the pupil. We found that to obtain a vertical viewing angle of at least ± 30° and crosstalk of at most 0.11 for a display with a pixel pitch beyond 0.27 mm, the display should include black absorbers, and the thickness of the front glass should be at most 0.5 mm. For higher resolution displays (pixel pitch no more than 0.21 mm), a front glass thickness at most 0.15 mm is required to produce a vertical viewing angle beyond ± 14° and a minimum viewing distance of 0.3 m.