The fluid dynamics of expiratory events are complex, and understanding how indoor air conditions affect this and the spread of exhaled material is crucial to the prevention of large-scale spread of diseases. It is known that thermal stratification can trap contaminants in the lower levels of a room; however, there is a lack of studies that investigate the influence of vertical temperature gradients on the transport of expiratory particles at room scale. To this effect, we used Eulerian–Lagrangian large-eddy simulations to investigate the effect of thermal stratification on the transport of polydispersed expiratory particles during speaking in two different sized rooms. Cases with increasing temperature gradient were compared to an isothermal base case, and the influence of stratification on the exhalation jet and the particles suspended within is analyzed. The particle volume fraction was computed to quantify the spatiotemporal evolution of different particle size categories. Our results show that thermal stratification leads to an increased concentration of aerosols in the breathing zone and extends their forward reach. Aerosols up to a size threshold between 12 and 20 μm are locked up at different heights by stratification—beyond this threshold, they fall out continuously. In all cases, aerosols <20 μm traveled up to 4 m from the source, showing that physical distancing guidelines alone may be inadequate for controlling cross-infection risk for long-term exposures. Particles >60 μm are unaffected by stratification and do not follow a ballistic trajectory, falling out within 0.5 m of the infectious individual in all cases.