Runaway electron (RAE) generation in high-pressure gases is an important physical phenomenon that significantly influences discharge shapes and properties of initiated plasma. The diffuse discharges formed due to RAEs in the air and other gases at atmospheric pressure find wide applications. In the present review, theoretical and experimental results that explain the reason for RAE occurrence at high pressures are analyzed, and recommendations are given for the implementation of conditions under which the runaway electron beam (RAEB) with the highest current can be obtained at atmospheric pressure. The experimental results were obtained using subnanosecond, nanosecond, and submicrosecond generators, including those specially developed for runaway electron generation. The RAEBs were recorded using oscilloscopes and collectors with picosecond time resolution. To theoretically describe the phenomenon of continuous electron acceleration, the method of physical kinetics was used based on the Boltzmann kinetic equation that takes into account the minimum but sufficient number of elementary processes, including shock gas ionization and elastic electron scattering. The results of modeling allowed the main factors to be established that control the RAE appearance, the most important of which is electron scattering on neutral atoms and/or molecules. Theoretical modeling has allowed the influence of various parameters (including the voltage, pressure, gas type, and geometrical characteristics of the discharge gap) to be taken into account. The results of the research presented here allow RAE accelerators with desirable parameters to be developed and the possibility of obtaining diffuse discharges to be accessed under various conditions. The review consists of the Introduction, five sections, the Conclusion, and the References.