We estimate the beam-normal single-spin asymmetry in elastic lepton-proton scattering. In the leading-order approximation, such an asymmetry is proportional to the imaginary part of the two-photon exchange amplitude and can be related to an integral over the doubly virtual Compton scattering (VVCS) tensor. In our calculation, we account for the elastic contribution to the VVCS tensor without resorting to the ultrarelativistic (UR) approximation. The approximation cannot be justified when the mass of the lepton is comparable to the lepton's energy. For example, scattering of a muon beam at energy of few hundred MeV need to be analyzed beyond the UR approximation. Our beam-normal single-spin asymmetry predictions are presented in the kinematics of the upcoming MUSE experiment.