In this paper, we consider the downlink of multiuser multiple-input-multiple-output system operating in the narrowband and outdoor of millimeter-wave propagation environment. First, we propose a receive spatial modulation (RSM) scheme based on energy efficient transceiver architecture for the single user system. We derive the RSM system assuming single radiofrequency (RF) chain at the user terminal (UT) and then, we propose a novel extension for multiple RF chains. At the UT, we consider analog switches to control which antennas are active during the transmission according to an optimization algorithm aimed at maximizing the spectral efficiency. At the base station (BS), we use analog switches to control the ON/OFF status of the RF chains based on an optimization algorithm to improve the energy efficiency at the BS. Then, we extend the proposed RSM scheme for multiple users. Specifically, we propose an algorithm to jointly optimize number of users, set of antennas and the power allocated for each user to maximize the weighted sum spectral efficiency. After that, for a given number of users and antennas per user, we formulate the power allocation problem as non convex optimization program. Hence, we propose alternating optimization algorithm to convert the non convex program into multiple convex problems. Finally, we compare the performance and the convergence of the proposed alternating optimization with successive convex approximation framework. Simulation results are presented to illustrate the single and multiple users system performance of the RSM scheme compared to conventional modulation transmission.