Millimeter waves and massive multiple-input multiple output (MIMO) are two promising key technologies to achieve the high demands of data rate for the future mobile communication generation. Due to hardware limitations, these systems employ hybrid analog–digital architectures. Nonetheless, most of the works developed for hybrid architectures focus on narrowband channels, and it is expected that millimeter waves be wideband. Moreover, it is more feasible to have a sub-connected architecture than a fully connected one, due to the hardware constraints. Therefore, the aim of this paper is to design a sub-connected hybrid analog–digital multi-user linear equalizer combined with an analog precoder to efficiently remove the multi-user interference. We consider low complexity user terminals employing pure analog precoders, computed with the knowledge of a quantized version of the average angles of departure of each cluster. At the base station, the hybrid multi-user linear equalizer is optimized by using the bit-error-rate (BER) as a metric over all the subcarriers. The analog domain hardware constraints, together with the assumption of a flat analog equalizer over the subcarriers, considerably increase the complexity of the corresponding optimization problem. To simplify the problem at hand, the merit function is first upper bounded, and by leveraging the specific properties of the resulting problem, we show that the analog equalizer may be computed iteratively over the radio frequency (RF) chains by assigning the users in an interleaved fashion to the RF chains. The proposed hybrid sub-connected scheme is compared with a fully connected counterpart.