Microwave signals with low phase noise can be broadly used in communication systems, satellite communications, and radar systems. Discrete mode laser diode (DM-LD) has the capacity to generate signals that meet the above requirements. Moreover, it has the following advantages such as stable operation over a wide temperature range, very high side mode suppression ratio, low sensitivity to optical feedback, and narrow linewidth. In this paper, we proposed and experimentally demonstrated DM-LD for generating the second harmonic signal in the self-starting microwave generation system. The results show that DM-LD effectively reduces the single sideband (SSB) phase noise of the fundamental signals and its second harmonic signals better than the same designed experimental system using a distributed feedback LD, which reduces the SSB noise of the fundamental signal/its second harmonic signal by over 16/22 dB, 18/22 dB, 13/19 dB at a frequency offset of 10 kHz, 100 kHz, and 1 MHz, respectively.