Compared with electrons, photons have the potential to realise ultra-high speed operations because of its unique high speed and high parallelism. In recent years, there have been many researches on neural networks using optical hardware. The Mach-Zehnder interferometer (MZI) and micro-ring resonator (MRR) are commonly used as optical devices to realise linear operation units in optical neural networks (ONN). MZI has the advantages of simple fabrication, high sensitivity, and easy integration, which has attracted the attention of researchers. We summarise the implementation methods of ONN matrix multiplication based on MZI, the implementation methods of non-linear activation, and the on-chip training methods. We first summarise the researches on matrix multiplication of ONN based on MZI. Three kinds of MZI grid decomposition methods, Fast Fourier Transform (FFT) grid structures, and the corresponding derivation processes are introduced, respectively. Then, several experimental implementations of ONN based on MZI are summarised, and the characteristics of optical processors fabricated in these references are analysed. Finally, the realisation methods of non-linear activation and on-chip training of silicon ONN are introduced, respectively.