Mullite has high creep resistance, low thermal expansion coefficient and thermal conductivity, excellent corrosion resistance and thermal shock resistance, and plays an important role in traditional ceramics and advanced ceramic materials. However, the poor mechanical properties of mullite at room temperature limit its application. In order to improve the strength and toughness of mullite, the current research focuses on the modification of mullite by using the second phase. The research status of discontinuous phase (particle, whisker, and chopped fiber) and continuous fiber reinforced mullite matrix composites is introduced, including preparation process, microstructure, and its main properties. The reinforcement mechanism of second phase on mullite matrix composites is summarized, and the existing problems and the future development direction of mullite matrix composites are pointed out and discussed.