Plants are associated with hundreds of thousands of microbes that are present outside on the surfaces or colonizing inside plant organs, such as leaves and roots. Plant-associated microbiota plays a vital role in regulating various biological processes and affects a wide range of traits involved in plant growth and development, as well as plant responses to adverse environmental conditions. An increasing number of studies have illustrated the important role of microbiota in crop plant growth and environmental stress resistance, which overall assists agricultural sustainability. Beneficial bacteria and fungi have been isolated and applied, which show potential applications in the improvement of agricultural technologies, as well as plant growth promotion and stress resistance, which all lead to enhanced crop yields. The symbioses of arbuscular mycorrhizal fungi, rhizobia and Frankia species with their host plants have been intensively studied to provide mechanistic insights into the mutual beneficial relationship of plant–microbe interactions. With the advances in second generation sequencing and omic technologies, a number of important mechanisms underlying plant–microbe interactions have been unraveled. However, the associations of microbes with their host plants are more complicated than expected, and many questions remain without proper answers. These include the influence of microbiota on the allelochemical effect caused by one plant upon another via the production of chemical compounds, or how the monoculture of crops influences their rhizosphere microbial community and diversity, which in turn affects the crop growth and responses to environmental stresses. In this review, first, we systematically illustrate the impacts of beneficial microbiota, particularly beneficial bacteria and fungi on crop plant growth and development and, then, discuss the correlations between the beneficial microbiota and their host plants. Finally, we provide some perspectives for future studies on plant–microbe interactions.