2D layered materials (2DLMs) are a subject of intense research for a wide variety of applications (e.g., electronics, photonics, and optoelectronics) due to their unique physical properties. Most recently, increasing research efforts on 2DLMs are projected toward the nonlinear optical properties of 2DLMs, which are not only fascinating from the fundamental science point of view but also intriguing for various potential applications. Here, the current state of the art in the field of nonlinear optics based on 2DLMs and their hybrid structures (e.g., mixed-dimensional heterostructures, plasmonic structures, and silicon/fiber integrated structures) is reviewed. Several potential perspectives and possible future research directions of these promising nanomaterials for nonlinear optics are also presented.