The accurate evaluation of nonlinear optical (NLO) coefficient, the main parameter affecting light conversion efficiency, plays a crucial role in the development of NLO materials. The Kurtz–Perry powder technique can evaluate second-harmonic generation (SHG) intensity in pristine powder form, saving a significant amount of time and energy in the preliminary screening of materials. However, the Kurtz–Perry method has recently been subject to some controversy due to the limitations of the Kurtz–Perry theory and the oversimplified experimental operation. Therefore, it is very meaningful to revisit and develop the Kurtz–Perry technique. In this work, on the basis of introducing the light scattering effect into the original Kurtz–Perry theory, the theoretical expression of second-harmonic generation intensity with respect to band gap and refractive index are analyzed. In addition, the reference-dependent SHG measurements were carried out on polycrystalline LiB3O5 (LBO), AgGaQ2 (Q = S, Se), BaGa4Q7 (Q = S, Se), and ZnGeP2 (ZGP), and the results of SHG response emphasize the importance of using appropriate references to the Kurtz–Perry method. In order to obtain reliable values of nonlinear coefficients, two criteria for selecting a reference compound were proposed: (1) it should possess a band gap close to that of the sample to be measured and (2) it should possess a refractive index close to that of the sample to be measured. This work might shed light on improvements in accuracy that can be made for effective NLO coefficients obtained using the Kurtz–Perry method.