The optimization of an unmanned aerial vehicle (UAV) aerial photogrammetry scheme is crucial for achieving higher precision mapping results. Three representative factors, namely the real-time kinematic (RTK) mode, flight altitude, and the number of ground control points (GCPs) were selected to analyze their impact on UAV aerial photogrammetry accuracy. Four flight altitude tests were conducted separately in two RTK modes, and five GCP layout schemes were designed. Based on this, the root mean square error (RMSE) values of 40 aerial photogrammetric results were analyzed. The results showed a significant correlation between flight altitude and resolution of the UAV aerial photogrammetric results. Further, conversion formulas between actual image resolution and flight altitude for different GCP values were also derived in RTK and non-RTK modes. In the case of precise positioning, the horizontal and vertical accuracy of the aerial photogrammetric image decreased with increasing flight altitude. Under the same flight altitude, the addition or no addition of GCPs, including changes in GCP numbers, had no significant effect on improving the accuracy of aerial photogrammetry in RTK mode. However, in non-RTK mode, the number of GCPs significantly affected accuracy. The horizontal and vertical RMSE values decreased rapidly with the increase in GCP numbers and then stabilized. However, regardless of whether RTK was activated, an excessive number of GCPs was not conducive to improving the accuracy of aerial photogrammetric results. The mapping accuracy of UAVs in RTK mode without GCPs was equivalent to that in non-RTK mode with GCPs. Therefore, when using RTK-UAVs, deploying GCPs is unnecessary under suitable circumstances. Finally, practical suggestions for optimizing the UAV aerial photogrammetry scheme are provided as a reference for related applications.