The Gaofen-1 satellite is equipped with four wide-field-of-view (WFV) instruments, enabling an impressive spatial resolution of 16 m and a combined swath exceeding 800 km. These WFV images have shown their valuable applications across diverse fields. However, achieving accurate radiometric calibration is an essential prerequisite for establishing reliable connections between satellite signals and biophysical, as well as biochemical, parameters. However, observations with large viewing angles (>20°) pose new challenges due to the bidirectional reflectance distribution function (BRDF) effect having a pronounced impact on the accuracy of cross-radiation calibrations, especially for the off-nadir WFV1 and WFV4 cameras. To overcome this challenge, a novel approach was introduced utilizing the combined observations from the Gaofen-1 and Gaofen-6 satellites, with Landsat-8 OLI serving as a reference sensor. The key advantage of this synergistic observation strategy is the ability to obtain a greater number of image pairs that closely resemble Landsat-8 OLI reference images in terms of geometry and observation dates. This increased availability of matching images ensures a more representative dataset of the observation geometry, enabling the derived calibration coefficients to be applicable across various sun–target–sensor geometries. Then, the geometry angles and bidirectional reflectance information were put into a Particle Swarm Optimization (PSO) algorithm incorporating radiative transfer modeling. This PSO-based approach formulates cross-calibration as an optimization problem, eliminating the reliance on complex BRDF models and satellite-based BRDF products that can be affected by cloud contamination. Extensive validation experiments involving satellite data and in situ measurements demonstrated an average uncertainty of less than eight percent for the proposed cross-radiation calibration scheme. Comparisons of top-of-atmosphere (TOA) results calibrated using our proposed scheme, the previous traditional radiative transfer modeling using MODIS BRDF products for BRDF correction (RTM-BRDF) method, and official coefficients reveal the superior accuracy of our method. The proposed scheme achieves a 36.99% decrease in root mean square error (RMSE) and a 38.13% increase in mean absolute error (MAE) compared to official coefficients. Moreover, it achieves comparable accuracy to the RTM-BRDF method while eliminating the need for MODIS BRDF products, with a decrease in RMSE exceeding 14% for the off-nadir WFV1 and WFV4 cameras. The results substantiate the efficacy of the proposed scheme in enhancing cross-calibration accuracy by improving image match-up selection, efficiently removing BRDF effects, and expanding applicability to diverse observation geometries.