To improve the color conversion performance, we study the nanoscale-cavity effects on the emission efficiency of a colloidal quantum dot (QD) and the Förster resonance energy transfer (FRET) from quantum well (QW) into QD in a GaN porous structure (PS). For this study, we insert green-emitting QD (GQD) and red-emitting QD (RQD) into the fabricated PSs in a GaN template and a blue-emitting QW template, and investigate the behaviors of the photoluminescence (PL) decay times and the intensity ratios of blue, green, and red lights. In the PS samples fabricated on the GaN template, we observe the efficiency enhancements of QD emission and the FRET from GQD into RQD, when compared with the samples of surface QDs, which is attributed to the nanoscale-cavity effect. In the PS samples fabricated on the QW template, the FRET from QW into QD is also enhanced. The enhanced FRET and QD emission efficiencies in a PS result in an improved color conversion performance. Because of the anisotropic PS in the sample surface plane, the polarization dependencies of QD emission and FRET are observed.