Red color conversion materials have often been used in conventional white LEDs (light-emitting diodes) to enhance the insufficient deep-red component and thus improve the color-rendering property. Quantum dots (QDs) are one of the candidates for this due to their flexibility in controlling the emission wavelength, which is attributed to the quantum confinement effect. Two types of remote QD components, i.e., QD films and QD caps, were prepared and applied to conventional white LED illumination to improve the color-rendering properties. Thanks to the red component near 630 nm caused by the QD components, the color rendering indices (CRIs) of both Ra and R9 could be increased to over 95. It was found that both the diffusing nature of the reflector and the light recycling process in the vertical cavity between the bottom reflector and the top optical films play important roles in improving the color conversion efficiency of remote QD components. The present study showed that the proper application of remote QDs combined with a suitable optical cavity can control the correlated color temperature of the illumination over a wide range, thus realizing different color appearances of white LED illumination. In addition, a high CRI of over 95 could be achieved due to the sufficient excitation from fewer QDs, due to the strong optical cavity effect.