Heart rate asymmetry (HRA) quantifies imbalance of heart rate acceleration and deceleration. The impact of different colored lights on autonomic nervous system captured by HRA was studied in this paper. Using electrocardiogram (ECG) data for 16 female volunteers exposed to four different colored lights (red, green, blue, and yellow), three common HRA indices (Porta Index-PI, Guzik Index-GI, and Slope Index-SI) were calculated. Analysis of data revealed a statistically significant difference in PI (p<0.001), GI (p=0.006), and SI (p=0.001) depending on which colored light was used as visual stimuli. These results propose that HRA can be used as a complementary measure along with heart rate and heart rate variability to quantify heart response to colored light stimulation.