We report temperature dependent photoluminescence, contactless electroreflectance and photoluminescence excitation study of ͑GaP͒ 2 ͑InP͒ 2.5 strained short period superlattices sandwiched between Ga x In 1Ϫx P alloy layers grown on GaAs ͑311͒A substrates. Transmission electron microscope pictures of these samples reveal the presence of self-organized In rich globular structures with Ga rich surroundings in the superlattice planes. The variation of the peak position of the photoluminescence band with decreasing temperature has an anomalous dip. We show that this is not due to an anomalous change in the band gap with temperature but is due to the interplay between two luminescence pathways associated with two phases, one which has the original ͑GaP͒ 2 ͑InP͒ 2.5 superlattice and the other being the self-organized composition modulated In rich regions within the superlattice layers. We also present spectroscopic results which indicate quantum dot like nature of the self-organized In rich structures in these samples.