The experimental seasonal forecast of Indian summer monsoon (ISM) rainfall during June through September using Community Atmosphere Model (CAM) version 3 has been carried out at the Space Applications Centre Ahmedabad since 2009. The forecasts, based on a number of ensemble members (ten minimum) of CAM, are generated in several phases and updated on regular basis. On completion of 5 years of experimental seasonal forecasts in operational mode, it is required that the overall validation or correctness of the forecast system is quantified and that the scope is assessed for further improvements of the forecast over time, if any. The ensemble model climatology generated by a set of 20 identical CAM simulations is considered as the model control simulation. The performance of the forecast has been evaluated by assuming the control simulation as the model reference. The forecast improvement factor shows positive improvements, with higher values for the recent forecasted years as compared to the control experiment over the Indian landmass. The Taylor diagram representation of the Pearson correlation coefficient (PCC), standard deviation and centered root mean square difference has been used to demonstrate the best PCC, in the order of 0.74-0.79, recorded for the seasonal forecast made during 2013. Further, the bias score of different phases of experiment revealed the fact that the ISM rainfall forecast is affected by overestimation in predicting the low rain-rate (less than 7 mm/day), but by underestimation in the medium and high rain-rate (higher than 11 mm/day). Overall, the analysis shows significant improvement of the ISM forecast over the last 5 years, viz. 2009-2013, due to several important modifications that have been implemented in the forecast system. The validation exercise has also pointed out a number of shortcomings in the forecast system; these will be addressed in the upcoming years of experiments to improve the quality of the ISM prediction.