This study presents differentiation in milk samples of mother's feeding male and female infants using Raman spectroscopy combined with a support vector machine (SVM). Major differences have been observed in the Raman spectra of both types of milk based on their chemical compositions. Overall, it has been found that milk samples of mother's having a female infant are richer in fatty acids, phospholipids, and tryptophan. In contrast, milk samples of mother's having a male infant contain more carotenoids and saccharides. Principal component analysis and SVM further highlighted the differences between the two groups on the basis of differentiating features obtained from their Raman spectra. The SVM model with two different kernels, i.e. polynomial kernel function (order-2) and Gaussian radial basis function (RBF sigma-2), are used for gender based milk differentiations. The performance of the proposed model in terms of accuracy, precision, sensitivity, and specificity using the polynomial kernel function of order-2 have been found to be 86%, 88%, 85% and 88%, respectively.