It is widely acknowledged that casein is an important allergenic protein in milk which may cause danger to customers. The identification and confirmation of caseins through mass spectrometry requires the selection of suitable characteristic peptides. In this study, by means of matrix-assisted laser desorption ionization time-of-flight mass spectrometry (MALDI-TOF MS), the three most representative specific peptides of caseins in cow milk were screened out with mass-to-charge ratios (m/z) of 830, 1195, and 1759, respectively. By comparing 2,5-dihydroxybenzoic acid (DHB) and α-cyano-4-hydroxycinnamic acid (CHCA) MALDI matrices, it was found that DHB was more suitable for peptide detection with the limits of detection (LODs) of 0.1 mg/L for α, β-casein. Furthermore, on the basis of verifying the characteristic peptides of casein from cow milk, this protocol was applied to goat milk authentication. Cow milk addition in goat milk was investigated by using the screened specific peptides. The results showed that the adulteration could be identified when the proportion of cow milk was 1% or more. When applied to inspect adulteration in five brands of commercial goat milk, specific peptides of bovine casein were detected in four of them. The method has the advantages of strong reliability, high throughput, simple preprocessing, and fast speed, which can provide powerful help for prewarning dairy allergen.