Free oligosaccharides are abundant macronutrients in milk and involved in prebiotic functions and antiadhesive binding of pathogenic bacteria to colonocytes. Despite the importance of these oligosaccharides, structural determination of oligosaccharides is challenging, and milk oligosaccharide biosynthetic pathways remain unclear. Oligosaccharide structures are conventionally determined using a combination of chemical reactions, exoglycosidase digestion, nuclear magnetic resonance spectroscopy, and mass spectrometry. Most reported free oligosaccharides are highly abundant and have lactose at the reducing end, and current oligosaccharide biosynthetic pathways in human milk are proposed based on these oligosaccharides. In this study, a new mass spectrometry technique, which can identify linkages, anomericities, and stereoisomers, was applied to determine the structures of free oligosaccharides in human, bovine, and caprine milk. Oligosaccharides that do not follow the current biosynthetic pathways and are not synthesized by any discovered enzymes were found, indicating the existence of undiscovered biosynthetic pathways and enzymes. New biosynthetic pathways were proposed.