Recently, increasing attention has been focused on developing new products based on goat’s milk. Consumers positively perceive fermented goat’s milk products as health-promoting due to their nutritional value, digestibility, and potential source of probiotics. This study aimed to evaluate the possibility of using different doses of collagen and collagen hydrolysate in the production of probiotic goat’s milk fermented by four monocultures: Lacticaseibacillus casei 431® Lactobacillus acidophilus LA- 5®, Lacticaseibacillus paracasei LP26, and Lacticaseibicillus rhamnosus Lr- 32®. A total of 20 experimental groups were prepared, including control groups (without additives), and due to the added probiotic (Lacticaseibacillus casei, Lactobacillus acidophilus, Lacticaseibacillus paracasei, and Lacticaseibacillus rhamnosus), various collagen doses (1.5% and 3.0%) and collagen types (hydrolysate and bovine collagen). Physicochemical, organoleptic, and microbiological characteristics were evaluated after 1 and 21 days of cold storage. The applied additives increased the acidity of the milk even before fermentation. However, milk with bovine collagen and hydrolysate had a higher pH value after fermentation than control milk. The study showed higher than 8 log cfu g−1 viability of probiotic bacteria in goat’s milk products during storage due to the proper pH, high buffering capacity, and rich nutrient content of goat’s milk. The best survival rate was shown for the L. casei strain after 21 days in milk with collagen protein hydrolysate. Moreover, collagen in milk fermented by L. rhamnosus decreased syneresis compared to its control counterpart. The addition of collagen, especially the hydrolysate, increased the gel hardness of the fermented milk. The collagen additives used in the milk, both in the form of hydrolysate and bovine collagen, caused a darkening of the color of the milk and increased the intensity of the milky-creamy and sweet taste.