Using a combination of data from the BovineSNP50 BeadChip SNP array (Illumina, San Diego, CA) and a EuroGenomics (Amsterdam, the Netherlands) custom single nucleotide polymorphism (SNP) chip with SNP pre-selected from whole genome sequence data, we carried out an association study of milking speed in 32,491 French Holstein dairy cows. Milking speed was measured by a score given by the farmer. Phenotypes were yield deviations as obtained from the French evaluation system. They were analyzed with a linear mixed model for association studies. We identified SNP on 22 chromosomes significantly associated with milking speed. As clinical mastitis and somatic cell score have an unfavorable genetic correlation with milking speed, we tested whether the most significant SNP on these 22 chromosomes associated with milking speed were also associated with clinical mastitis or somatic cell score. Nine hundred seventy-one genome-wide significant SNP were associated with milking speed. Of these, 86 were associated with clinical mastitis and 198 with somatic cell score. The most significant association signals for milking speed were observed on chromosomes 7, 8, 10, 14, and 18. The most significant signal was located on chromosome 14 (ZFAT gene). Eleven novel milking speed quantitative trait loci (QTL) were observed on chromosomes 7, 10, 11, 14, 18, 25, and 26. Twelve candidate SNP for milking speed mapped directly within genes. Of these, 10 were QTL lead SNP, which mapped within the genes HMHA1, POLR2E, GNB5, KLHL29, ZFAT, KCNB2, CEACAM18, CCL24, and LHPP. Limited pleiotropy was observed between milking speed QTL and clinical mastitis.