Kazakh cheese is a traditional dairy product in Xinjiang, China. To study the function and potential probiotic characteristics of yeast in Kazakh cheese and its contribution to cheese fermentation, we screened the γ-aminobutyric acid (GABA)-producing yeasts Pichia kudriavzevii 1-21, Kluyveromyces marxianus B13-5, Saccharomyces cerevisiae DL6-20, and Kluyveromyces lactis DY1-10. We investigated the potential probiotic properties of these strains and their use in cheese fermentation (cheeses designated CSP, CSM, CSS, and CSI, respectively); a control with no added yeast was designated CS. The results showed that the 4 yeast strains all showed high self-polymerization (2-and 24-h autoaggregation capacity of >80 and 90%, respectively), hydrophobicity (40-92% variation, low hydrophobicity in xylene, but within the range of probiotics), and the ability to survive the gastrointestinal tract (survival rate >75% after simulation), indicating the probiotic ability of the strains in vitro. The GABA production capacity of the CSM cheese increased (to 95.6 mg/100 g), but its protein content did not change significantly, and amino acid degradation was obvious. The GABA production capacity of the CSS cheese decreased (to 450 mg/kg); its protein content declined, and its amino acid content increased. Except for water and protein, we found no obvious differences in most physical and chemical indicators. Kluyveromyces marxianus B13-5 helped to form the desired texture. Multivariate statistical analysis showed that fermentation of the cheese with the 4 yeasts improved the production of esters and alcohols. The CSS cheese had good aroma production performance, because S. cerevisiae DL6-20 produced high concentrations of isoamyl alcohol, hexanoic acid ethyl ester, benzyl alcohol, octanoic acid ethyl ester, 3-hydroxy-2-butanone, and hexanoic acid; the content of 2-methyl-propanoic acid was low. Compared with the CSP cheese, the CSI and CSM cheeses had a fruitier aroma and a milder odor, but the CSI and CSM cheeses had high concentrations of ethyl acetate, butanoic acid, ethyl ester, 3-methyl-1-butanol-acetate, ethyl hexanoate, ethyl octanoate, acetic acid 2-phenylethyl ester, and ethyl lactate; concentrations of 3-methyl-butanoic acid, propanoic acid, acetic acid, and butanoic acid were low. The CSP cheese had stronger acid-producing ability. The order of fragrance production performance was CSS > CSI, CSM > CSP > CS. Research into the fermentation mechanisms of GABA-producing yeast in cheese will provide a theoretical basis for the quality control and industrial production of Kazakh cheese.