The gallstone disease is becoming increasingly prevalent worldwide. Dietary trace minerals have been proven to be closely related to many metabolic diseases, and this study aims to explore the association between intakes of dietary trace minerals (copper, iron, selenium, and zinc) and gallstone disease (GSD). Using the National Health and Nutrition Examination Survey (NHANES) from 2017 to 2018, intakes of dietary trace minerals and GSD data were obtained through a 24-hour recall and diagnostic questionnaire, respectively. Weighted logistic regression models were used to identify the association between intakes of dietary trace minerals and the prevalence of GSD, and the results were presented as odds ratios (OR) and 95% confidence intervals (95% CI). A total of 4077 participants were included in the final analysis, of which 456 participants had GSD and 3621 participants serving as the control group. No significant associations between GSD and intakes of dietary trace minerals (iron, selenium, and zinc) were found. However, after adjusting for all covariates, significant association was demonstrated between dietary copper (Cu) intake and GSD (OR = 0.66, 95% CI = 0.45–0.98). After conducting a weighted quantile logistic regression, a significant negative correlation was also found between dietary Cu intake and highest GSD quartile (Q4) (OR = 0.45, 95% CI = 0.26–0.80). Following the research outlined above, no association was found between intakes of dietary trace minerals (iron, selenium, and zinc) and GSD; however, a linear negative association was identified between dietary Cu intake and GSD.