The only treatment currently available to combat celiac disease (CD) is strict adherence to a gluten-free diet (GFD), but there may be various determinants of its adherence, including food neophobia (FN), that is associated with sensory aversions, or fears of negative consequences of eating specific food products, that may be crucial for CD patients following a GFD. The aim of the present study was to analyze food neophobia levels and its determinants in CD patients in comparison with other individuals who follow a GFD based on their own decision. The study was conducted in two independent groups of individuals following a GFD: those diagnosed with CD (n = 101) and those following a GFD based on their own decision (n = 124). Each group was recruited with cooperation from the local CD and GFD societies located in Poland. The FN was assessed using the Food Neophobia Scale (FNS) and compared between groups, as well as the influence of gender, age, body mass index, educational level, place of residence and employment status was assessed. It was stated, that for the individuals following a GFD, CD was the major determinant of FN. The FNS score values were higher (indicating higher food neophobia) for CD individuals (39.4 ± 9.2), than for those following a GFD based on their own decision (33.6 ± 8.7; p < 0.0001) and it was observed both for general group and for sub-groups stratified by assessed variables. Moreover, the indicated variables did not influence the FNS in any of the analyzed groups. The influence of CD with no influence of other variables was confirmed in the regression analysis. It may be concluded that CD is a major contributor to FN, which can be attributed to fear of developing adverse reactions to gluten-contaminated food products, which is more pronounced in CD patients compared to non-CD patients following a GFD based on their own decision.