The survival of marginal/peripheral silver fir (Abies alba Mill.) populations in the broader region of Southeast Europe is endangered due to climate change and population decline. This study aimed to determine the level and pattern of variability for the anatomical traits of needles and the possibility of linking the pattern of phenotypic variability with environmental factors. In most of the analyzed needle traits, the statistically significant variability between populations was determined. According to the results of the multivariate principal component analysis, it is evident that the populations are distinct from each other, in three groups. The climatic factors Hargreaves reference evaporation, mean annual temperature, and growing degree-days, were statistically significantly correlated. The altitude and heating degree-days are statistically significantly correlated with the following three environmental factors: Hargreaves reference evaporation, mean annual temperature and growing degree-days, but negatively with others. The paper’s findings indicate significant moderate and high correlations between the anatomical traits of the needles’ central bundle diameter with the resin duct diameter, the distance between the vascular bundle and the resin duct and the epidermis thickness with cuticle, the resin duct diameter with the distance between the vascular bundle and the resin duct and the epidermis thickness with cuticle, as well as the distance between the vascular bundle and the resin duct with the hypodermis height and the epidermis thickness with cuticle. The results of agglomerative hierarchical clustering analysis, performed for anatomical and climatic traits, confirmed the existence of three groups of tested populations according to the altitude gradient. Research results provide knowledge on the diversity and structure of Abies alba populations of Southeast Europe, important for further research and guidelines for the species’ conservation and genetic variability preservation in the southern marginal distribution area and keeping in line with climate change projections.