Background: Age-related macular degeneration (AMD) is a complex eye disorder with an environmental and genetic origin, affecting millions worldwide. The study aims to explore the association between retinal morphology and the polygenic risk score (PRS) for AMD using fundus images and deep learning techniques. Methods: The study used and pre-processed 23,654 fundus images from 332 subjects (235 patients with AMD and 97 controls), ultimately selecting 558 high-quality images for analysis. The fine-tuned DenseNet121 deep learning model was employed to estimate PRS from single fundus images. After training, deep features were extracted, fused, and used in machine learning regression models to estimate PRS for each subject. The Grad-CAM technique was applied to examine the relationship between areas of increased model activity and the retina’s morphological features specific to AMD. Results: Using the hybrid approach improved the results obtained by DenseNet121 in 5-fold cross-validation. The final evaluation metrics for all predictions from the best model from each fold are MAE = 0.74, MSE = 0.85, RMSE = 0.92, R2 = 0.18, MAPE = 2.41. Grad-CAM heatmap evaluation showed that the model decisions rely on lesion area, focusing mostly on the presence of drusen. The proposed approach was also shown to be sensitive to artifacts present in the image. Conclusions: The findings indicate an association between fundus images and AMD PRS, suggesting that deep learning models may effectively estimate genetic risk for AMD from retinal images, potentially aiding in early detection and personalized treatment strategies.