The eastern coastline of James Bay is known to have been home to sizeable eelgrass beds (Zostera marina L.) which thrived in the bay’s shallow, subarctic waters. The region was subjected to substantial hydroelectric dams, large fires, and other human activities in the past half-century. To assess the impact of these factors on eelgrass beds, a historical reconstruction of eelgrass bed distribution was performed from images acquired by Landsat-5 Thematic Mapper (TM) in 1988, 1991, and 1996 and images of the Landsat-8 Operational Land Imager (OLI) in 2019. All the images were classified using the Random Forests classifier (RF) and assessed for accuracy each year on a bay-wide scale using an independent field validation dataset. The validation data were extracted from an eelgrass bed map established using aerial photos and field surveys in 1986, 1991, and 1995 and from a field survey in 2019. The overall validation accuracy of the classified images (between 72% and 85%) showed good agreement with the other datasets for most locations, providing reassurance about the reliability of the research. This makes it possible to use satellite imagery to detect past changes to eelgrass distribution within a bay. The classified images of 1988 and 1996 were also compared to aerial photos taken in years close to each other at ten sites to determine their ability to assess small eelgrass beds’ shape and presence. Such a comparison revealed that the classified images accurately portrayed eelgrass distribution even at finer scales.