Toxic metal pollution is a global issue, and the use of metal-accumulating plants to clean contaminated ecosystems is one of the most rapidly growing ecologically beneficial and cost-effective technologies. In this study, samples of sediment and three mangrove species (Excoecaria agallocha, Avicennia officinalis, Sonneratia apetala) were collected from the world’s largest mangrove forest (along the Northern Bay of Bengal Coast) with the aim of evaluating metal concentrations, contamination degrees, and phytoremediation potentiality of those plants. Overall, the heavy metals concentration in sediment ranged from Cu: 72.41–95.89 mg/kg; Zn: 51.28–71.20 mg/kg; Fe: 22,760–27,470 mg/kg; Mn: 80.37–116.37 mg/kg; Sr: 167.92–221.44 mg/kg. In mangrove plants, the mean concentrations were in the order of E. agallocha > A. officinalis > S. apetala. The mean (± SD) concentration of each metal in the plant tissue (root) was found following the descending order of Fe (737.37 ± 153.06) > Mn (151.13 ± 34.26) > Sr (20.98 ± 6.97) > Cu (16.12 ± 4.34) > Zn (11.3 ± 2.39) mg/kg, whereas, in the leaf part, the mean concentration (mg/kg) of each metal found in the order of Fe (598.75 ± 410.65) > Mn (297.27 ± 148.11) > Sr (21.40 ± 8.71) > Cu (14.25 ± 2.51) > Zn (12.56 ± 2.13). The contamination factor (CF) values for the studied metals were in the descending order of Cu > Sr > Zn > Fe > Mn. The values of Igeo (Geo-accumulation index) and CF showed that the area was unpolluted to moderately polluted by Zn, Fe, Mn, Cu and Sr. Enrichment factor (EF) values in both sampling stations portrayed moderate to minimum enrichment. Phytoremediation potentiality of the species was assessed by bio-concentration factor (BCF) and translocation factor (TF). BCF values showed less accumulation for most of the heavy metals (<1) except Mn which was highly accumulated in all mangrove plants. The translocation factor (TF) values depicted that most of the heavy metals were strongly accumulated in plant tissues (>1). However, the BCF value depicts that Mn was highly bioconcentrated in E. agallocha, but the translocation on leaves tissue were minimum, which reveals that E. agallocha is phytoextractor for Mn, and accumulated in root tissues. All the examined plants can be used as phytoextractors as they have bioconcentration factors <1 and translocation factors >1. However, A. officinalis is clearly more suitable for metal extraction than S. apetala and E. agallocha in terms of hyper-metabolizing capabilities.