In the context of China’s Pilot Free Trade Zone (FTZ), ports have a new opportunity to realize high-quality development. Based on the analysis of the current situation of pollutant emissions from ports in China’s Pilot Free Trade Zones (FTZs), this paper introduces environmental factors into the analysis framework of the total factor productivity (TFP) of ports in China’s FTZs, and uses the Global Malmquist–Luenberger index method to analyze the evolution trend and heterogeneity of green TFP in 28 ports of China’s 19 FTZs from 2011 to 2017. The results show that firstly, the emissions of sulfur dioxide (SO2), nitrogen oxides (NOX) and other pollutants in China’s FTZs have been decreasing year by year. Secondly, both the green TFP and the traditional TFP of the ports in FTZs are on the rise. The absence of environmental factors leads to the underestimation of the TFP of ports. For the green TFP, the main source of its growth is technological progress. Thirdly, there is obvious port heterogeneity in the green TFP of FTZ ports. Nanjing Port has the highest green TFP growth rate, with an average annual growth rate of 21.95%. Ningbo Port, which ranks 14th, has an average annual growth rate of 5.46%. Fuzhou Port, which is rated last, has negative growth. Fourthly, there is also obvious types and regional heterogeneity in the green TFP of FTZ ports. When categorized by type, the average annual growth rate of green TFP in inland ports is significantly higher than that of coastal ports. When categorized by region, the descending order of the average annual growth rate of green TFP is the western region, the eastern region and the central region. Fifthly, the green TFP differences among the eastern, central, and western regions, as well as between inland ports and coastal ports, are shrinking. Moreover, the green TFP differences within inland ports and coastal ports and within central ports and eastern ports are also shrinking, implying there may be σ convergence. The conclusions of this paper have important implications for the scientific understanding of the heterogeneity of green TFP growth in ports in China’s FTZs, and how to promote the green development of ports in China’s FTZs under environmental constraints.