The accurate estimation of the zero-height geopotential level in a local vertical datum (LVD) is critical for linking traditional height reference systems to a global height system. In this paper, we investigate the theoretical and practical challenges involved in determining the offset between the North American vertical datum (NAVD) and the global vertical datum (GVD). Drawing on the classical theory of the vertical system in physical geodesy, we define the vertical datum offset and derive rigorous formulas for its calculation. We examine various factors that affect the determination of the offset, including the global gravitational models (GGMs), geodetic reference system, tide system, tilt error, and omission error. Using terrestrial gravity data and gravity anomalies from multiple GGMs in conjunction with Global Navigation Satellite System (GNSS) and orthometric heights, we estimate the vertical offset between the NAVD and GVD. Our results indicate that the geopotential difference approach and the geodetic boundary value problem (GBVP) approach yield consistent results. When the normal gravity geopotential of the geodetic reference system is selected as the gravity geopotential of the global height datum, the NAVD is approximately 0.04 m higher than the GVD relative to the GRS80 ellipsoid, and 0.97 cm higher than the GVD relative to the WGS84 ellipsoid. When the Gauss–Listing geopotential value is chosen as the gravity geopotential of the global height datum, the NAVD is roughly 1.45 m higher than the GVD relative to the GRS80 ellipsoid, and approximately 0.52 m higher than the GVD relative to the WGS84 ellipsoid.