The Earth's geoid is one of the most important fundamental concepts to provide a gravity fieldrelated height reference in geodesy and associated sciences. To keep up with the ever-increasing experimental capabilities and to consistently interpret high-precision measurements without any doubt, a relativistic treatment of geodetic notions (including the geoid) within Einstein's theory of General Relativity is inevitable. Building on the theoretical construction of isochronometric surfaces and the so-called redshift potential for clock comparison, we define a relativistic gravity potential as a generalization of known (post-)Newtonian notions. This potential exists for any stationary configuration and rigidly co-rotating observers. It is the same as realized by local plumb lines. In a second step, we employ the gravity potential to define the relativistic geoid in direct analogy to the Newtonian understanding. In the respective limits, it allows to recover well-known (post-) Newtonian results. For a better illustration and proper interpretation of the general relativistic gravity potential and geoid, we consider some particular examples. Explicit results are derived for exact vacuum solutions to Einstein's field equation as well as a parametrized post-Newtonian model. Comparing the Earth's Newtonian geoid to its relativistic generalization is a very subtle problem. However, an isometric embedding into Euclidean three-dimensional space can solve it and allows a genuinely intrinsic comparison. With this method, the leading-order differences are determined, which are at the mm-level.