Precise information of geoid undulations is essential for obtaining the orthometric heights from Global Positioning System (GPS) measurements over any region; apart from providing the information of subsurface density distribution. This paper presents computation of geoid undulations over a part of southern Indian region from terrestrial gravity and elevation data using remove-restore technique that involves spherical Fast Fourier Transform (FFT) to compute 'Stokes' coefficients. Computed geoid undulations are compared with geoid obtained from global geopotential models such as EGM2008 and EIGEN-GRACE02S and measured GPS-levelling records at 67 locations. Statistical analysis of comparison suggests that the computed gravimetric geoid model has a good match with the geoid determined from GPS-levelling with rms of 0.1 m whereas EGM2008 has 0.46 m. The differences of GPS-levelling with EGM2008 at majority of stations fall in the range of ±0.5 m, which indicates that EGM2008 may be used for orthometric height determination with an accuracy of <0.5 m in the south Indian region and offers a reasonably good transformation platform from ellipsoid to local datum. However, local determination of geoid is necessary for better accuracy of orthometric height from GPS. The gravimetric geoid calculated from the available gravity data shows considerable improvement to the global model and can be used to achieve orthometric height with an accuracy of 0.1 m.