By using the Global Inventory Modeling and Mapping Studies (GIMMS) third-generation normalized difference vegetation index (NDVI3g) data, this paper explores the spatiotemporal variations in vegetation and their relationship with temperature and precipitation between 1982 and 2015 in the Inner Mongolia region of China. Based on yearly scale data, the vegetation changes in Inner Mongolia have experienced three stages from 1982 to 2015: the vegetation activity kept a continuous improvement from 1982–1999, then downward between 1999–2009, and upward from 2009 to 2015. On the whole, the general trend is increasing. Several areas even witnessed significant vegetation increases: in the east and south of Tongliao and Chifeng, north of Xing’anmeng, north and west of Hulunbir, and in the west of Inner Mongolia. Based on monthly scale data, one-year and half-year cycles exist in normalized difference vegetation index (NDVI) and temperature but only a one-year cycle in precipitation. Finally, based on the one-year cycle, the relationship between NDVI and climatic were studied; NDVI has a significant positive correlation with temperature and precipitation, and temperature has a greater effect in promoting vegetation growth than precipitation. Moreover, based on a half-year changing period, NDVI is only affected by temperature in the study region. Those findings can serve as a critical reference for grassland managers or policy makers to make informed decisions on grassland management.