Background: Estimates of unmet needs, as an indicator of future needs for long-term care (LTC) services, have become increasingly crucial policy concerns. This study aimed to examine the urban-rural differences in unmet needs and the demand for community care service among community-dwelling elderly people in China. Methods: The data come from the 2014 Chinese Longitudinal Health Longevity Survey (CLHLS). A total of 1587 community residents aged 65+ with disabilities in the activities of daily living (ADLs) were included in this study. Based on the Andersen theoretical model, binary logistic regression was used to estimate the correlates of unmet needs in LTC. A chi-square test was used to examine the differences in expected needs for community-based LTC services between urban and rural areas. Results: Over half (55.07%) of the participants reported their needs were unmet. Poor economic status and reluctant caregivers seriously affected elderly unmet needs. Among urban older adults, those who were male and lonely reported more unmet needs. Among rural ones, those with severe ADL disability and poor self-rated health reported more unmet needs. In addition, access to medication and home visit services were negatively associated with unmet needs. Living with children (69.12%) was viewed as the most desirable living arrangement among older adults, while living in a LTC facility seemed to be more accepted for rural residents with unmet needs than for other elderly respondents. Residents showed a high demand for community LTC care services, with 82.55% of them expecting to need home visits and 74.29% to healthcare education. Specifically, rural residents had greater expected needs for every community care service than their urban counterparts. However, only 4.66% to 36.42% of the respondents reported that all eight types of services were available, which was far below the demand for these services. Conclusion: The risk of having unmet LTC needs is largely determined by elderly people’s economic status and caregivers’ willingness to provide care for both rural and urban elderly residents. More attention should be paid to psychological consulting services in urban areas, as well as personal care, home visits, psychological consulting and healthcare education services in rural areas.