This study collected basic information and conducted waste composition surveys to identify the present management condition of construction and demolition waste (CDW) landfills in Hanoi of Vietnam and to characterize waste composition and grain size distribution of CDW dumped at landfills. Basic information on seven CDW landfills under operation or closed/abandoned was collected, and the waste composition and the grain size distributions of dumped CDW at two landfills were investigated. Results showed that only one landfill site is currently under operation in Hanoi. Sanitary conditions of investigated landfills were relatively good without dumping of hazardous waste. Illegal dumping of domestic waste from residents, however, could be observed more or less at all sites due to an unclear boundary between dumping and surrounding areas. To improve current management of CDW landfills, a suitable recording system of accepted/dumped CDW and technical support for site managers are required as well as the implementation plan for developing and renovating landfills. Based on the results of the waste composition survey, the major components of dumped CDW were “Concrete”, “Clay bricks”, and “Soil-like”, and the sum of these materials reached >80% of the total. Grain size distributions of “Concrete” ranged from 10–600 mm and of “Clay bricks” ranged from 10–300 mm. Technical recommendations to examine a potential availability of dumped “Concrete” and “Clay bricks” as a base material in road construction are summarized from the viewpoints of segregation from “Soil-like” and impurities, grading of “Concrete” and “Clay bricks”, mechanical properties and environmental safety, and economic feasibility. The findings in this study raise challenges and perspectives to establish sound CDW management and to promote sustainable development of CDW recycling in Vietnam.