Communities living in the Chittagong Hill Districts (CHD) of Bangladesh recurrently observe landslide disasters during the monsoon season (June–September). CHD is primarily dominated by three distinct groups of hill communities, namely, urbanised hill (Bengali), indigenous tribal and stateless Rohingya refugees. Landslide vulnerability amongst them is complex and varies between physical, social, economic, environmental, institutional and cultural dimensions. This study aims to understand driving forces of landslide disasters in the region by emphasising human factors. Data from the three contrasting communities were collected through participatory workshops, in-depth interviews and fieldwork observation. The participants were local people and landslide experts who were purposefully selected from five case study communities in the CHD. They ranked different socio-economic problems, identified causes of landslides and proposed landslide mitigation action plans. Results suggest that the urbanised Bengali and Rohingya refugee communities are highly vulnerable to landslides. The urbanised hill communities largely deal with poverty, social injustice, lack of planning regulations and illegal hill cutting issues, whereas the Rohingya refugees’ predominant constraints are linked to the ongoing genocide and state-sponsored violence in Myanmar hindering their sustainable repatriation, and their protracted living conditions in Bangladesh. The indigenous tribal communities are comparatively resilient to landslides due to their unique history, traditional knowledge, cultural heritage and lifestyle. Landslides in the CHD should be characterised as socio-natural hazards since the components of landslide disasters are profoundly intertwined with the culture–conflict–corruption nexus.