Eradicating poverty is a strategic priority in the pursuit of Sustainable Development Goals. This study intends to identify and quantify the elements affecting the Characteristic Agriculture Development (CAD) project implemented in area of Chinese poverty and reveals the interrelationships between those elements. First-hand data for the structural modeling were collected through semi-structured interviews with a group of selected experts. As a result, this study has identified seventeen representative elements, and the interrelationships between them have been examined based on the Interpretive Structural Modeling (ISM) method. Furthermore, these elements were further categorized into four categories depending on their driving power and dependence power by using the cross-impact matrix multiplication applied to classification (MICMAC) analysis. The combination result of the elements identification, ISM modeling and MICMAC analysis provide a conceptual framework for designing, implementing, and managing CAD projects conducted in rural China. Finally, we suggest that an appropriate approach should be applied to empower the poor, promote target group participation, optimize the regional agriculture structure, and increase the agro value chain competiveness in CAD project implementation.