The implementation of Cloud Enterprise Resource Planning systems (Cloud ERP) is always challenging, which requires a variety of risks to be taken into consideration to ensure the success of the implementation. The assessment of Critical Success Factors (CSFs) in on-premise ERP implementations has been well documented but this research has not carried through to Cloud ERP implementations. Therefore, the contribution of this paper is to provide research and practice with identification and analysis of 35 CSFs through a systematic literature review. Drawing from the literature, we found security, project management, and communication are the top three widely cited CSFs during implementation. We also identify critical gaps in current research, such as inconclusiveness of findings related to CSFs and a lack of discussion on the nature of criticality of those CSFs. Furthermore, the attributes of CSFs are investigated in order to explore CSFs in a more logical and systematical way.