PurposeThe aim of this paper is to undertake an exploration of the challenges related to knowledge management (KM) within public sector organisations in Jordan.Design/methodology/approachThere was the adoption of a qualitative method to achieve the objective of the study, with content analysis undertaken on ten assessment reports, so the results of the content analysis could be validated. A total of 20 semi-structured interviews were conducted within the sample organisations. The sample was made up of ten public sector organisations that had participated at least twice within the King Abdullah Excellence Award with acknowledgement within their reports of failure to achieve results that were satisfactory for KM.FindingsKM challenges identified reflect various aspects of different factors, such as organisational structure, culture, KM processes and the evaluation of KM. In practical terms, the main KM-related challenges for the Jordanian public sector are considered to be a lack of a culture of teamwork to support sharing and exchange of knowledge, lack of required documentation for the building of organisational memory needed for processes of KM, lack of training for KM, lack of clear vision and strategy for KM and lack of proper methodologies for the management of internal knowledge and weaknesses in the integration of information and data.Originality/valueThe study puts forward a conceptual model that can be used in assessing the challenges that managers face when they seek to implement KM in organisations within the public sector. The challenges of KM within the public sector have been studied widely, in general; however there is an importance to gaining better understanding of how to overcome those challenges. Compared with most of the existent studies, this particular research has offered detailed, specific insights into challenges for KM within the public sector, along with provision of a conceptual model that other researchers could use in the future.