Currently, higher learning institutions (HLIs) are facing their most challenging problem in inefficient information management. The knowledge management system (KMS) application calls for providing several benefits to lecturers and students, producing daily information, documenting records for evidence of a transaction, and eventually improving the decision-making process. Knowledge management can be coupled with fuzzy logic to deal with imprecision and uncertainty of data in a KMS. The ICT dynamic development has shifted the HLI operations from manual to electronic-based handling of related information. KMS is one of the systems that are of significant consideration in this regard. Nevertheless, such a system has not been extensively adopted as expected due to users’ rejection of its use. In the present paper, the factors affecting the decision to adopt/reject KMS are highlighted. The study is qualitative and entails a critical review of the related literature concerning the topic, backed by interviews. KMS experts working with highly reputable HLI were interviewed. A total of 11 factors were focused on in light of their effect on the decision to adopt/reject KMS, as argued by the technological adoption theories and literature review. All the factors were validated and placed in ranks by the experts. From the results, a novel conceptual framework of KMS adoption was developed for Libyan HLIs to bring about technology adoption and improved decision-making.