Several studies reveal that knowledge management is crucial in enabling institutions gain and maintain a competitive advantage. Yet, institutions must leverage their internal quality assurance mechanisms as a prerequisite for gaining and maintaining an edge over competitors. Based on this revelation, the paper set out to examine how knowledge management can be used to build strong internal quality assurance framework in HEIs basing on institutional theoretical perspective. Using an in-depth literature review, it was revealed that knowledge of external stakeholders should constitute part of the knowledge used in developing quality assurance policies. In addition, HEIs will also identify internal knowledge sources that enhance designing of quality assurance mechanisms that satisfy normative prescriptions. Moreover, HEIs that embrace mimetic isomorphism by copying and incorporating best practices from other institutions will likely improve the teaching, staff development and pedagogical quality. These institutional logics act in the best interest of the HEIs by providing critical linkages for knowledge management-internal quality assurance nexus.