Background Surgical site infections (SSIs) are among the most common infections seen in hospitalized patients in low- and middle-income countries (LMICs), accounting for up to 60% of hospital-acquired infections. Surgical antimicrobial prophylaxis (SAP) has shown to be an effective intervention for reducing SSIs and their impact. There are concerns of inappropriate use of SAP in Ghana and therefore our audit in this teaching hospital. Methods A retrospective cross sectional clinical audit of medical records of patients undergoing surgery over a 5 month duration from January to May 2021 in Ho Teaching Hospital. A data collection form was designed to collect key information including the age and gender of patients, type and duration of surgery, choice and duration of SAP. The collected data was assessed for the proportion of SAP compliance with Ghana Standard Treatment Guidelines (STGs) and any association with various patient, surgical wound and drug characteristics. Results Of the 597 medical records assessed, the mean age of patients was 35.6 ± 12.2 years with 86.8% (n = 518) female. Overall SAP compliance with the STG was 2.5% (n = 15). SAP compliance due to appropriate choice of antimicrobials was 67.0% (n = 400) and duration at 8.7% (n = 52). SAP compliance was predicted by duration of SAP (P < 0.000) and postoperative hospitalization duration (P = 0.005). Conclusions SAP compliance rate was suboptimal, principally due to a longer duration of prescription. Quality improvement measures such as education of front-line staff on guideline compliance, coupled with clinical audit and regular updates, are urgently needed to combat inappropriate prescribing and rising resistance rates.