Histopathology based on formalin-fixed and paraffin-embedded tissues remains the gold standard for surgical margin assessment (SMA). However, routine pathological practice is lengthy and laborious, failing to provide immediate feedback to surgeons and pathologists for intraoperative decision-making. In this report, we propose a cost-effective and easy-to-use histological imaging method with speckle illumination microscopy (i.e., HiLo). HiLo can achieve rapid and non-destructive imaging of large and fluorescently-labelled resection tissues at an acquisition speed of 5 cm2/min with 1.3-μm lateral resolution and 5.8-μm axial resolution, demonstrating a great potential as an intraoperative SMA tool that can be used by surgeons and pathologists to detect residual tumors at surgical margins. It is experimentally validated that HiLo enables rapid diagnosis of different subtypes of human lung adenocarcinoma and hepatocellular carcinoma, producing images with remarkably recognizable cellular features comparable to the gold-standard histology. This work will facilitate the clinical translations of HiLo microscopy to improve the current standard-of-care.