Sustainable and safe food is an important issue worldwide, and it depends on cost-effective analysis tools with good sensitivity and reality. However, traditional standard chemical methods of food safety detection, such as high-performance liquid chromatography (HPLC), gas chromatography (GC), and tandem mass spectrometry (MS), have the disadvantages of high cost and long testing time. Those disadvantages have prevented people from obtaining sufficient risk information to confirm the safety of their products. In addition, food safety testing, such as the bioassay method, often results in false positives or false negatives due to little rigor preprocessing of samples. So far, food safety analysis currently relies on the enzyme-linked immunosorbent assay (ELISA), polymerase chain reaction (PCR), HPLC, GC, UV-visible spectrophotometry, and MS, all of which require significant time to train qualified food safety testing laboratory operators. These factors have hindered the development of rapid food safety monitoring systems, especially in remote areas or areas with a relative lack of testing resources. Surface-enhanced Raman spectroscopy (SERS) has emerged as one of the tools of choice for food safety testing that can overcome these dilemmas over the past decades. SERS offers advantages over chromatographic mass spectrometry analysis due to its portability, non-destructive nature, and lower cost implications. However, as it currently stands, Raman spectroscopy is a supplemental tool in chemical analysis, reinforcing and enhancing the completeness and coverage of the food safety analysis system. SERS combines portability with non-destructive and cheaper detection costs to gain an advantage over chromatographic mass spectrometry analysis. SERS has encountered many challenges in moving toward regulatory applications in food safety, such as quantitative accuracy, poor reproducibility, and instability of large molecule detection. As a result, the reality of SERS, as a screening tool for regulatory announcements worldwide, is still uncommon. In this review article, we have compiled the current designs and fabrications of SERS substrates for food safety detection to unify all the requirements and the opportunities to overcome these challenges. This review is expected to improve the interest in the sensing field of SERS and facilitate the SERS applications in food safety detection in the future.