Surface-enhanced Raman spectroscopy (SERS) is an attractive tool for the sensing of molecules in the fields of chemical and biochemical analysis as it enables the sensitive detection of molecular fingerprint information even at the single-molecule level. In addition to traditional coinage metals in SERS analysis, recent research on noble-metal-free materials has also yielded highly sensitive SERS activity. This Minireview presents the recent development of noble-metal-free materials as SERS substrates and their potential applications, especially semiconductors and emerging graphene-based nanostructures. Rather than providing an exhaustive review of this field, possible contributions from semiconductor substrates, characteristics of graphene enhanced Raman scattering, as well as effect factors such as surface plasmon resonance, structure and defects of the nanostructures that are considered essential for SERS activity are emphasized. The intention is to illustrate, through these examples, that the promise of noble-metal-free materials for enhancing detection sensitivity can further fuel the development of SERS-related applications.