The carbon-based micro/nano electromechanical system (MEMS/NEMS) technique provides a powerful approach to large-scale manufacture of high-aspect-ratio carbon structures for wafer-level processing. The fabricated three-dimensional (3D) carbon structures have the advantages of excellent electrical and electrochemical properties, and superior biocompatibility. In order to improve their performance for applications in micro energy storage devices and microsensors, an increase in the footprint surface area is of great importance. Various approaches have been proposed for fabricating large surface area carbon-based structures, including the integration of nanostructures such as carbon nanotubes (CNTs), graphene, nanowires, nanofilms and nanowrinkles onto 3D structures, which has been proved to be effective and productive. Moreover, by etching the 3D photoresist microstructures through oxygen plasma or modifying the photoresist with specific materials which can be etched in the following pyrolysis process, micro/nano hierarchical carbon structures have been fabricated. These improved structures show excellent performance in various applications, especially in the fields of biological sensors, surface-enhanced Raman scattering, and energy storage devices such as micro-supercapacitors and fuel cells. With the rapid development of microelectronic devices, the carbon-based MEMS/NEMS technique could make more aggressive moves into microelectronics, sensors, miniaturized power systems, etc. In this review, the recent advances in the fabrication of micro/nano hierarchical carbon-based structures are introduced and the technical challenges and future outlook of the carbon-based MEMS/NEMS techniques are also analyzed.