Continuous structural health monitoring has the potential to significantly improve the safety management of aged, in-service civil structures. In particular, monitoring of local damage growth at hot-spot areas can help to prevent disastrous structural failures. Although ultrasonic nondestructive evaluation (NDE) has proved to be effective in monitoring local damage growth, conventional equipment and devices are usually bulky and only suitable for scheduled human inspections. The objective of this research is to harness the latest developments in embedded hardware and wireless communication for developing a stand-alone, compact ultrasonic device. The device is oriented for the continuous structural health monitoring of civil structures. Relying on battery power, the device possesses functionalities of high-speed actuation, sensing, signal processing, and wireless communication. Integrated with contact ultrasonic transducers, the device can generate 1-MHz Rayleigh surface waves in a steel specimen and measure response waves. A Hilbert-transform-based envelope detection algorithm is presented for efficiently determining the peak values of the response signals, from which small surface cracks are successfully identified.