The advent of elastic metamaterials at the beginning of the 21st century opened new venues and possibilities for the existence of new types of elastic (ultrasonic) surface waves, which were deemed previously impossible. In fact, it is not difficult to prove that shear horizontal (SH) elastic surface waves cannot exist on the elastic half-space or at the interface between two conventional elastic half-spaces. However, in this paper we will show that SH elastic surface waves can propagate at the interface between two elastic half-spaces, providing that one of them is a metamaterial with a negative elastic compliance s44(ω). If in addition, s44(ω) changes with frequency ω as the dielectric function ε(ω) in Drude’s model of metals, then the proposed SH elastic surface waves can be considered as an elastic analogue of surface plasmon polariton (SPP) electromagnetic waves, propagating at a metal-dielectric interface. Due to inherent similarities between the proposed SH elastic surface waves and SPP electromagnetic waves, the new results developed in this paper can be readily transferred into the SPP domain and vice versa. The proposed new SH elastic surface waves are characterized by a strong subwavelength confinement of energy in the vicinity of the guiding interface; therefore, they can potentially be used in subwavelength ultrasonic imaging, superlensing, and/or acoustic (ultrasonic) sensors with extremely high mass sensitivity.