This paper concerns the use of adaptive wave cancellation in a new multilayer smart skin sensor to attenuate the primary low-frequency noise underwater. The proposed multilayered system is designed with a piezoelectric actuator (Pb(In1/2Nb1/2)O3–Pb(Mg1/3Nb2/3)O3–PbTiO3 composite) and two layers of polyvinylidene fluoride to accelerate wave absorption. Furthermore, the use of a combination of an adaptive control scheme and a time-delay signal separation method has the potential to provide the proposed absorber system with a wave cancellation capability and thereby enable the absorber system to respond to environmental changes underwater. The use of smart piezoelectric materials and an adaptive control approach enables the absorber system to achieve the high attenuation level of the reflected waves, unlike typical absorber systems based on active noise control. Echo reduction experiments showed that the proposed piezoelectric-based multilayer sensor with an adaptive controller could attenuate reflected wave signals effectively.