For many engineering applications, it is sufficient to use the concept of simple materials. However, higher gradients of the kinematic variables are taken into account to model materials with internal length scales as well as to describe localization effects using gradient theories in finite plasticity or fluid mechanics. In many approaches, length scale parameters have been introduced that are related to a specific micro structure. An alternative approach is possible, if a thermodynamically consistent framework is used for material modeling, as shown in the present contribution. However, even if sophisticated and thermodynamically consistent material models can be established, there are still not yet standard experiments to determine higher order material constants. In order to contribute to this ongoing discussion, system identification based on the method of self-adaptive filtering is proposed in this paper. To evaluate the effectiveness of this approach, it has been applied to second-order gradient materials considering longitudinal vibrations. Based on thermodynamically consistent models that have been solved numerically, it has been possible to prove that system identification based on self-adaptive filtering can be used effectively for both narrow-band and broadband signals in the field of second-order gradient materials. It has also been found that the differences identified for simple materials and gradient materials allow for condition monitoring and detection of gradient effects in the material behavior.