A method is proposed based on the transmissibility function and the Online Sequence Extreme Learning Machine (OS-ELM) algorithm, which is applied to the impact damage of composite materials. First of all, the transmissibility functions of the undamaged signals and the damage signals at different points are calculated. Secondly, the difference between them is taken as the damage index. Finally, principal component analysis (PCA) is used to reduce the noise feature. And then, input to the online sequence limit learning neural network classification to identify damage and confirm the damage location. Taking the amplitude of the transmissibility function instead of the acceleration response as the signal analysis for structural damage identification cannot be influenced by the excitation amplitude. The OS-ELM algorithm is based on the ELM (Extreme Learning Machine) algorithm, increased training speed also increases the recognition accuracy. Experiment in the epoxy board shows that the method can effectively identify the structural damage accurately.