Energy-Propagation Graph Neural Networks for Enhanced Out-of-Distribution Fault Analysis in Intelligent Construction Machinery Systems

Li, Xinming; Li, Meng; Gu, Jiawei; Wang, Yanxue; Yao, Jiachi; Feng, Jianbo

doi:10.1109/jiot.2024.3463718

IEEE Internet Things J.

2024

DOI: 10.1109/jiot.2024.3463718

|View full text |Cite

Energy-Propagation Graph Neural Networks for Enhanced Out-of-Distribution Fault Analysis in Intelligent Construction Machinery Systems

Xinming Li,

Meng Li,

Jiawei Gu

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

A lightweight and rapidly converging transformer based on separable linear self-attention for fault diagnosis

Yin,

Chen,

Shen

et al. 2024

Meas. Sci. Technol.

View full text Add to dashboard Cite

Reaching reliable decisions on equipment maintenance is facilitated by the implementation of intelligent fault diagnosis techniques for rotating machineries. Recently, the Transformer model has demonstrated exceptional capabilities in global feature modeling for fault diagnosis tasks, garnering significant attention from the academic community. However, it lacks sufficient prior knowledge regarding rotation invariance, scale, and shift, necessitating pre-training on extensive datasets. In comparison, contemporary convolutional neural networks exhibit greater ease of optimization. This limitation becomes particularly evident when applying the Transformer model in fault diagnosis scenarios with limited data availability. Moreover, the increasing the number of parameters and FLOPs. pose a challenge to its suitability for mobile services due to the limited computational resources available on edge devices. To mitigate these issues, this paper introduces a novel lightweight Transformer (SepFormer) based on separable linear self-attention for fault diagnosis task. The SepFormer performs a novel sequence-level feature embedding to better leverage the inductive bias inherent in the convolutional layers. Furthermore, it integrate a novel separable linear self-attention mechanism into the Transformer architecture, effectively mitigating the computational burden concerns and significantly enhancing the training convergence speed. Extensive experiments are conducted extensively on a bearing fault dataset and gear fault dataset. The experimental results demonstrate that the SepFormer achieves a top-1 accuracy exceeding state-of-the-art approaches by more than 5%, while utilizing the fewest FLOPs. Moreover, the optimizability of SepFormer surpasses that of CNN, ensuring its superior preservation of inductive bias.

show abstract

A lightweight and rapidly converging transformer based on separable linear self-attention for fault diagnosis

Yin,

Chen,

Shen

et al. 2024

Meas. Sci. Technol.

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Energy-Propagation Graph Neural Networks for Enhanced Out-of-Distribution Fault Analysis in Intelligent Construction Machinery Systems

Cited by 1 publication

References 38 publications

A lightweight and rapidly converging transformer based on separable linear self-attention for fault diagnosis

A lightweight and rapidly converging transformer based on separable linear self-attention for fault diagnosis

Contact Info

Product

Resources

About