Discrimination between tectonic and non-tectonic events is crucial to assess seismic hazards and manage associated risks. However, the discrimination process is challenging due to the imbalanced distribution of tectonic and non-tectonic events. In this paper, we propose a ghost-attention network (GA-Net) consisting of multiple ghost modules and convolutional block attention modules (CBAMs) to solve this problem. Ghost module allows the network to extract feature maps using cost effective operations, which are suitable for small and unbalanced training sets. CBAM emphasizes meaningful features along channel and spatial axes, effectively learning which information to emphasize or suppress. We train the proposed GA-Net using seismic data from Shaanxi Province in China. The evaluation shows that on the test set, the proposed GA-Net achieves sensitivity, specificity, and accuracy of 96.40%, 93.24%, and 95.75%, respectively. In addition, a comparative analysis with several state-of-the-art networks establishes its superiority. Our GA-Net exhibits robust generalized performance on several training sets with different imbalanced levels and an independent dataset.