EMCA: Efficient Multiscale Channel Attention Module

Abstract

Attention mechanisms have been explored with CNNs across the spatial and channel dimensions. However, all the existing methods devote the attention modules to capture local interactions from a uni-scale. This paper tackles the following question: can one consolidate multi-scale aggregation while learning channel attention more efficiently? To this end, we avail channel-wise attention over multiple feature scales, which empirically shows its aptitude to replace the limited local and uni-scale attention modules. EMCA is lightweight and can efficiently model the global context further; it is easily integrated into any feed-forward CNN architectures and trained in an end-to-end fashion. We validate our novel architecture through comprehensive experiments on image classification, object detection, and instance segmentation with different backbones. Our experiments show consistent gains in performances against their counterparts, where our proposed module, named EMCA, outperforms other channel attention techniques in accuracy and latency trade-off. More specifically, compared to SENet, we boost the accuracy by 0.8 %, 0.6 %, and 1 % on ImageNet benchmark for ResNet-18, 34, and 50, respectively. For detection and segmentation tasks, MS-COCO are for benchmarking, Our EMCA module boost the accuracy by 0.5 % and 0.3 %, respectively. We also conduct experiments that probe the robustness of the learned representations. Our code will be published once the paper is accepted.

An Anchor-Free Lightweight Object Detection Network

“…To verify the effectiveness of the proposed model, the detection results of the proposed model on MS COCO dataset are compared with four multi-stage methods, including Faster R-CNN [15], Mask RCNN [47], Libra RCNN [48], AutoDet [49], six one-stage methods, including YOLOv3 [50], SSD [29], RefineDet [51], RetinaNet [18], GHM [42], EMCA [53] and five anchor-free methods, including CornerNet [19], FCOS [21], ReFPN-FCOS [54], Pseudo-IoU [54], ObjectBox [56] methods, and the comparison results are shown in Table 1.…”