Deep neural network (DNN) based computer-aided breast tumor diagnosis (CABTD) method plays a vital role in the early detection and diagnosis of breast tumors. However, a Brightness mode (B-mode) ultrasound image derives training feature samples that make closer isolation toward the infection part. Hence, it is expensive due to a meta-heuristic search of features occupying the global region of interest (ROI) structures of input images. Thus, it may lead to the high computational complexity of the pre-trained DNN-based CABTD method. This paper proposes a novel ensemble pre-trained DNN-based CABTD method using global-and local-ROI-structures of B-mode ultrasound images. It conveys the additional consideration of a local-ROI-structures for further enhancing the pre-trained DNN-based CABTD method's breast tumor diagnostic performance without degrading its visual quality. The features are extracted at various depths (18, 50, and 101) from the global and local ROI structures and feed to support vector machine for better classification. From the experimental results, it has been observed that the combined local and global ROI structure of small depth residual network ResNet18 (0.8 in %) has produced significant improvement in pixel ratio as compared to ResNet50 (0.5 in %) and ResNet101 (0.3 in %), respectively. Subsequently, the pre-trained DNN-based CABTD methods have been tested by influencing local and global ROI structures to diagnose two specific breast tumors (Benign and Malignant) and improve the diagnostic accuracy (86%) compared to Dense Net, Alex Net, VGG Net, and Google Net. Moreover, it reduces the computational complexity due to the small depth residual network ResNet18, respectively.