In this paper, we propose a method, named EqCo (Equivalent Rules for Contrastive Learning), to make self-supervised learning irrelevant to the number of negative samples in the contrastive learning framework. Inspired by the InfoMax principle, we point that the margin term in contrastive loss needs to be adaptively scaled according to the number of negative pairs in order to keep steady mutual information bound and gradient magnitude. EqCo bridges the performance gap among a wide range of negative sample sizes, so that for the first time, we can perform self-supervised contrastive training using only a few negative pairs (e.g. smaller than 256 per query) on large-scale vision tasks like ImageNet, while with little accuracy drop. This is quite a contrast to the widely used large batch training or memory bank mechanism in current practices. Equipped with EqCo, our simplified MoCo (SiMo) achieves comparable accuracy with MoCo v2 on Ima-geNet (linear evaluation protocol) while only involves 16 negative pairs per query instead of 65536, suggesting that large quantities of negative samples might not be a critical factor in contrastive learning frameworks.

Objectives: Assessing implant stability is integral to dental implant therapy. This study aimed to construct a multi-task cascade convolution neural network to evaluate implant stability using cone-beam computed tomography (CBCT). Methods: A dataset of 779 implant coronal section images was obtained from CBCT scans, and matching clinical information was used for the training and test datasets. We developed a multi-task cascade network based on CBCT to assess implant stability. We used the MobilenetV2-DeeplabV3+ semantic segmentation network, combined with an image processing algorithm in conjunction with prior knowledge, to generate the volume of interest (VOI) that was eventually used for the ResNet-50 classification of implant stability. The performance of the multitask cascade network was evaluated in a test set by comparing the implant stability quotient (ISQ), measured using an Osstell device. Results: The cascade network established in this study showed good prediction performance for implant stability classification. The binary, ternary, and quaternary ISQ classification test set accuracies were 96.13%, 95.33%, and 92.90%, with mean precisions of 96.20%, 95.33%, and 93.71%, respectively. In addition, this cascade network evaluated each implant’s stability in only 3.76 s, indicating high efficiency. Conclusions: To our knowledge, this is the first study to present a CBCT-based deep learning approach CBCT to assess implant stability. The multi-task cascade network accomplishes a series of tasks related to implant denture segmentation, VOI extraction, and implant stability classification, and has good concordance with the ISQ.

No abstract