Cross-view image matching has attracted extensive attention due to its huge potential applications, such as localization and navigation. Unmanned aerial vehicle (UAV) technology has been developed rapidly in recent years, and people have more opportunities to obtain and use UAV-view images than ever before. However, the algorithms of cross-view image matching between the UAV view (oblique view) and the satellite view (vertical view) are still in their beginning stage, and the matching accuracy is expected to be further improved when applied in real situations. Within this context, in this study, we proposed a cross-view matching method based on location classification (hereinafter referred to LCM), in which the similarity between UAV and satellite views is considered, and we implemented the method with the newest UAV-based geo-localization dataset (University-1652). LCM is able to solve the imbalance of the input sample number between the satellite images and the UAV images. In the training stage, LCM can simplify the retrieval problem into a classification problem and consider the influence of the feature vector size on the matching accuracy. Compared with one study, LCM shows higher accuracies, and Recall@K (K ∈ {1, 5, 10}) and the average precision (AP) were improved by 5–10%. The expansion of satellite-view images and multiple queries proposed by the LCM are capable of improving the matching accuracy during the experiment. In addition, the influences of different feature sizes on the LCM’s accuracy are determined, and we found that 512 is the optimal feature size. Finally, the LCM model trained based on synthetic UAV-view images was evaluated in real-world situations, and the evaluation result shows that it still has satisfactory matching accuracy. The LCM can realize the bidirectional matching between the UAV-view image and the satellite-view image and can contribute to two applications: (i) UAV-view image localization (i.e., predicting the geographic location of UAV-view images based on satellite-view images with geo-tags) and (ii) UAV navigation (i.e., driving the UAV to the region of interest in the satellite-view image based on the flight record).
Background: Robotic-assisted total knee arthroplasty (TKA) was performed to promote the accuracy of bone resection and mechanical alignment. Among these TKA system procedures, 3D reconstruction of CT data of lower limbs consumes significant manpower. Artificial intelligence (AI) algorithms applying deep learning has been proved efficient in automated identification and visual processing.Methods: CT data of a total of 200 lower limbs scanning were used for AI-based 3D model construction and CT data of 20 lower limbs scanning were utilised for verification.
Results:We showed that the performance of an AI-guided 3D reconstruction of CT data of lower limbs for robotic-assisted TKA was similar to that of the operatorbased approach. The time of 3D lower limb model construction using AI was 4.7 min. AI-based 3D models can be used for surgical planning.
Conclusion:AI was used for the first time to guide the 3D reconstruction of CT data of lower limbs for facilitating robotic-assisted TKA. Incorporation of AI in 3D model reconstruction before TKA might reduce the workload of radiologists.
K E Y W O R D Sartificial intelligence, HURWA robotic-assisted TKA system, robotically TKA assisted system, 3D CT model
| INTRODUCTIONTotal knee arthroplasty (TKA) is an effective procedure for cases with end-stage rheumatoid arthritis or osteoarthritis of the knee. 1 The surgery was carried out in over 370,000 and 700,000 patients annually in China and USA, respectively. 2 Despite the development in implant materials and design, thromboembolic prophylaxis, rehabilitation, computer navigation and patient-specific implants, and the use of prophylactic antibiotics, over 20% of patients reported unsatisfaction following TKA. [3][4][5][6] Robotically assisted TKA was thus developed to promote mechanical alignment, accuracy of bone resection, soft tissue protection, and implant survivorship and implant stability. [7][8][9][10] In this connection, our previous studies showed that a novel HURWA robotic-assisted TKA system (BEIJING HURWA-ROBOT Technology Co. Ltd) could enhance the accuracy of bone resection in terms of resection angles and levels in the sawbone and the sheep models. 11,12 The procedures of robotic-assisted TKA system consists of the following steps: preoperative computed tomography (CT) scanning of lower limbs, three-dimensional (3D) reconstruction of CT data of lower limbs, CT-based planning, surgical planning depending on the 3D CT model, and the act of performing robotic-assisted TKA. Among
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.