Summary Intracranial aneurysm (IA) is an enormous threat to human health, which often results in nontraumatic subarachnoid hemorrhage or dismal prognosis. Diagnosing IAs on commonly used computed tomographic angiography (CTA) examinations remains laborious and time consuming, leading to error-prone results in clinical practice, especially for small targets. In this study, we propose a fully automatic deep-learning model for IA segmentation that can be applied to CTA images. Our model, called Global Localization-based IA Network (GLIA-Net), can incorporate the global localization prior and generates the fine-grain three-dimensional segmentation. GLIA-Net is trained and evaluated on a big internal dataset (1,338 scans from six institutions) and two external datasets. Evaluations show that our model exhibits good tolerance to different settings and achieves superior performance to other models. A clinical experiment further demonstrates the clinical utility of our technique, which helps radiologists in the diagnosis of IAs.

We propose a real-time DNN-based technique to segment hand and object of interacting motions from depth inputs. Our model is called DenseAttentionSeg, which contains a dense attention mechanism to fuse information in different scales and improves the results quality with skip-connections. Besides, we introduce a contour loss in model training, which helps to generate accurate hand and object boundaries. Finally, we propose and release our InterSegHands dataset 1 , a fine-scale hand segmentation dataset containing about 52k depth maps of hand-object interactions. Our experiments evaluate the effectiveness of our techniques and datasets, and indicate that our method outperforms the current state-of-the-art deep segmentation methods on interaction segmentation.

Lung cancer remains the most commonly diagnosed cancer and the leading cause of death from cancer. Recent research shows that the human eye can provide useful information about one’s health status, but few studies have revealed that the eye’s features are associated with the risk of cancer. The aims of this paper are to explore the association between scleral features and lung neoplasms and develop a non-invasive artificial intelligence (AI) method for detecting lung neoplasms based on scleral images. A novel instrument was specially developed to take the reflection-free scleral images. Then, various algorithms and different strategies were applied to find the most effective deep learning algorithm. Ultimately, the detection method based on scleral images and the multi-instance learning (MIL) model was developed to predict benign or malignant lung neoplasms. From March 2017 to January 2019, 3923 subjects were recruited for the experiment. Using the pathological diagnosis of bronchoscopy as the gold standard, 95 participants were enrolled to take scleral image screens, and 950 scleral images were fed to AI analysis. Our non-invasive AI method had an AUC of 0.897 ± 0.041(95% CI), a sensitivity of 0.836 ± 0.048 (95% CI), and a specificity of 0.828 ± 0.095 (95% CI) for distinguishing between benign and malignant lung nodules. This study suggested that scleral features such as blood vessels may be associated with lung cancer, and the non-invasive AI method based on scleral images can assist in lung neoplasm detection. This technique may hold promise for evaluating the risk of lung cancer in an asymptomatic population in areas with a shortage of medical resources and as a cost-effective adjunctive tool for LDCT screening at hospitals.

Hand-object interaction is challenging to reconstruct but important for many applications like HCI, robotics and so on. Previous works focus on either the hand or the object while we jointly track the hand poses, fuse the 3D object model and reconstruct its rigid and nonrigid motions, and perform all these tasks in real time. To achieve this, we first use a DNN to segment the hand and object in the two input depth streams and predict the current hand pose based on the previous poses by a pre-trained LSTM network. With this information, a unified optimization framework is proposed to jointly track the hand poses and object motions. The optimization integrates the segmented depth maps, the predicted motion, a spatial-temporal varying rigidity regularizer and a real-time contact constraint. A nonrigid fusion technique is further involved to reconstruct the object model. Experiments demonstrate that our method can solve the ambiguity caused by heavy occlusions between hand and object, and generate accurate results for various objects and interacting motions.

Identifying new biomarkers is necessary and important to diagnose and treat malignant lung cancer. However, existing protein marker detection methods usually require complex operation steps, leading to a lag time for diagnosis. Herein, we developed a rapid, minimally invasive, and convenient nucleic acid biomarker recognition method, which enabled the combined specific detection of 11 lung cancer typing markers in a microliter reaction system after only one sampling. The primers for the combined specific detection of 11 lung cancer typing markers were designed and screened, and the microfluidic chip for parallel detection of the multiple markers was designed and developed. Furthermore, a miniaturized microfluidic-based analyzer was also constructed. By developing a microfluidic chip and a miniaturized nucleic acid analyzer, we enabled the detection of the mRNA expression levels of multiple biomarkers in rice-sized tissue samples. The miniaturized nucleic acid analyzer could detect ≥10 copies of nucleic acids. The cell volume of the typing reaction on the microfluidic chip was only 0.94 μL, less than 1/25 of that of the conventional 25-μL Eppendorf tube PCR method, which significantly reduced the testing cost and significantly simplified the analysis of multiple biomarkers in parallel. With a simple injection operation and reverse transcription loop-mediated isothermal amplification (RT-LAMP), real-time detection of 11 lung cancer nucleic acid biomarkers was performed within 45 min. Given these compelling features, 86 clinical samples were tested using the miniaturized nucleic acid analyzer and classified according to the cutoff values of the 11 biomarkers. Furthermore, multi-biomarker analysis was conducted by a machine learning model to classify different subtypes of lung cancer, with an average area under the curve (AUC) of 0.934. This method shows great potential for the identification of new nucleic acid biomarkers and the accurate diagnosis of lung cancer.