NEURO-ONCOLOGY • NOVEMBER 2017 racy, precision, recall, and F1 measure were calculated for the NLP method. RESULTS: The manual review was completed in 27 days; mean discordance rate was 36.2%. The overall accuracy of the best logistic regression classifier was 84.6% on the training data and 82.8% on the hold-out test data. The precision and recall were both 83%, and the F1-score was 0.83. The algorithm required 28.9 minutes for training, after which it is able to classify the entire dataset in a less than 0.2 second. The model was incorporated into a user-friendly interface that allows for future report classification. CONCLUSION: NLP is a powerful method for the high-throughput evaluation of free-text radiology reports that can have high sensitivity and specificity. Use of NLP can accelerate retrospective clinical research with improved accuracy over manual chart review.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.