Mass Deployment of Deep Neural Network: Real-Time Proof of Concept With Screening of Intracranial Hemorrhage Using an Open Data Set

Source abstract

BACKGROUND: Intracranial hemorrhage (ICH) is considered an emergency that requires rapid medical or surgical management. Previous studies have used artificial intelligence to attempt to expedite the diagnosis of this pathology on neuroimaging. However, these studies have used local, institution-specific data for training of networks that limit deployment of across broader hospital networks or regions because of data biases. OBJECTIVE: To demonstrate the creation of a neural network based on an openly available imaging data tested on data from our institution demonstrating a high-efficacy, institution-agnostic network. METHODS: A data set was created from publicly available noncontrast computed tomography images of known ICH. These data were used to train a neural network using distinct windowing and augmentation. This network was then validated in 2 phases using cohort-based (phase 1) and longitudinal (phase 2) approaches. RESULTS: Our convolutional neural network was trained on 752 807 openly available slices, which included 112 762 slices containing intracranial hemorrhage. In phase 1, the final network performance for intracranial hemorrhage showed a receiver operating characteristic curve (AUC) of 0.99. At the inflection point, our model showed a sensitivity of 98% at a threshold specificity of 99%. In phase 2, we obtained an AUC of 0.98 after analysis of 726 scans with a negative predictive value of 99.70% (n = 726). CONCLUSION: We demonstrate an effective neural network trained on completely open data for screening ICH at an unrelated institution. This study demonstrates a proof of concept for screening networks for multiple sites while maintaining high efficacy.