NeSy Conference 2023 Conference Paper
Implementing Trustworthy AI in Real-world Medical Imaging using the SimpleMind Software Environment
- Matthew S. Brown
- M. Wasil Wahi-Anwar
- Youngwon Choi
- Morgan Daly
- Liza Shrestha
- Koon-Pong Wong
- Jonathan G. Goldin
- Dieter R. Enzmann
Deep neural networks (DNNs) have good overall performance in medical imaging, but they are susceptible to obvious mistakes that violate common sense concepts. Unexplained errors have reduced trust and prevented widespread adoption in real-world clinical practice. We introduce SimpleMind, an open-source Cognitive AI software environment for medical image understanding. It uses a hybrid Neurosymbolic AI approach that integrates both DNNs and machine reasoning from a knowledge base. We demonstrate its use in building trustworthy AI for checking endotracheal tube (ETT) placement on chest X-rays (CXRs). The AI was integrated into clinical practice and the correctness of the ETT misplacement alerts were compared with radiology reports as the reference. 214 CXRs were ordered by ICU physicians to check ETT placement with AI assistance. ETT alert messages had a positive predictive value (PPV) of 42% and a negative predictive value (NPV) of 98%. Physicians indicated that they agreed with the AI outputs, had increased confidence in their decisions, and were more effective with AI assistance.