Human factors challenges for the safe use of artificial intelligence in patient care

M Sujan, Dominic Furniss, K Grundy, H Grundy, D Nelson, M Elliott, S White, I Habli, N Reynolds
in BMJ Health and Care Informatics, Journal article

Abstract

© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. The use of artificial intelligence (AI) in patient care can offer significant benefits. However, there is a lack of independent evaluation considering AI in use. The paper argues that consideration should be given to how AI will be incorporated into clinical processes and services. Human factors challenges that are likely to arise at this level include cognitive aspects (automation bias and human performance), handover and communication between clinicians and AI systems, situation awareness and the impact on the interaction with patients. Human factors research should accompany the development of AI from the outset.