Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

In a correspondence to Nature Medicine, a team of Oxford-led academics describe upcoming new guidelines to improve the reporting of early clinical stage (or first-with-human) evaluation of decision support systems driven by artificial intelligence.

Red light with silhouette of a man

As an increasing number of clinical decision-support systems driven by artificial intelligence progress from development to implementation, better guidance on the reporting of human factors (ergonomics) and early-stage clinical evaluation is needed.

Therefore, Dr Baptiste Vasey and Professor Peter McCulloch from the Nuffield Department of Surgical Sciences, together with a steering group of experts in the fields of machine learning, human factors, and guidelines development from Oxford University and other universities in the UK and abroad, aim to develop new guidelines to improve the reporting of the early-stage clinical evaluation of AI-based decision support systems.

“We are convinced that human clinicians should and will remain at the centre of patient care, and therefore aiming to improve the way in which AI-based clinical decision support systems are evaluated when used to enhance rather than replace human intelligence. A critical phase of this process is when such systems are assessed when first used by clinicians in real life settings,” says Dr Vasey.

The article outlines a Delphi process, comprising two rounds of experts’ feedback and one consensus meeting, and the rationale for the new Developmental and Exploratory Clinical Investigation of Decision support systems based on Artificial Intelligence (DECIDE-AI) guidelines being developed. The authors hope to address some of the important issues hindering the translation from in silico algorithm development to clinical impact.

Read the full story on the Nuffield Department of Surgical Sciences website