Artificial Intelligence Models Improve Clinicians' Diagnostic Accuracy

Follow Drugslib on

Medically reviewed by Carmen Pope, BPharm. Last updated on Dec 19, 2023.

By Elana Gotkine HealthDay Reporter

TUESDAY, Dec. 19, 2023 -- Standard artificial intelligence (AI) models improve diagnostic accuracy, but systematically biased AI models reduce this accuracy, according to a study published in the Dec. 19 issue of the Journal of the American Medical Association.

Sarah Jabbour, from the University of Michigan in Ann Arbor, and colleagues examined the impact of systematically biased AI on clinician diagnostic accuracy in a randomized clinical vignette survey study. Clinicians were shown nine clinical vignettes of patients hospitalized with acute respiratory failure and were asked to determine the likelihood of pneumonia, heart failure, or chronic obstructive pulmonary disease as the underlying cause. Clinicians were shown two vignettes without AI model input to establish baseline diagnostic accuracy and were then randomly assigned to see six vignettes with AI model input: three standard-model predictions and three systematically biased model predictions.

Overall, 457 clinicians were randomly assigned: 231 and 226 to AI model predictions without and with explanations, respectively. The researchers found that for the three diagnoses, clinicians' baseline diagnostic accuracy was 73.0 percent. Clinician accuracy increased over baseline by 2.9 and 4.4 percentage points when shown a standard AI model without and with explanations. Clinician accuracy was reduced by 11.3 percentage points with systematically biased AI model predictions compared with baseline; providing biased AI model predictions with explanations reduced accuracy by 9.1 percentage points, representing a nonsignificant improvement of 2.3 percentage points compared with the systematically biased model.

"Although the findings of the study suggest that clinicians may not be able to serve as a backstop against flawed AI, they can play an essential role in understanding AI's limitations," the authors write.

One author reported receiving royalties from a patent from Airstrip.

Abstract/Full Text (subscription or payment may be required)

Editorial (subscription or payment may be required)

Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.

Source: HealthDay

Posted : 2023-12-20 02:15

Read more

Disclaimer

Every effort has been made to ensure that the information provided by Drugslib.com is accurate, up-to-date, and complete, but no guarantee is made to that effect. Drug information contained herein may be time sensitive. Drugslib.com information has been compiled for use by healthcare practitioners and consumers in the United States and therefore Drugslib.com does not warrant that uses outside of the United States are appropriate, unless specifically indicated otherwise. Drugslib.com's drug information does not endorse drugs, diagnose patients or recommend therapy. Drugslib.com's drug information is an informational resource designed to assist licensed healthcare practitioners in caring for their patients and/or to serve consumers viewing this service as a supplement to, and not a substitute for, the expertise, skill, knowledge and judgment of healthcare practitioners.

The absence of a warning for a given drug or drug combination in no way should be construed to indicate that the drug or drug combination is safe, effective or appropriate for any given patient. Drugslib.com does not assume any responsibility for any aspect of healthcare administered with the aid of information Drugslib.com provides. The information contained herein is not intended to cover all possible uses, directions, precautions, warnings, drug interactions, allergic reactions, or adverse effects. If you have questions about the drugs you are taking, check with your doctor, nurse or pharmacist.

Popular Keywords