Can AI Boost Accuracy of Doctors' Diagnoses?

Follow Drugslib on

Medically reviewed by Carmen Pope, BPharm. Last updated on Nov 15, 2024.

By Dennis Thompson HealthDay Reporter

FRIDAY, Nov. 15, 2024 -- AI can’t yet help doctors improve their ability to diagnose complex conditions, a sobering new study has found.

Doctors had about the same diagnostic accuracy whether or not they were using ChatGPT Plus, according to results published recently in the journal JAMA Network Open.

However, the AI outperformed doctors when allowed to diagnose on its own, the researchers noted.

“Our study shows that AI alone can be an effective and powerful tool for diagnosis,” said researcher Dr. Andrew Parsons, who oversees the teaching of clinical skills to medical students at the University of Virginia School of Medicine.

“We were surprised to find that adding a human physician to the mix actually reduced diagnostic accuracy though improved efficiency,” Parsons said. “These results likely mean that we need formal training in how best to use AI.”

For the study, researchers provided 50 doctors with case studies based on real-life patients. These cases included details about medical history, physical exams and lab test results.

The doctors were randomly assigned to two groups -- one that diagnosed the patients’ conditions based solely on the info available and standard reference materials, and another that used ChatGPT Plus to help inform their diagnosis.

Doctors using ChatGPT returned an accurate diagnosis about 76% of the time, compared with about 74% for those not aided by AI, results show.

The ChatGPT group did come to their diagnoses slightly faster -- about 8.6 minutes compared to 9.4 minutes for those without AI help, researchers found.

When ChatGPT Plus was given the case studies on its own, it achieved an accuracy of more than 92%.

However, researchers caution that the AI would likely fare less well in real life, when diagnosing patients on the fly versus evaluating case studies.

More study is needed to assess the ability of AI to diagnose medical problems, particularly in terms of the downstream effects of diagnoses and the treatment decisions that result from them, researchers said.

“As AI becomes more embedded in healthcare, it's essential to understand how we can leverage these tools to improve patient care and the physician experience,” Parsons said. “This study suggests there is much work to be done in terms of optimizing our partnership with AI in the clinical environment.”

Sources

  • University of Virginia, news release, Nov. 13, 2024

    • Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.

    Source: HealthDay

    Posted : 2024-11-16 06:00

    Read more

    Disclaimer

    Every effort has been made to ensure that the information provided by Drugslib.com is accurate, up-to-date, and complete, but no guarantee is made to that effect. Drug information contained herein may be time sensitive. Drugslib.com information has been compiled for use by healthcare practitioners and consumers in the United States and therefore Drugslib.com does not warrant that uses outside of the United States are appropriate, unless specifically indicated otherwise. Drugslib.com's drug information does not endorse drugs, diagnose patients or recommend therapy. Drugslib.com's drug information is an informational resource designed to assist licensed healthcare practitioners in caring for their patients and/or to serve consumers viewing this service as a supplement to, and not a substitute for, the expertise, skill, knowledge and judgment of healthcare practitioners.

    The absence of a warning for a given drug or drug combination in no way should be construed to indicate that the drug or drug combination is safe, effective or appropriate for any given patient. Drugslib.com does not assume any responsibility for any aspect of healthcare administered with the aid of information Drugslib.com provides. The information contained herein is not intended to cover all possible uses, directions, precautions, warnings, drug interactions, allergic reactions, or adverse effects. If you have questions about the drugs you are taking, check with your doctor, nurse or pharmacist.

    Popular Keywords