AI Screens Patients for Clinical Trials With Greater Accuracy Than Staff

Follow Drugslib on

Medically reviewed by Carmen Pope, BPharm. Last updated on June 20, 2024.

By Lori Solomon HealthDay Reporter

THURSDAY, June 20, 2024 -- Large language model-based solutions can enhance clinical trial screening performance and reduce costs by automating the screening process, according to a study published online June 17 in NEJM AI.

Ozan Unlu, M.D., from Brigham and Women's Hospital in Boston, and colleagues evaluated the utility of a Retrieval-Augmented Generation (RAG)-enabled GPT-4 system to improve the accuracy, efficiency, and reliability of screening for a trial involving patients with symptomatic heart failure. Findings were based on clinical notes from 100, 282, and 1,894 patients for development, validation, and test datasets, respectively.

The researchers reported that answers from the RAG-Enabled Clinical Trial Infrastructure for Inclusion Exclusion Review (RECTIFIER), a clinical note-based, question-answering system powered by RAG and GPT-4, closely aligned with the expert clinicians' answers across the target criteria, with accuracy ranging from 97.9 to 100 percent (Matthews correlation coefficient [MCC], 0.837 and 1) for RECTIFIER versus 91.7 and 100 percent (MCC, 0.644 and 1) for the study staff. Compared with study staff, RECTIFIER performed better at determining symptomatic heart failure (accuracy 91.7 and 97.9 percent, respectively; MCC, 0.721 and 0.924). With RECTIFIER, the sensitivity and specificity for determining patient eligibility were 92.3 and 93.9 percent, respectively, versus 90.1 and 83.6 percent, respectively, for the study staff. The single-question approach to determining eligibility with RECTIFIER resulted in an average cost of 11 cents per patient, and the combined-question approach resulted in an average cost of 2 cents per patient.

"Integrating such technologies requires careful consideration of potential hazards and should include safeguards such as final clinician review," the authors write.

Several authors disclosed ties to the pharmaceutical industry.

Abstract/Full Text

Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.

Source: HealthDay

Posted : 2024-06-21 05:15

Read more

Disclaimer

Every effort has been made to ensure that the information provided by Drugslib.com is accurate, up-to-date, and complete, but no guarantee is made to that effect. Drug information contained herein may be time sensitive. Drugslib.com information has been compiled for use by healthcare practitioners and consumers in the United States and therefore Drugslib.com does not warrant that uses outside of the United States are appropriate, unless specifically indicated otherwise. Drugslib.com's drug information does not endorse drugs, diagnose patients or recommend therapy. Drugslib.com's drug information is an informational resource designed to assist licensed healthcare practitioners in caring for their patients and/or to serve consumers viewing this service as a supplement to, and not a substitute for, the expertise, skill, knowledge and judgment of healthcare practitioners.

The absence of a warning for a given drug or drug combination in no way should be construed to indicate that the drug or drug combination is safe, effective or appropriate for any given patient. Drugslib.com does not assume any responsibility for any aspect of healthcare administered with the aid of information Drugslib.com provides. The information contained herein is not intended to cover all possible uses, directions, precautions, warnings, drug interactions, allergic reactions, or adverse effects. If you have questions about the drugs you are taking, check with your doctor, nurse or pharmacist.

Popular Keywords