AI Can Identify Guardian Authorship of Messages in Teen Patient Portal

Follow Drugslib on

Medically reviewed by Drugs.com.

By Elana Gotkine HealthDay Reporter

FRIDAY, June 28, 2024 -- Large language model (LLM)-based classifiers can accurately detect guardian authorship of messages sent from an adolescent patient portal, according to a research letter published online June 25 in JAMA Network Open.

April S. Liang, M.D., from the Stanford University School of Medicine in Palo Alto, California, and colleagues examined the ability of a LLM to detect guardian authorship of messages originating from adolescent patient portals. Messages from adolescent patient portal accounts at Stanford Children's Health were sampled and manually reviewed for authorship. Two prompts were iteratively engineered on a random subset of 20 messages until perfect performance was achieved: one focusing on authorship identification (single task) and one that generated response to the message and identified authorship (multitask). Both prompts were tested on remaining messages.

Of the 2,088 test messages, 71.8 and 28.2 percent were labeled as parent- or guardian-authored and patient-authored, respectively. The researchers found that the single-task LLM achieved sensitivity and specificity of 98.1 and 88.4 percent, respectively, while the multitask LLM achieved sensitivity and specificity of 98.3 and 88.9 percent, respectively. This corresponded to a positive predictive value and negative predictive value above 95 percent for multitask LLM. Statistically identical performance was seen for the single-task and multitask classifiers.

"Ultimately, reliable identification of nonpatient-authored messages has implications beyond adolescent medicine. Among adults, care partners commonly access patient portals using the patient's credentials, especially relevant for geriatric patients or individuals with developmental differences," the authors write. "Our results found that this study's LLM has potential in improving safeguards for patient confidentiality."

One author disclosed ties to nference.

Abstract/Full Text

Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.

Source: HealthDay

Posted : 2024-06-29 07:15

Read more

Disclaimer

Every effort has been made to ensure that the information provided by Drugslib.com is accurate, up-to-date, and complete, but no guarantee is made to that effect. Drug information contained herein may be time sensitive. Drugslib.com information has been compiled for use by healthcare practitioners and consumers in the United States and therefore Drugslib.com does not warrant that uses outside of the United States are appropriate, unless specifically indicated otherwise. Drugslib.com's drug information does not endorse drugs, diagnose patients or recommend therapy. Drugslib.com's drug information is an informational resource designed to assist licensed healthcare practitioners in caring for their patients and/or to serve consumers viewing this service as a supplement to, and not a substitute for, the expertise, skill, knowledge and judgment of healthcare practitioners.

The absence of a warning for a given drug or drug combination in no way should be construed to indicate that the drug or drug combination is safe, effective or appropriate for any given patient. Drugslib.com does not assume any responsibility for any aspect of healthcare administered with the aid of information Drugslib.com provides. The information contained herein is not intended to cover all possible uses, directions, precautions, warnings, drug interactions, allergic reactions, or adverse effects. If you have questions about the drugs you are taking, check with your doctor, nurse or pharmacist.

Popular Keywords