While Artificial Intelligence (AI) can be a powerful tool that physicians can use to help diagnose their patients and has great potential to improve accuracy, efficiency and patient safety, it has its drawbacks. It may distract doctors, give them too much confidence in the answers it provides, and even lead them to lose confidence in their own diagnostic judgement.
To ensure that AI is properly integrated into healthcare practice, a research team has provided a framework comprising five guiding questions aimed at supporting doctors in their patient care while not undermining their expertise through an over-reliance on AI. The framework was recently published in the peer-reviewed Journal of the American Medical Informatics Association.
This paper moves the discussion from how well the AI algorithm performs to how physicians actually interact with AI during diagnosis. This paper provides a framework that pushes the field beyond ‘Can AI detect disease?’ to ‘How should AI support doctors without undermining their expertise?’ This reframing is an essential step toward safer and more effective adoption of AI in clinical practice.”
Dr. Joann G. Elmore, senior author, professor of medicine in the division of general internal medicine and health services research and Director of the National Clinician Scholars Program at the David Geffen School of Medicine at UCLA
While AI-related errors happen, no one really knows why these tools can fail to improve diagnostic decision-making when implemented into clinical practice.
To find out why, the researchers propose five questions to guide research and development to prevent AI-linked diagnostic errors. The questions to ask are: What type and format of information should AI present? Should it provide that information immediately, after initial review, or be toggled on and off by the physician? How does the AI system show how it arrives at its decisions? How does it affect bias and complacency? And finally, what are the risks of long-term reliance on it?
These questions are important to ask because:
- Format affects doctors’ attention, diagnostic accuracy, and possible interpretive biases
- Immediate information can lead to a biased interpretation while delayed cues may help maintain diagnostic skills by allowing physicians to more fully engage in a diagnosis
- How the AI system arrives at a decision can highlight features that were ruled in or out, provide “what-if” types of explanations, and more effectively align with doctors’ clinical reasoning
- When physicians lean too much on AI, they may rely less on their own critical thinking, letting an accurate diagnosis slip by
- Long-term reliance on AI may erode a doctor’s learned diagnostic abilities
The next steps toward improving AI for diagnostic purposes are to evaluate different designs in clinical settings, study how AI affects trust and decision-making, observe doctors’ skill development when AI is used in training and clinical practice, and develop systems that self-adjust how they assist physicians.
“AI has huge potential to improve diagnostic accuracy, efficiency, and patient safety, but poor integration could make healthcare worse instead of better,” Elmore said. “By highlighting the human factors like timing, trust, over-reliance, and skill erosion, our work emphasizes that AI must be designed to work with doctors, not replace them. This balance is crucial if we want AI to enhance care without introducing new risks.”
Co-authors are Tad Brunyé of Tufts University and Stephen Mitroff of George Washington University.
The research was supported by the National Cancer Institute of the National Institutes of Health (R01 CA288824, R01 CA225585, R01 CA172343, and R01 CA140560).
News
Researchers propose five key questions for effective adoption of AI in clinical practice
While Artificial Intelligence (AI) can be a powerful tool that physicians can use to help diagnose their patients and has great potential to improve accuracy, efficiency and patient safety, it has its drawbacks. It [...]
Advancements and clinical translation of intelligent nanodrugs for breast cancer treatment
A comprehensive review in "Biofunct. Mater." meticulously details the most recent advancements and clinical translation of intelligent nanodrugs for breast cancer treatment. This paper presents an exhaustive overview of subtype-specific nanostrategies, the clinical benefits [...]
It’s Not “All in Your Head”: Scientists Develop Revolutionary Blood Test for Chronic Fatigue Syndrome
A 96% accurate blood test for ME/CFS could transform diagnosis and pave the way for future long COVID detection. Researchers from the University of East Anglia and Oxford Biodynamics have created a highly accurate [...]
How Far Can the Body Go? Scientists Find the Ultimate Limit of Human Endurance
Even the most elite endurance athletes can’t outrun biology. A new study finds that humans hit a metabolic ceiling at about 2.5 times their resting energy burn. When ultra-runners take on races that last [...]
World’s Rivers “Overdosing” on Human Antibiotics, Study Finds
Researchers estimate that approximately 8,500 tons of antibiotics enter river systems each year after passing through the human body and wastewater treatment processes. Rivers spanning millions of kilometers across the globe are contaminated with [...]
Yale Scientists Solve a Century-Old Brain Wave Mystery
Yale scientists traced gamma brain waves to thalamus-cortex interactions. The discovery could reveal how brain rhythms shape perception and disease. For more than a century, scientists have observed rhythmic waves of synchronized neuronal activity [...]
Can introducing peanuts early prevent allergies? Real-world data confirms it helps
New evidence from a large U.S. primary care network shows that early peanut introduction, endorsed in 2015 and 2017 guidelines, was followed by a marked decline in clinician-diagnosed peanut and overall food allergies among [...]
Nanoparticle blueprints reveal path to smarter medicines
Lipid nanoparticles (LNPs) are the delivery vehicles of modern medicine, carrying cancer drugs, gene therapies and vaccines into cells. Until recently, many scientists assumed that all LNPs followed more or less the same blueprint, [...]
How nanomedicine and AI are teaming up to tackle neurodegenerative diseases
When I first realized the scale of the challenge posed by neurodegenerative diseases, such as Alzheimer's, Parkinson's disease and amyotrophic lateral sclerosis (ALS), I felt simultaneously humbled and motivated. These disorders are not caused [...]
Self-Organizing Light Could Transform Computing and Communications
USC engineers have demonstrated a new kind of optical device that lets light organize its own route using the principles of thermodynamics. Instead of relying on switches or digital control, the light finds its own [...]
Groundbreaking New Way of Measuring Blood Pressure Could Save Thousands of Lives
A new method that improves the accuracy of interpreting blood pressure measurements taken at the ankle could be vital for individuals who are unable to have their blood pressure measured on the arm. A newly developed [...]
Scientist tackles key roadblock for AI in drug discovery
The drug development pipeline is a costly and lengthy process. Identifying high-quality "hit" compounds—those with high potency, selectivity, and favorable metabolic properties—at the earliest stages is important for reducing cost and accelerating the path [...]
Nanoplastics with environmental coatings can sneak past the skin’s defenses
Plastic is ubiquitous in the modern world, and it's notorious for taking a long time to completely break down in the environment - if it ever does. But even without breaking down completely, plastic [...]
Chernobyl scientists discover black fungus feeding on deadly radiation
It looks pretty sinister, but it might actually be incredibly helpful When reactor number four in Chernobyl exploded, it triggered the worst nuclear disaster in history, one which the surrounding area still has not [...]
Long COVID Is Taking A Silent Toll On Mental Health, Here’s What Experts Say
Months after recovering from COVID-19, many people continue to feel unwell. They speak of exhaustion that doesn’t fade, difficulty breathing, or an unsettling mental haze. What’s becoming increasingly clear is that recovery from the [...]
Study Delivers Cancer Drugs Directly to the Tumor Nucleus
A new peptide-based nanotube treatment sneaks chemo into drug-resistant cancer cells, providing a unique workaround to one of oncology’s toughest hurdles. CiQUS researchers have developed a novel molecular strategy that allows a chemotherapy drug to [...]
