While Artificial Intelligence (AI) can be a powerful tool that physicians can use to help diagnose their patients and has great potential to improve accuracy, efficiency and patient safety, it has its drawbacks. It may distract doctors, give them too much confidence in the answers it provides, and even lead them to lose confidence in their own diagnostic judgement.
To ensure that AI is properly integrated into healthcare practice, a research team has provided a framework comprising five guiding questions aimed at supporting doctors in their patient care while not undermining their expertise through an over-reliance on AI. The framework was recently published in the peer-reviewed Journal of the American Medical Informatics Association.
This paper moves the discussion from how well the AI algorithm performs to how physicians actually interact with AI during diagnosis. This paper provides a framework that pushes the field beyond ‘Can AI detect disease?’ to ‘How should AI support doctors without undermining their expertise?’ This reframing is an essential step toward safer and more effective adoption of AI in clinical practice.”
Dr. Joann G. Elmore, senior author, professor of medicine in the division of general internal medicine and health services research and Director of the National Clinician Scholars Program at the David Geffen School of Medicine at UCLA
While AI-related errors happen, no one really knows why these tools can fail to improve diagnostic decision-making when implemented into clinical practice.
To find out why, the researchers propose five questions to guide research and development to prevent AI-linked diagnostic errors. The questions to ask are: What type and format of information should AI present? Should it provide that information immediately, after initial review, or be toggled on and off by the physician? How does the AI system show how it arrives at its decisions? How does it affect bias and complacency? And finally, what are the risks of long-term reliance on it?
These questions are important to ask because:
- Format affects doctors’ attention, diagnostic accuracy, and possible interpretive biases
- Immediate information can lead to a biased interpretation while delayed cues may help maintain diagnostic skills by allowing physicians to more fully engage in a diagnosis
- How the AI system arrives at a decision can highlight features that were ruled in or out, provide “what-if” types of explanations, and more effectively align with doctors’ clinical reasoning
- When physicians lean too much on AI, they may rely less on their own critical thinking, letting an accurate diagnosis slip by
- Long-term reliance on AI may erode a doctor’s learned diagnostic abilities
The next steps toward improving AI for diagnostic purposes are to evaluate different designs in clinical settings, study how AI affects trust and decision-making, observe doctors’ skill development when AI is used in training and clinical practice, and develop systems that self-adjust how they assist physicians.
“AI has huge potential to improve diagnostic accuracy, efficiency, and patient safety, but poor integration could make healthcare worse instead of better,” Elmore said. “By highlighting the human factors like timing, trust, over-reliance, and skill erosion, our work emphasizes that AI must be designed to work with doctors, not replace them. This balance is crucial if we want AI to enhance care without introducing new risks.”
Co-authors are Tad Brunyé of Tufts University and Stephen Mitroff of George Washington University.
The research was supported by the National Cancer Institute of the National Institutes of Health (R01 CA288824, R01 CA225585, R01 CA172343, and R01 CA140560).
News
A Hidden DNA Mechanism Could Explain How 20% of Human Cancers Develop
Researchers have identified an unexpected molecular vulnerability in cancers carrying BAF mutations. Mutations found in roughly 20% of human cancers may promote tumor growth by changing how DNA is organized inside cells. Researchers have [...]
Ebola kills over 5,300 in fastest-growing outbreak on record
Africa’s latest Ebola outbreak has killed nearly 5,400 people, the vast majority of them in the Democratic Republic of Congo (DRC), according to the continent’s top health agency. Africa Centres for Disease Control and [...]
China makes early progress in using sound waves to stimulate damaged brains
Chinese researchers are testing whether focused ultrasound can help restore consciousness in patients with severe brain injuries, adding to a growing international effort to use sound waves to stimulate deep brain structures without surgery. [...]
Micro-drones fly through the body thanks to ultrasound
At the EPFL, micro-drones have been developed that can be moved without a motor or battery.No motors, no batteries, no electronics on board, just small cavities that convert sound waves into thrust: this is [...]
A Single Enzyme Could Hold the Key to Treating a Devastating Brain Disorder
Blocking an enzyme’s production restored brain growth and healthy behaviors in mice engineered to develop Angelman syndrome, pointing to a possible treatment target. Children with Angelman syndrome begin to show difficulties with thinking and [...]
Scientists Develop a Clever New Way To Kill Cancer Cells From the Inside
Scientists have developed an experimental strategy that exploits a chemical byproduct of cancer cells to produce anticancer drugs directly inside them. Scientists in Japan have developed an experimental method that uses a chemical produced [...]
Our books are available worldwide!
Online Sellers other than Amazon, Routledge, and IOPP Indigo Global Health Care Equivalency in the Age of Nanotechnology, Nanomedicine and Artifcial Intelligence Global Health Care Equivalency In The Age Of Nanotechnology, Nanomedicine And Artificial [...]
After only a short training, people in a coma managed to send targeted signals
Researchers have succeeded in communicating with brain-injured patients who are unconscious. They see enormous potential in this for future treatments. Patients who lie motionless in bed after a severe brain injury and do not [...]
MIT Scientists Reprogram Immune Cells Inside the Body To Destroy Cancer
Natural killer cells reprogrammed inside mice eliminated lymphoma tumors and helped damaged livers heal, though whether this approach could help people with cancer or autoimmune disease remains unknown. To make a cancer treatment from [...]
Melanoma mRNA Vaccine Shows Promise in Preventing Disease Recurrence
Key takeaways: Phase 3 trial finds personalized intismeran plus pembrolizumab may better prevent high-risk melanoma recurrence after surgery The trial enrolled 1,137 patients and builds on phase 2 results showing about half the recurrence [...]
Scientists Discover a Powerful New Weapon Against a Dangerous Gut Infection
The promise of an experimental treatment for C. difficile gut infections lies partly in the bacteria it leaves alive, according to early laboratory and mouse research. Broad-spectrum antibiotics can disrupt the gut’s microbial community, [...]
Your Bones May Hold a Hidden Clue to Blood Cancer Survival
For people with blood cancers called myelodysplastic syndromes, osteoporosis may hold an overlooked clue to survival, a three-year observational study suggests. In blood cancers that develop in the bone marrow, an important clue to [...]
Researchers Discover What Reading for Pleasure May Be Doing to Your Brain
Reading for pleasure may offer surprising benefits for the brain, with research linking the habit to better mental health, stronger cognitive abilities, and a lower risk of dementia. Reading for pleasure may do far [...]
Scientists Discover a Hidden Trigger That Keeps Inflammation Alive
Inflammation persists after proteins detach from immune receptors, revealing a potential target for autoimmune treatments. Since a Nobel Prize-winning discovery in the 1990s identified molecules called Toll-like Receptors as the guardians of the human [...]
A Virus Gives Itself Away the Moment It Attacks
Researchers have found the trigger behind a powerful bacterial defense against viruses. Viruses that prey on bacteria could become an increasingly important tool for treating bacterial infections, particularly as antibiotic resistance makes some infections [...]
Scientists Discover Aspirin May Slash Dementia Risk by 70% – but Only for Certain People
Aspirin was linked to a sharply lower dementia risk in some older adults, and their genes may hold the clue. A Monash University analysis found that older adults with a particular genetic profile had [...]
