Doctors experimenting with AI tools to help diagnose patients is nothing new. But getting them to trust the AIs they’re using is another matter entirely.
To establish that trust, researchers at Cornell University attempted to create a more transparent AI system that works by counseling doctors in the same way a human colleague would — that is, arguing over what the medical literature says.
Their resulting study, which will be presented at the Association for Computing Machinery Conference on Human Factors in Computing Systems later this month, found that how a medical AI works isn’t nearly as important to earning a doctor’s trust as the sources it cites in its suggestions.
“A doctor’s primary job is not to learn how AI works,” said Qian Yang, an assistant professor of information science at Cornell who led the study, in a press release. “If we can build systems that help validate AI suggestions based on clinical trial results and journal articles, which are trustworthy information for doctors, then we can help them understand whether the AI is likely to be right or wrong for each specific case.”
“We built a system that basically tries to recreate the interpersonal communication that we observed when the doctors give suggestions to each other, and fetches the same kind of evidence from clinical literature to support the AI’s suggestion,” Yang said.
The AI tool Yang’s team created is based on GPT-3, an older large language model that once powered OpenAI’s ChatGPT. The tool’s interface is fairly straightforward: on one side, it provides the AI’s suggestions. The other side contrasts this with relevant biomedical literature the AI gleaned, plus brief summaries of each study and other helpful nuggets of information like patient outcomes.
So far, the team has developed their tool with three different medical specializations: neurology, psychiatry, and palliative care. When the doctors tried the versions tailored to their respective field, they told the researchers that they liked the presentation of the medical literature, and affirmed they preferred it to an explanation of how the AI worked.
Either way, this specialized AI seems to be faring better than ChatGPT’s attempt of playing the doctor in a larger study, which found that 60 percent of its answers to real medical scenarios disagreed with human experts’ opinions or were too irrelevant to be helpful.
But the jury is still out on how the Cornell researchers’ AI would hold up when subjected to a similar analysis.
Overall, it’s worth noting that while these tools may be helpful to doctors who have years of expertise to inform their decisions, we’re still a very long way out from an “AI medical advisor” that can replace them.
News
New Research Reveals That Your Sense of Smell May Be Smarter Than You Think
A new study published in the Journal of Neuroscience indicates that the sense of smell is significantly influenced by cues from other senses, whereas the senses of sight and hearing are much less affected. A popular [...]
Deadly bacteria show thirst for human blood: the phenomenon of bacterial vampirism
Some of the world's deadliest bacteria seek out and feed on human blood, a newly-discovered phenomenon researchers are calling "bacterial vampirism." A team led by Washington State University researchers has found the bacteria are [...]
Organ Architects: The Remarkable Cells Shaping Our Development
Finding your way through the winding streets of certain cities can be a real challenge without a map. To orient ourselves, we rely on a variety of information, including digital maps on our phones, [...]
Novel hydrogel removes microplastics from water
Microplastics pose a great threat to human health. These tiny plastic debris can enter our bodies through the water we drink and increase the risk of illnesses. They are also an environmental hazard; found [...]
Researchers Discover New Origin of Deep Brain Waves
Understanding hippocampal activity could improve sleep and cognition therapies. Researchers from the University of California, Irvine’s biomedical engineering department have discovered a new origin for two essential brain waves—slow waves and sleep spindles—that are critical for [...]
The Lifelong Cost of Surviving COVID: Scientists Uncover Long-Term Effects
Many of the individuals released to long-term acute care facilities suffered from conditions that lasted for over a year. Researchers at UC San Francisco studied COVID-19 patients in the United States who survived some of the longest and [...]
Previously Unknown Rogue Immune Key to Chronic Viral Infections Discovered
Scientists discovered a previously unidentified rogue immune cell linked to poor antibody responses in chronic viral infections. Australian researchers have discovered a previously unknown rogue immune cell that can cause poor antibody responses in [...]
Nature’s Betrayal: Unmasking Lead Lurking in Herbal Medicine
A case of lead poisoning due to Ayurvedic medicine use demonstrates the importance of patient history in diagnosis and the need for public health collaboration to prevent similar risks. An article in CMAJ (Canadian Medical Association [...]
Frozen in Time: How a DNA Anomaly Misled Scientists for Centuries
An enormous meteor spelled doom for most dinosaurs 65 million years ago. But not all. In the aftermath of the extinction event, birds — technically dinosaurs themselves — flourished. Scientists have spent centuries trying [...]
‘Mini kidneys’ reveal new insights into metabolic defects in polycystic kidney disease
Scientists at Nanyang Technological University, Singapore (NTU Singapore) have successfully grown 'mini kidneys' in the lab and grafted them into live mice, revealing new insights into the metabolic defects and a potential therapy for [...]
Decoding the Origin of Life: Scientists Solve Early Earth RNA Puzzle
Recent research illustrates how RNA molecules’ chemical characteristics might have played a crucial role in the development of complex life forms. How did complex life manage to evolve on the early, inhospitable Earth? Initially, [...]
Improving infectious disease testing with gold nanoparticles
By harnessing the power of composite polymer particles adorned with gold nanoparticles, a group of researchers have delivered a more accurate means of testing for infectious diseases. Details of their research was published in the [...]
New micromaterial releases nanoparticles that selectively destroy cancer cells
Researchers have developed micromaterials made up only of proteins, capable of delivering over an extended period of time nanoparticles that attack specific cancer cells and destroy them. The micromaterials mimic natural secretory granules found [...]
Alzheimer’s Breakthrough: Scientists Make Revolutionary Leap
Dementia is a major health issue worldwide in the 21st century, impacting over 50 million people globally. This figure is expected to soar to 152 million by 2050, as the global population ages. Alzheimer’s disease (AD) [...]
How small RNA molecules regulate viral infections of bacteria
Viruses need hosts. Whether it's measles, the flu or coronavirus, viral pathogens cannot multiply or infect other organisms without the assistance of their hosts' cellular infrastructure. However, humans are not the only ones affected [...]
Computer scientists discover gap in the latest security mechanisms used by some chips
Over the past few years, hardware manufacturers have developed technologies that ought to make it possible for companies and governmental organizations to process sensitive data securely using shared cloud computing resources. Known as confidential [...]