What happens in the human brain when we learn from positive and negative experiences? To help answer that question and better understand decision-making and human behavior, scientists are studying dopamine.
Now, a new study from researchers at Wake Forest University School of Medicine published Dec. 1 in Science Advances shows that dopamine release in the human brain plays a crucial role in encoding both reward and punishment prediction errors. This means that dopamine is involved in the process of learning from both positive and negative experiences, allowing the brain to adjust and adapt its behavior based on the outcomes of these experiences.
"Previously, research has shown that dopamine plays an important role in how animals learn from 'rewarding' (and possibly 'punishing') experiences. But, little work has been done to directly assess what dopamine does on fast timescales in the human brain," said Kenneth T. Kishida, Ph.D., associate professor of physiology and pharmacology and neurosurgery at Wake Forest University School of Medicine.
"This is the first study in humans to examine how dopamine encodes rewards and punishments and whether dopamine reflects an 'optimal' teaching signal that is used in today's most advanced artificial intelligence research."
For the study, researchers on Kishida's team utilized fast-scan cyclic voltammetry, an electrochemical technique, paired with machine learning, to detect and measure dopamine levels in real-time (i.e., 10 measurements per second). However, this method is challenging and can only be performed during invasive procedures such as deep-brain stimulation (DBS) brain surgery. DBS is commonly employed to treat conditions such as Parkinson's disease, essential tremor, obsessive-compulsive disorder and epilepsy.
Kishida's team collaborated with Atrium Health Wake Forest Baptist neurosurgeons Stephen B. Tatter, M.D., and Adrian W. Laxton, M.D., who are also both faculty members in the Department of Neurosurgery at Wake Forest University School of Medicine, to insert a carbon fiber microelectrode deep into the brain of three participants at Atrium Health Wake Forest Baptist Medical Center who were scheduled to receive DBS to treat essential tremor.
While the participants were awake in the operating room, they played a simple computer game. As they played the game, dopamine measurements were taken in the striatum, a part of the brain that is important for cognition, decision-making, and coordinated movements.
During the game, participants' choices were either rewarded or punished with real monetary gains or losses. The game was divided into three stages in which participants learned from positive or negative feedback to make choices that maximized rewards and minimized penalties. Dopamine levels were measured continuously, once every 100 milliseconds, throughout each of the three stages of the game.
"We found that dopamine not only plays a role in signaling both positive and negative experiences in the brain, but it seems to do so in a way that is optimal when trying to learn from those outcomes. What was also interesting, is that it seems like there may be independent pathways in the brain that separately engage the dopamine system for rewarding versus punishing experiences. Our results reveal a surprising result that these two pathways may encode rewarding and punishing experiences on slightly shifted timescales separated by only 200 to 400 milliseconds in time," Kishida said.
Kishida believes that this level of understanding may lead to a better understanding of how the dopamine system is affected in humans with psychiatric and neurological disorders. Kishida said additional research is needed to understand how dopamine signaling is altered in psychiatric and neurological disorders.
"Traditionally, dopamine is often referred to as 'the pleasure neurotransmitter,"' Kishida said. "However, our work provides evidence that this is not the way to think about dopamine. Instead, dopamine is a crucial part of a sophisticated system that teaches our brain and guides our behavior. That dopamine is also involved in teaching our brain about punishing experiences is an important discovery and may provide new directions in research to help us better understand the mechanisms underlying depression, addiction, and related psychiatric and neurological disorders."
More information: Paul Sands et al, Sub-second fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans, Science Advances (2023). DOI: 10.1126/sciadv.adi4927. www.science.org/doi/10.1126/sciadv.adi4927
News
Nanomotors: Where Are They Now?
First introduced in 2004, nanomotors have steadily advanced from a scientific curiosity to a practical technology with wide-ranging applications. This article explores the key developments, recent innovations, and major uses of nanomotors today. A [...]
Study Finds 95% of Tested Beers Contain Toxic “Forever Chemicals”
Researchers found PFAS in 95% of tested beers, with the highest levels linked to contaminated local water sources. Per- and polyfluoroalkyl substances (PFAS), better known as forever chemicals, are gaining notoriety for their ability [...]
Long COVID Symptoms Are Closer To A Stroke Or Parkinson’s Disease Than Fatigue
When most people get sick with COVID-19 today, they think of it as a brief illness, similar to a cold. However, for a large number of people, the illness doesn't end there. The World [...]
The world’s first AI Hospital, developed in China is transforming healthcare
Artificial Intelligence and its developments have had a revolutionary impact on society, and healthcare is not an exception. China has made massive strides in AI integrated healthcare, and continues to do so as AI [...]
Scientists Rewire Immune Cells To Supercharge Cancer-Fighting Power
Blocking a single protein boosts T cell metabolism and tumor-fighting strength. The discovery could lead to next-generation cancer immunotherapies. Scientists have identified a strategy to greatly enhance the cancer-fighting abilities of the immune system’s [...]
Scientists Discover 20 Percent of Human DNA Comes from a Mysterious Ancestor
Humans carry a complex genetic history that continues to reveal surprises. Scientists have found that 20% of our DNA may come from a mysterious ancestor, according to WP Tech. This discovery changes how we understand [...]
AI detects early prostate cancer missed by pathologists
Men assessed as healthy after a pathologist analyses their tissue sample may still have an early form of prostate cancer. Using AI, researchers at Uppsala University have been able to find subtle tissue changes [...]
The Rare Mutation That Makes People Immune to Viruses
Some people carry a rare mutation that makes them resistant to viruses. Now scientists have copied that effect with an experimental mRNA therapy that stopped both flu and COVID in animal trials — raising [...]
Nanopore technique for measuring DNA damage could improve cancer therapy and radiological emergency response
Scientists at the National Institute of Standards and Technology (NIST) have developed a new technology for measuring how radiation damages DNA molecules. This novel technique, which passes DNA through tiny openings called nanopores, detects [...]
AI Tool Shows Exactly When Genes Turn On and Off
Summary: Researchers have developed an AI-powered tool called chronODE that models how genes turn on and off during brain development. By combining mathematics, machine learning, and genomic data, the method identifies exact “switching points” that [...]
Your brain could get bigger – not smaller – as you age
recently asked myself if I’ll still have a healthy brain as I get older. I hold a professorship at a neurology department. Nevertheless, it is difficult for me to judge if a particular brain, [...]
Hidden Cost of Smart AI: 50× More CO₂ for a Single Question
Every time we ask an AI a question, it doesn’t just return an answer—it also burns energy and emits carbon dioxide. German researchers found that some “thinking” AI models, which generate long, step-by-step reasoning [...]
Genetically-engineered immune cells show promise for preventing organ rejection
A Medical University of South Carolina team reports in Frontiers in Immunology that it has engineered a new type of genetically modified immune cell that can precisely target and neutralize antibody-producing cells complicit in organ rejection. [...]
Building and breaking plastics with light: Chemists rethink plastic recycling
What if recycling plastics were as simple as flicking a switch? At TU/e, Assistant Professor Fabian Eisenreich is making that vision a reality by using LED light to both create and break down a [...]
Generative AI Designs Novel Antibiotics That Defeat Defiant Drug-Resistant Superbugs
Harnessing generative AI, MIT scientists have created groundbreaking antibiotics with unique membrane-targeting mechanisms, offering fresh hope against two of the world’s most formidable drug-resistant pathogens. With the help of artificial intelligence, MIT researchers have [...]
AI finds more breast tumors earlier than traditional double radiologist review
AI is detecting tumors more often and earlier in the Dutch breast cancer screening program. Those tumors can then be treated at an earlier stage. This has been demonstrated by researchers led by Radboud [...]
