What happens in the human brain when we learn from positive and negative experiences? To help answer that question and better understand decision-making and human behavior, scientists are studying dopamine.
Now, a new study from researchers at Wake Forest University School of Medicine published Dec. 1 in Science Advances shows that dopamine release in the human brain plays a crucial role in encoding both reward and punishment prediction errors. This means that dopamine is involved in the process of learning from both positive and negative experiences, allowing the brain to adjust and adapt its behavior based on the outcomes of these experiences.
“Previously, research has shown that dopamine plays an important role in how animals learn from ‘rewarding’ (and possibly ‘punishing’) experiences. But, little work has been done to directly assess what dopamine does on fast timescales in the human brain,” said Kenneth T. Kishida, Ph.D., associate professor of physiology and pharmacology and neurosurgery at Wake Forest University School of Medicine.
“This is the first study in humans to examine how dopamine encodes rewards and punishments and whether dopamine reflects an ‘optimal’ teaching signal that is used in today’s most advanced artificial intelligence research.”
For the study, researchers on Kishida’s team utilized fast-scan cyclic voltammetry, an electrochemical technique, paired with machine learning, to detect and measure dopamine levels in real-time (i.e., 10 measurements per second). However, this method is challenging and can only be performed during invasive procedures such as deep-brain stimulation (DBS) brain surgery. DBS is commonly employed to treat conditions such as Parkinson’s disease, essential tremor, obsessive-compulsive disorder and epilepsy.
Kishida’s team collaborated with Atrium Health Wake Forest Baptist neurosurgeons Stephen B. Tatter, M.D., and Adrian W. Laxton, M.D., who are also both faculty members in the Department of Neurosurgery at Wake Forest University School of Medicine, to insert a carbon fiber microelectrode deep into the brain of three participants at Atrium Health Wake Forest Baptist Medical Center who were scheduled to receive DBS to treat essential tremor.
While the participants were awake in the operating room, they played a simple computer game. As they played the game, dopamine measurements were taken in the striatum, a part of the brain that is important for cognition, decision-making, and coordinated movements.
During the game, participants’ choices were either rewarded or punished with real monetary gains or losses. The game was divided into three stages in which participants learned from positive or negative feedback to make choices that maximized rewards and minimized penalties. Dopamine levels were measured continuously, once every 100 milliseconds, throughout each of the three stages of the game.
“We found that dopamine not only plays a role in signaling both positive and negative experiences in the brain, but it seems to do so in a way that is optimal when trying to learn from those outcomes. What was also interesting, is that it seems like there may be independent pathways in the brain that separately engage the dopamine system for rewarding versus punishing experiences. Our results reveal a surprising result that these two pathways may encode rewarding and punishing experiences on slightly shifted timescales separated by only 200 to 400 milliseconds in time,” Kishida said.
Kishida believes that this level of understanding may lead to a better understanding of how the dopamine system is affected in humans with psychiatric and neurological disorders. Kishida said additional research is needed to understand how dopamine signaling is altered in psychiatric and neurological disorders.
“Traditionally, dopamine is often referred to as ‘the pleasure neurotransmitter,”‘ Kishida said. “However, our work provides evidence that this is not the way to think about dopamine. Instead, dopamine is a crucial part of a sophisticated system that teaches our brain and guides our behavior. That dopamine is also involved in teaching our brain about punishing experiences is an important discovery and may provide new directions in research to help us better understand the mechanisms underlying depression, addiction, and related psychiatric and neurological disorders.”
More information: Paul Sands et al, Sub-second fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans, Science Advances (2023). DOI: 10.1126/sciadv.adi4927. www.science.org/doi/10.1126/sciadv.adi4927
News
GLP-1 Drugs Like Ozempic Work, but New Research Reveals a Major Catch
Three new Cochrane reviews find evidence that GLP-1 drugs lead to clinically meaningful weight loss, though industry-funded studies raise concerns. Three new reviews from Cochrane have found that GLP-1 medications can lead to significant [...]
How a Palm-Sized Laser Could Change Medicine and Manufacturing
Researchers have developed an innovative and versatile system designed for a new generation of short-pulse lasers. Lasers that produce extremely short bursts of light are known for their remarkable precision, making them indispensable tools [...]
New nanoparticles stimulate the immune system to attack ovarian tumors
Cancer immunotherapy, which uses drugs that stimulate the body’s immune cells to attack tumors, is a promising approach to treating many types of cancer. However, it doesn’t work well for some tumors, including ovarian [...]
New Drug Kills Cancer 20,000x More Effectively With No Detectable Side Effects
By restructuring a common chemotherapy drug, scientists increased its potency by 20,000 times. In a significant step forward for cancer therapy, researchers at Northwestern University have redesigned the molecular structure of a well-known chemotherapy drug, greatly [...]
Lipid nanoparticles discovered that can deliver mRNA directly into heart muscle cells
Cardiovascular disease continues to be the leading cause of death worldwide. But advances in heart-failure therapeutics have stalled, largely due to the difficulty of delivering treatments at the cellular level. Now, a UC Berkeley-led [...]
The basic mechanisms of visual attention emerged over 500 million years ago, study suggests
The brain does not need its sophisticated cortex to interpret the visual world. A new study published in PLOS Biology demonstrates that a much older structure, the superior colliculus, contains the necessary circuitry to perform the [...]
AI Is Overheating. This New Technology Could Be the Fix
Engineers have developed a passive evaporative cooling membrane that dramatically improves heat removal for electronics and data centers Engineers at the University of California San Diego have created an innovative cooling system designed to greatly enhance [...]
New nanomedicine wipes out leukemia in animal study
In a promising advance for cancer treatment, Northwestern University scientists have re-engineered the molecular structure of a common chemotherapy drug, making it dramatically more soluble and effective and less toxic. In the new study, [...]
Mystery Solved: Scientists Find Cause for Unexplained, Deadly Diseases
A study reveals that a protein called RPA is essential for maintaining chromosome stability by stimulating telomerase. New findings from the University of Wisconsin-Madison suggest that problems with a key protein that helps preserve chromosome stability [...]
Nanotech Blocks Infection and Speed Up Chronic Wound Recovery
A new nanotech-based formulation using quercetin and omega-3 fatty acids shows promise in halting bacterial biofilms and boosting skin cell repair. Scientists have developed a nanotechnology-based treatment to fight bacterial biofilms in wound infections. The [...]
Researchers propose five key questions for effective adoption of AI in clinical practice
While Artificial Intelligence (AI) can be a powerful tool that physicians can use to help diagnose their patients and has great potential to improve accuracy, efficiency and patient safety, it has its drawbacks. It [...]
Advancements and clinical translation of intelligent nanodrugs for breast cancer treatment
A comprehensive review in "Biofunct. Mater." meticulously details the most recent advancements and clinical translation of intelligent nanodrugs for breast cancer treatment. This paper presents an exhaustive overview of subtype-specific nanostrategies, the clinical benefits [...]
It’s Not “All in Your Head”: Scientists Develop Revolutionary Blood Test for Chronic Fatigue Syndrome
A 96% accurate blood test for ME/CFS could transform diagnosis and pave the way for future long COVID detection. Researchers from the University of East Anglia and Oxford Biodynamics have created a highly accurate [...]
How Far Can the Body Go? Scientists Find the Ultimate Limit of Human Endurance
Even the most elite endurance athletes can’t outrun biology. A new study finds that humans hit a metabolic ceiling at about 2.5 times their resting energy burn. When ultra-runners take on races that last [...]
World’s Rivers “Overdosing” on Human Antibiotics, Study Finds
Researchers estimate that approximately 8,500 tons of antibiotics enter river systems each year after passing through the human body and wastewater treatment processes. Rivers spanning millions of kilometers across the globe are contaminated with [...]
Yale Scientists Solve a Century-Old Brain Wave Mystery
Yale scientists traced gamma brain waves to thalamus-cortex interactions. The discovery could reveal how brain rhythms shape perception and disease. For more than a century, scientists have observed rhythmic waves of synchronized neuronal activity [...]
