What happens in the human brain when we learn from positive and negative experiences? To help answer that question and better understand decision-making and human behavior, scientists are studying dopamine.
Now, a new study from researchers at Wake Forest University School of Medicine published Dec. 1 in Science Advances shows that dopamine release in the human brain plays a crucial role in encoding both reward and punishment prediction errors. This means that dopamine is involved in the process of learning from both positive and negative experiences, allowing the brain to adjust and adapt its behavior based on the outcomes of these experiences.
“Previously, research has shown that dopamine plays an important role in how animals learn from ‘rewarding’ (and possibly ‘punishing’) experiences. But, little work has been done to directly assess what dopamine does on fast timescales in the human brain,” said Kenneth T. Kishida, Ph.D., associate professor of physiology and pharmacology and neurosurgery at Wake Forest University School of Medicine.
“This is the first study in humans to examine how dopamine encodes rewards and punishments and whether dopamine reflects an ‘optimal’ teaching signal that is used in today’s most advanced artificial intelligence research.”
For the study, researchers on Kishida’s team utilized fast-scan cyclic voltammetry, an electrochemical technique, paired with machine learning, to detect and measure dopamine levels in real-time (i.e., 10 measurements per second). However, this method is challenging and can only be performed during invasive procedures such as deep-brain stimulation (DBS) brain surgery. DBS is commonly employed to treat conditions such as Parkinson’s disease, essential tremor, obsessive-compulsive disorder and epilepsy.
Kishida’s team collaborated with Atrium Health Wake Forest Baptist neurosurgeons Stephen B. Tatter, M.D., and Adrian W. Laxton, M.D., who are also both faculty members in the Department of Neurosurgery at Wake Forest University School of Medicine, to insert a carbon fiber microelectrode deep into the brain of three participants at Atrium Health Wake Forest Baptist Medical Center who were scheduled to receive DBS to treat essential tremor.
While the participants were awake in the operating room, they played a simple computer game. As they played the game, dopamine measurements were taken in the striatum, a part of the brain that is important for cognition, decision-making, and coordinated movements.
During the game, participants’ choices were either rewarded or punished with real monetary gains or losses. The game was divided into three stages in which participants learned from positive or negative feedback to make choices that maximized rewards and minimized penalties. Dopamine levels were measured continuously, once every 100 milliseconds, throughout each of the three stages of the game.
“We found that dopamine not only plays a role in signaling both positive and negative experiences in the brain, but it seems to do so in a way that is optimal when trying to learn from those outcomes. What was also interesting, is that it seems like there may be independent pathways in the brain that separately engage the dopamine system for rewarding versus punishing experiences. Our results reveal a surprising result that these two pathways may encode rewarding and punishing experiences on slightly shifted timescales separated by only 200 to 400 milliseconds in time,” Kishida said.
Kishida believes that this level of understanding may lead to a better understanding of how the dopamine system is affected in humans with psychiatric and neurological disorders. Kishida said additional research is needed to understand how dopamine signaling is altered in psychiatric and neurological disorders.
“Traditionally, dopamine is often referred to as ‘the pleasure neurotransmitter,”‘ Kishida said. “However, our work provides evidence that this is not the way to think about dopamine. Instead, dopamine is a crucial part of a sophisticated system that teaches our brain and guides our behavior. That dopamine is also involved in teaching our brain about punishing experiences is an important discovery and may provide new directions in research to help us better understand the mechanisms underlying depression, addiction, and related psychiatric and neurological disorders.”
More information: Paul Sands et al, Sub-second fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans, Science Advances (2023). DOI: 10.1126/sciadv.adi4927. www.science.org/doi/10.1126/sciadv.adi4927
News
Scientists Just Captured the Stunning Process That Shapes Chromosomes
Scientists at EMBL have captured how human chromosomes fold into their signature rod shape during cell division, using a groundbreaking method called LoopTrace. By observing overlapping DNA loops forming in high resolution, they revealed that large [...]
Bird Flu Virus Is Mutating Fast – Scientists Say Our Vaccines May Not Be Enough
H5N1 influenza is evolving rapidly, weakening the effectiveness of existing antibodies and increasing its potential threat to humans. Scientists at UNC Charlotte and MIT used high-performance computational modeling to analyze thousands of viral protein-antibody interactions, revealing [...]
Revolutionary Cancer Vaccine Targets All Solid Tumors
The method triggers immune responses that inhibit melanoma, triple-negative breast cancer, lung carcinoma, and ovarian cancer. Cancer treatment vaccines have been in development since 2010, when the first was approved for prostate cancer, followed [...]
Scientists Uncover Hidden Protein Driving Autoimmune Attacks
Scientists have uncovered a critical piece of the puzzle in autoimmune diseases: a protein that helps release immune response molecules. By studying an ultra-rare condition, researchers identified ArfGAP2 as a key player in immune [...]
Mediterranean neutrino observatory sets new limits on quantum gravity
Quantum gravity is the missing link between general relativity and quantum mechanics, the yet-to-be-discovered key to a unified theory capable of explaining both the infinitely large and the infinitely small. The solution to this [...]
Challenging Previous Beliefs: Japanese Scientists Discover Hidden Protector of Heart
A Japanese research team found that the oxidized form of glutathione (GSSG) may protect heart tissue by modifying a key protein, potentially offering a novel therapeutic approach for ischemic heart failure. A new study [...]
Millions May Have Long COVID – So Why Can’t They Get Diagnosed?
Millions of people in England may be living with Long Covid without even realizing it. A large-scale analysis found that nearly 10% suspect they might have the condition but remain uncertain, often due to [...]
Researchers Reveal What Happens to Your Brain When You Don’t Get Enough Sleep
What if poor sleep was doing more than just making you tired? Researchers have discovered that disrupted sleep in older adults interferes with the brain’s ability to clean out waste, leading to memory problems [...]
How to prevent chronic inflammation from zombie-like cells that accumulate with age
In humans and other multicellular organisms, cells multiply. This defining feature allows embryos to grow into adulthood, and enables the healing of the many bumps, bruises and scrapes along the way. Certain factors can [...]
Breakthrough for long Covid patients who lost sense of smell
A breakthrough nasal surgery has restored the sense of smell for a dozen long Covid patients. Experts at University College London Hospitals NHS Foundation Trust successfully employed a technique typically used for correcting blocked nasal passages, [...]
Scientists Invent Plastic That Can Dissolve In Seawater In Just A Few Hours
Plastic waste and pollution in the sea have been among the most serious environmental problems for decades, causing immense damage to marine life and ecosystems. However, a breakthrough discovery may offer a game-changing solution. [...]
Muscles from the 3D printer
Swiss researchers have developed a method for printing artificial muscles out of silicone. In the future, these could be used on both humans and robots. Swiss researchers have succeeded in printing artificial muscles out [...]
Beneficial genetic changes observed in regular blood donors
Researchers at the Francis Crick Institute have identified genetic changes in blood stem cells from frequent blood donors that support the production of new, non-cancerous cells. Understanding the differences in the mutations that accumulate [...]
Shocking Amounts of Microplastics in the Brain – It Could Be Increasing Our Risk of Dementia
The brain has higher concentrations of plastic particles compared to other organs, with increased levels found in dementia patients. In a comprehensive commentary published in Brain Medicine, researchers highlight alarming new evidence of microplastic accumulation [...]
Baffling Scientists for Centuries: New Study Unravels Mystery of Static Electricity
ISTA physicists demonstrate that contact electrification depends on the contact history of materials. For centuries, static electricity has intrigued and perplexed scientists. Now, researchers from the Waitukaitis group at the Institute of Science and [...]
Tumor “Stickiness” – Scientists Develop Potential New Way To Predict Cancer’s Spread
UC San Diego researchers have developed a device that predicts breast cancer aggressiveness by measuring tumor cell adhesion. Weakly adherent cells indicate a higher risk of metastasis, especially in early-stage DCIS. This innovation could [...]
