DNA is crucial for life, and its organization has been a significant scientific challenge. GROVER, a model developed by BIOTEC, decodes DNA like text, promising advancements in genomics and personalized medicine.
DNA holds the essential information required to sustain life. Deciphering how this information is stored and organized has been one of the greatest scientific challenges of the past century. Now, with GROVER, a new large language model trained on human DNA, researchers can attempt to decode the intricate information concealed within our genome. Developed by a team at the Biotechnology Center (BIOTEC) of Dresden University of Technology, GROVER treats human DNA as text, learning its rules and context to extract functional information about DNA sequences. Published in Nature Machine Intelligence, this innovative tool has the potential to revolutionize genomics and accelerate personalized medicine.
Since the discovery of the double helix, scientists have sought to understand the information encoded in DNA. 70 years later, it is clear that the information hidden in the DNA is multilayered. Only 1-2 % of the genome consists of genes, the sequences that code for proteins.
"DNA has many functions beyond coding for proteins. Some sequences regulate genes, others serve structural purposes, and most sequences serve multiple functions at once. Currently, we don't understand the meaning of most of the DNA. When it comes to understanding the non-coding regions of the DNA, it seems that we have only started to scratch the surface. This is where AI and large language models can help," says Dr. Anna Poetsch, research group leader at the BIOTEC.
DNA as a Language
Large language models, like GPT, have transformed our understanding of language. Trained exclusively on text, the large language models developed the ability to use the language in many contexts.
"DNA is the code of life. Why not treat it like a language?" says Dr. Poetsch. The Poetsch team trained a large language model on a reference human genome. The resulting tool named GROVER, or "Genome Rules Obtained via Extracted Representations", can be used to extract biological meaning from the DNA.
"GROVER learned the rules of DNA. In terms of language, we are talking about grammar, syntax, and semantics. For DNA this means learning the rules governing the sequences, the order of the nucleotides and sequences, and the meaning of the sequences. Like GPT models learning human languages, GROVER has basically learned how to 'speak' DNA," explains Dr. Melissa Sanabria, the researcher behind the project.
The team showed that GROVER can not only accurately predict the following DNA sequences but can also be used to extract contextual information that has biological meaning, e.g., identify gene promoters or protein binding sites on DNA. GROVER also learns processes that are generally considered to be "epigenetic", i.e., regulatory processes that happen on top of the DNA rather than being encoded.
"It is fascinating that by training GROVER with only the DNA sequence, without any annotations of functions, we are actually able to extract information on biological function. To us, it shows that the function, including some of the epigenetic information, is also encoded in the sequence," says Dr. Sanabria.
The DNA Dictionary
"DNA resembles language. It has four letters that build sequences and the sequences carry a meaning. However, unlike a language, DNA has no defined words," says Dr. Poetsch. DNA consists of four letters (A, T, G, and C) and genes, but there are no predefined sequences of different lengths that combine to build genes or other meaningful sequences.
To train GROVER, the team had to first create a DNA dictionary. They used a trick from compression algorithms. "This step is crucial and sets our DNA language model apart from the previous attempts," says Dr. Poetsch.
"We analyzed the whole genome and looked for combinations of letters that occur most often. We started with two letters and went over the DNA, again and again, to build it up to the most common multi-letter combinations. In this way, in about 600 cycles, we have fragmented the DNA into 'words' that let GROVER perform the best when it comes to predicting the next sequence," explains Dr. Sanabria.
The Promise of AI in Genomics
GROVER promises to unlock the different layers of genetic code. DNA holds key information on what makes us human, our disease predispositions, and our responses to treatments.
"We believe that understanding the rules of DNA through a language model is going to help us uncover the depths of biological meaning hidden in the DNA, advancing both genomics and personalized medicine," says Dr. Poetsch.
Reference: "DNA language model GROVER learns sequence context in the human genome" by Melissa Sanabria, Jonas Hirsch, Pierre M. Joubert and Anna R. Poetsch, 23 July 2024, Nature Machine Intelligence.
DOI: 10.1038/s42256-024-00872-0
News
Electrostatic Discharge Boosts Triboelectric Nanogenerator Current and Enables DC Output
Controlled electrical discharges could enable triboelectric nanogenerators to achieve higher peak currents, extending nano-enabled energy harvesting into chemical processing and self-powered sensing. Paper: Electrostatic discharge as a breakthrough strategy for triboelectric nanogenerators. A new review [...]
Swiss laboratory uses old drugs against rare diseases
Researchers at the University of Geneva are combing through collections of approved drugs to find new therapies for rare diseases – with some success. This approach is gaining traction around the world, while pharmaceutical [...]
Nanozyme Aptasensors Show Promise for Faster Food, Health, and Environmental Testing
By pairing robust artificial enzymes with highly selective aptamers, nanozyme aptasensors could help detect disease biomarkers, pathogens, and contaminants faster, but the review shows that real-world deployment still depends on overcoming matrix interference, biofouling, [...]
Paralyzed Man Feels Sensation Again With Brain Stimulation Device
Aneuroprosthetic system has allowed a man with paralysis to grasp and lift objects and feel touch again. The device helped 42-year-old Keith Thomas of Massapequa, New York, who was paralyzed from the chest down [...]
Global Cancer Cases Could Surge 67% by 2050, New Report Warns
New data reveal major geographic disparities and highlight the urgent need for global action on prevention, early detection, and equitable access to treatment. For roughly one in five people worldwide, cancer will become part [...]
A Deadly Ebola-Like Virus Is Spreading. Are We Ready?
BU virologist Nancy Sullivan says the Bundibugyo outbreak in the Democratic Republic of the Congo underscores the need for broader outbreak preparedness. The death of a nurse marked the moment health officials recognized that [...]
Why Most Animal Viruses Never Become Human Pandemics
From receptor mismatch to risky human-animal interfaces, this article explains why spillover is common but true pandemic emergence remains rare. Introduction Humans are constantly exposed to animal viruses through farming, wildlife contact, and the [...]
Stem cell organoids repair heart microvessels in coronary artery disease models
A Stanford University team has shown that vascular organoids derived from human stem cells can repair the heart’s microvessel network in pigs with ischaemic heart disease – a proof-of-concept advancement that could open new therapeutic [...]
Goodbye GP waiting rooms, hello prevention at home
Prevention is suddenly everywhere in NHS reform. The recent £340m community pharmacy deal is moving more services onto the high street. Community Diagnostic Centres are being expanded, and the Neighbourhood Health Framework sets out [...]
Ebola control is weakened by mistrust and cultural insensitivity
Effective response depends on cooperation with communities and frontline workers, writes Zaeem ul Haq The current Bundibugyo Ebola outbreak in the Democratic Republic of the Congo (DRC) and Uganda is exposing dangerous gaps in [...]
Building the Brain Requires Millions of Dangerous DNA Breaks
Scientists discovered that building a healthy brain involves an unexpected step: young neurons routinely break and rapidly repair their own DNA. As the brain develops, newly formed nerve cells must travel through tightly packed tissue [...]
One Tiny Change May Explain How Viruses Jump From Bats to Humans
Scientists found that one tiny genetic change may determine whether a bat virus stays in bats or becomes a human threat. Most infectious disease outbreaks begin when a virus or other pathogen crosses from animals into [...]
Scientists Discover 250+ Genes That Could Lead to New Ways To Prevent Melanoma
The world’s largest study of mole genetics identified hundreds of genes tied to melanoma risk, uncovering potential new drug targets and paving the way for more accurate melanoma screening and prevention. Researchers at QIMR [...]
Breakthrough Diabetes Treatment Reprograms the Immune System
An engineered stem cell therapy reversed new-onset Type 1 diabetes in mice by shifting the immune system away from attacking insulin-producing cells. For more than a century, people with Type 1 diabetes have relied [...]
Taking the world’s temperature: WHO chief spotlights global health emergencies
Taking the world’s temperature on pressing health matters, WHO Director-General Tedros Adhanom Ghebreyesus provided the latest on current global challenges - and successes when it comes to international cooperation. “The outbreaks of hantavirus, Ebola and Marburg all show [...]
Scientists Create Tiny “Mini Livers” That Could One Day Replace Liver Transplants
Engineered tissue grafts could help perform key liver functions and benefit thousands of people living with liver failure. The liver is one of the body’s hardest-working organs, carrying out hundreds of vital jobs, from [...]
