DNA is crucial for life, and its organization has been a significant scientific challenge. GROVER, a model developed by BIOTEC, decodes DNA like text, promising advancements in genomics and personalized medicine.
DNA holds the essential information required to sustain life. Deciphering how this information is stored and organized has been one of the greatest scientific challenges of the past century. Now, with GROVER, a new large language model trained on human DNA, researchers can attempt to decode the intricate information concealed within our genome. Developed by a team at the Biotechnology Center (BIOTEC) of Dresden University of Technology, GROVER treats human DNA as text, learning its rules and context to extract functional information about DNA sequences. Published in Nature Machine Intelligence, this innovative tool has the potential to revolutionize genomics and accelerate personalized medicine.
Since the discovery of the double helix, scientists have sought to understand the information encoded in DNA. 70 years later, it is clear that the information hidden in the DNA is multilayered. Only 1-2 % of the genome consists of genes, the sequences that code for proteins.
“DNA has many functions beyond coding for proteins. Some sequences regulate genes, others serve structural purposes, and most sequences serve multiple functions at once. Currently, we don’t understand the meaning of most of the DNA. When it comes to understanding the non-coding regions of the DNA, it seems that we have only started to scratch the surface. This is where AI and large language models can help,” says Dr. Anna Poetsch, research group leader at the BIOTEC.
DNA as a Language
Large language models, like GPT, have transformed our understanding of language. Trained exclusively on text, the large language models developed the ability to use the language in many contexts.
“DNA is the code of life. Why not treat it like a language?” says Dr. Poetsch. The Poetsch team trained a large language model on a reference human genome. The resulting tool named GROVER, or “Genome Rules Obtained via Extracted Representations”, can be used to extract biological meaning from the DNA.
“GROVER learned the rules of DNA. In terms of language, we are talking about grammar, syntax, and semantics. For DNA this means learning the rules governing the sequences, the order of the nucleotides and sequences, and the meaning of the sequences. Like GPT models learning human languages, GROVER has basically learned how to ‘speak’ DNA,” explains Dr. Melissa Sanabria, the researcher behind the project.
The team showed that GROVER can not only accurately predict the following DNA sequences but can also be used to extract contextual information that has biological meaning, e.g., identify gene promoters or protein binding sites on DNA. GROVER also learns processes that are generally considered to be “epigenetic”, i.e., regulatory processes that happen on top of the DNA rather than being encoded.
“It is fascinating that by training GROVER with only the DNA sequence, without any annotations of functions, we are actually able to extract information on biological function. To us, it shows that the function, including some of the epigenetic information, is also encoded in the sequence,” says Dr. Sanabria.
The DNA Dictionary
“DNA resembles language. It has four letters that build sequences and the sequences carry a meaning. However, unlike a language, DNA has no defined words,” says Dr. Poetsch. DNA consists of four letters (A, T, G, and C) and genes, but there are no predefined sequences of different lengths that combine to build genes or other meaningful sequences.
To train GROVER, the team had to first create a DNA dictionary. They used a trick from compression algorithms. “This step is crucial and sets our DNA language model apart from the previous attempts,” says Dr. Poetsch.
“We analyzed the whole genome and looked for combinations of letters that occur most often. We started with two letters and went over the DNA, again and again, to build it up to the most common multi-letter combinations. In this way, in about 600 cycles, we have fragmented the DNA into ‘words’ that let GROVER perform the best when it comes to predicting the next sequence,” explains Dr. Sanabria.
The Promise of AI in Genomics
GROVER promises to unlock the different layers of genetic code. DNA holds key information on what makes us human, our disease predispositions, and our responses to treatments.
“We believe that understanding the rules of DNA through a language model is going to help us uncover the depths of biological meaning hidden in the DNA, advancing both genomics and personalized medicine,” says Dr. Poetsch.
Reference: “DNA language model GROVER learns sequence context in the human genome” by Melissa Sanabria, Jonas Hirsch, Pierre M. Joubert and Anna R. Poetsch, 23 July 2024, Nature Machine Intelligence.
DOI: 10.1038/s42256-024-00872-0

News
Small antibodies provide broad protection against SARS coronaviruses
Scientists have discovered a unique class of small antibodies that are strongly protective against a wide range of SARS coronaviruses, including SARS-CoV-1 and numerous early and recent SARS-CoV-2 variants. The unique antibodies target an [...]
Controlling This One Molecule Could Halt Alzheimer’s in Its Tracks
New research identifies the immune molecule STING as a driver of brain damage in Alzheimer’s. A new approach to Alzheimer’s disease has led to an exciting discovery that could help stop the devastating cognitive decline [...]
Cyborg tadpoles are helping us learn how brain development starts
How does our brain, which is capable of generating complex thoughts, actions and even self-reflection, grow out of essentially nothing? An experiment in tadpoles, in which an electronic implant was incorporated into a precursor [...]
Prime Editing: The Next Frontier in Genetic Medicine
By Dr. Chinta SidharthanReviewed by Benedette Cuffari, M.Sc. Discover how prime editing is redefining the future of medicine by offering highly precise, safe, and versatile DNA corrections, bringing hope for more effective treatments for genetic diseases [...]
Can scientists predict life longevity from a drop of blood?
Discover how a new epigenetic clock measures how fast you are really aging from just a drop of blood or saliva. A recent study published in the journal Nature Aging constructed an intrinsic capacity (IC) clock [...]
What is different about the NB.1.8.1 Covid variant?
For many of us, Covid-19 feels like a chapter we’ve closed – along with the days of PCR tests, mask mandates and daily case updates. But while life may feel back to normal, the [...]
Scientists discover single cell creatures can learn new behaviours
It was previously thought that learning behaviours only applied to animals with complex brain and nervous systems, but a new study has proven that this may also occur in individual cells. As a result, this new evidence may change how [...]
Virus which ’causes multiple organ failure’ found at popular Spanish holiday destination
British tourists planning trips to Spain have been warned after a deadly virus that can cause multiple organ failure has been detected in the country. The Foreign Office issued the alert on its dedicated website Travel [...]
Urgent health warning as dangerous new Covid virus from China triggers US outbreak
A dangerous new Covid variant from China is surging in California, health officials warn. The California Department of Public Health warned this week the highly contagious NB.1.8.1 strain has been detected in the state, making it the [...]
How the evolution of a single gene allowed the plague to adapt, prolonging the pandemics
Scientists have documented the way a single gene in the bacterium that causes bubonic plague, Yersinia pestis, allowed it to survive hundreds of years by adjusting its virulence and the length of time it [...]
Inhalable Nanovaccines: The Future of Needle-Free Immunization
The COVID-19 pandemic highlighted the need for adaptable and scalable vaccine technologies. While mRNA vaccines have improved disease prevention, most are delivered by intramuscular injection, which may not effectively prevent infections that begin at [...]
‘Stealthy’ lipid nanoparticles give mRNA vaccines a makeover
A new material developed at Cornell University could significantly improve the delivery and effectiveness of mRNA vaccines by replacing a commonly used ingredient that may trigger unwanted immune responses in some people. Thanks to [...]
You could be inhaling nearly 70,000 plastic particles annually, what it means for your health
Invisible plastics in the air are infiltrating our bodies and cities. Scientists reveal the urgent health dangers and outline bold solutions for a cleaner, safer future. In a recent review article published in the [...]
Experts explain how H5 avian influenza adapts to infect more animals
A new global review reveals how rapidly evolving H5 bird flu viruses are reaching new species, including dairy cattle, and stresses the urgent need for coordinated action to prevent the next pandemic. Since its [...]
3D-printed device enables precise modeling of complex human tissues in the lab
A new, easily adopted, 3D-printed device will enable scientists to create models of human tissue with even greater control and complexity. An interdisciplinary group of researchers at the University of Washington and UW Medicine [...]
Ancient DNA sheds light on evolution of relapsing fever bacteria
Researchers at the Francis Crick Institute and UCL have analyzed ancient DNA from Borrelia recurrentis, a type of bacteria that causes relapsing fever, pinpointing when it evolved to spread through lice rather than ticks, and [...]