A new mathematical model enhances the evaluation of AI identification risks, offering a scalable solution to balance technological benefits with privacy protection.
AI tools are increasingly used to track and monitor people both online and in person, but their effectiveness carries significant risks. To address this, computer scientists from the Oxford Internet Institute, Imperial College London, and UCLouvain have developed a new mathematical model designed to help people better understand the dangers of AI and support regulators in safeguarding privacy. Their findings were published in Nature Communications.
This model is the first to offer a solid scientific framework for evaluating identification methods, particularly when handling large-scale data. It can assess the accuracy of techniques like advertising codes and invisible trackers in identifying online users based on minimal information—such as time zones or browser settings—a process known as "browser fingerprinting."
Lead author Dr. Luc Rocher, Senior Research Fellow, Oxford Internet Institute, part of the University of Oxford, said: "We see our method as a new approach to help assess the risk of re-identification in data release, but also to evaluate modern identification techniques in critical, high-risk environments. In places like hospitals, humanitarian aid delivery, or border control, the stakes are incredibly high, and the need for accurate, reliable identification is paramount."
Leveraging Bayesian Statistics for Improved Accuracy
The method draws on the field of Bayesian statistics to learn how identifiable individuals are on a small scale, and extrapolate the accuracy of identification to larger populations up to 10x better than previous heuristics and rules of thumb. This gives the method unique power in assessing how different data identification techniques will perform at scale, in different applications and behavioral settings. This could help explain why some AI identification techniques perform highly accurately when tested in small case studies but then misidentify people in real-world conditions.
The findings are highly timely, given the challenges posed to anonymity and privacy caused by the rapid rise of AI-based identification techniques. For instance, AI tools are being trialed to automatically identify humans from their voice in online banking, their eyes in humanitarian aid delivery, or their face in law enforcement.
According to the researchers, the new method could help organizations to strike a better balance between the benefits of AI technologies and the need to protect people's personal information, making daily interactions with technology safer and more secure. Their testing method allows for the identification of potential weaknesses and areas for improvement before full-scale implementation, which is essential for maintaining safety and accuracy.
A Crucial Tool for Data Protection
Co-author Associate Professor Yves-Alexandre de Montjoye (Data Science Institute, Imperial College, London) said: "Our new scaling law provides, for the first time, a principled mathematical model to evaluate how identification techniques will perform at scale. Understanding the scalability of identification is essential to evaluate the risks posed by these re-identification techniques, including to ensure compliance with modern data protection legislations worldwide."
Dr. Luc Rocher concluded: "We believe that this work forms a crucial step towards the development of principled methods to evaluate the risks posed by ever more advanced AI techniques and the nature of identifiability in human traces online. We expect that this work will be of great help to researchers, data protection officers, ethics committees, and other practitioners aiming to find a balance between sharing data for research and protecting the privacy of patients, participants, and citizens."
Reference: "A scaling law to model the effectiveness of identification techniques" by Luc Rocher, Julien M. Hendrickx and Yves-Alexandre de Montjoye, 9 January 2025, Nature Communications.
DOI: 10.1038/s41467-024-55296-6
The work was supported by a grant awarded to Luc Rocher by Royal Society Research Grant RG\R2\232035, the John Fell OUP Research Fund, the UKRI Future Leaders Fellowship [grant MR/Y015711/1], and by the F.R.S.-FNRS. Yves -Alexandre de Montjoye acknowledges funding from the Information Commissioner Office.
News
Pope Leo Urges Global Response to Congo’s Deadliest Ebola Outbreak
Pope Leo called for international action to address the Ebola outbreak in the Democratic Republic of Congo. The epidemic has claimed over 2,500 lives and is the nation's largest recorded outbreak. The Pope emphasized [...]
Is there a summer COVID-19 surge this year? Yep, it’s ramping up again
Hantavirus. Ebola. West Nile. Measles. And, of course, cyclospora — that stomach parasite making people miserable across the country. Americans have plenty to worry about this summer. But remember COVID-19? It may not be [...]
Natural Compound in Broccoli Could Help Treat a Rare, Incurable Neurological Disease
Swinburne researchers have discovered how broccoli could help treat an extremely rare and incurable disease that affects only about 200 Australians. A naturally occurring compound in broccoli is being investigated as a possible treatment [...]
Antibody recycling, FcRn and the next generation of biologics
FcRn plays a central role in regulating the half-life of IgG antibodies and albumin, making it a critical target in both antibody engineering and autoimmune disease therapy. This article explores the biology of FcRn, [...]
Ebola kills 2,300 in three months with no vaccine available for Congo’s deadliest ever outbreak
It’s Congo’s 17th outbreak, with a toll that has eclipsed that of the country’s 2018-2020 outbreak when 2,299 deaths out of 3,481 cases were recorded. The latest data shows 101 new cases and 33 [...]
Beyond an Agency: How AI, Creativity and Commercialization Are Converging Into a New Growth Model
At a moment when AI is forcing a fundamental rethink of how work gets done, the life sciences industry is grappling with a deeper question: what role should human creativity play in an increasingly [...]
New $60 Blood Test Detects Lung Cancer Without Costly DNA Sequencing
A simple blood test that detects chemical changes in DNA identified more than 90% of stage 2-4 lung cancers in an early study, without relying on costly DNA sequencing. Researchers at Tel Aviv University and collaborating [...]
Reducing drug development failures with human-relevant models and AI
Professor Joseph C. Wu of Stanford University explains how stem cells, human-relevant models and AI are helping researchers predict which drug candidates are most likely to succeed before clinical trials. Researchers now have access [...]
Half of vaccines are binned – ‘fridge-free’ versions could change that
Vaccines that do not need to be kept cool in a fridge have been successfully trialed in patients for the first time, say UK scientists. Currently, most vaccines need to be refrigerated or frozen [...]
Mushroom Mystery: The Fungus That Makes People See Tiny Humans
A mushroom sold in markets and served in restaurants in Southwest China has an unusual warning attached to it: cook it thoroughly, or you may start seeing tiny people. For decades, people have reported [...]
Artificial intelligence used to design brand new viruses
Artificial Intelligence has been used to design brand new viruses that are fully functional and can replicate in the laboratory, say US researchers. It is the first time whole genomes have been successfully designed [...]
Molecular Manufacturing: The Future of Nanomedicine – New book from NanoappsMedical Inc.
This book explores the revolutionary potential of atomically precise manufacturing technologies to transform global healthcare, as well as practically every other sector across society. This forward-thinking volume examines how envisaged Factory@Home systems might enable the cost-effective [...]
Moderna kicks off Phase I Ebola trial as Africa readies itself for research
If the Phase I trial is successful, Moderna plans to quickly initiate Phase II and Phase III trials of its Ebola vaccine. Moderna has initiated a Phase I trial of its mRNA Ebola vaccine [...]
3D Human Brain Tissue Model Replicates Alzheimer’s Pathology
Summary: Researchers introduced a highly reproducible three-dimensional human brain tissue model capable of replicating complex neurodegenerative processes in Alzheimer’s disease. Developed over nine years using human stem cells, the self-organizing tissue spheroids integrate functional neurons, [...]
A Common Sugar May Loosen Cancer Cells and Help Them Spread
Chemotherapy may kill most ovarian cancer cells, but the few that survive can turn dangerously active. By releasing fructose, they may help nearby tumor cells break free and spread. Researchers at The Wistar Institute [...]
COVID-19 can wake up dormant viruses in the body, large study confirms
Virus reactivations by SARS-CoV-2 could worsen initial symptoms and increase risk of Long Covid. Early in the COVID-19 pandemic, scientists noticed that a SARS-CoV-2 infection can “wake up” other, dormant viruses already present in [...]
