A novel architecture for optical neural networks utilizes wavefront shaping to precisely manipulate the travel of ultrashort pulses through multimode fibers, enabling nonlinear optical computation.
Present-day artificial intelligence systems rely on billions of adjustable parameters to accomplish complex objectives. Yet, the vast quantity of these parameters incurs significant expenses. The training and implementation of such extensive models demand considerable memory and processing power, available only in enormous data center facilities, consuming energy on par with the electrical demands of medium-sized cities. In response, researchers are currently reevaluating both the computing infrastructure and the machine learning algorithms to ensure the sustainable advancement of artificial intelligence continues at its current rate.
Optical implementation of neural network architectures is a promising avenue because of the low-power implementation of the connections between the units. New research reported in Advanced Photonics combines light propagation inside multimode fibers with a small number of digitally programmable parameters and achieves the same performance on image classification tasks with fully digital systems with more than 100 times more programmable parameters.
This computational framework streamlines the memory requirement and reduces the need for energy-intensive digital processes, while achieving the same level of accuracy in a variety of machine learning tasks.
Breakthrough in Nonlinear Optical Computations
The heart of this groundbreaking work, led by Professors Demetri Psaltis and Christophe Moser of EPFL (Swiss Federal Institute of Technology in Lausanne), lies in the precise control of ultrashort pulses within multimode fibers through a technique known as wavefront shaping. This allows for the implementation of nonlinear optical computations with microwatts of average optical power, reaching a crucial step in realizing the potential of optical neural networks.
"In this study, we found out that with a small group of parameters, we can select a specific set of model weights from the weight bank that optics provides and employ it for the aimed computing task. This way, we used naturally occurring phenomena as a computing hardware without going into the trouble of manufacturing and operating a device specialized for this purpose," states Ilker Oguz, lead co-author of the work.
This result marks a significant stride towards addressing the challenges posed by the escalating demand for larger machine learning models. By harnessing the computational power of light propagation through multimode fibers, the researchers have paved the way for low-energy, highly efficient hardware solutions in artificial intelligence.
As showcased in the reported nonlinear optics experiment, this computational framework can also be put to use for efficiently programming different high-dimensional, nonlinear phenomena for performing machine learning tasks and can offer a transformative solution to the resource-intensive nature of current AI models.
Reference: "Programming nonlinear propagation for efficient optical learning machines" by Ilker Oguz, Jih-Liang Hsieh, Niyazi Ulas Dinc, Uğur Teğin, Mustafa Yildirim, Carlo Gigli, Christophe Moser and Demetri Psaltis, 25 January 2024, Advanced Photonics.
DOI: 10.1117/1.AP.6.1.016002
News
Too Much RNA Can Drain a Cell’s Energy, Scientists Discover
A virus may cripple a cell’s power supply simply by producing too much of a molecule the cell needs to survive. New research from the Texas A&M College of Veterinary Medicine and Biomedical Sciences [...]
West African scientists warn of weakening health systems and urge stronger outbreak detection
LOME, Togo (AP) — West African laboratory scientists called on governments Friday to strengthen capacity to detect disease outbreaks to avoid another major outbreak, saying health systems across the region are becoming weaker. Participants [...]
A Little-Known Protein Could Point to a New Way To Treat Alzheimer’s
A study suggests that increasing SORLA protein levels could help treat Alzheimer’s disease and other disorders involving tau protein. Increasing SORLA, a protein with a protective role in the brain, helped mice withstand damage [...]
Cancer’s Hidden Antioxidant Shield Helps It Escape the Immune System
Blocking an antioxidant protein that tumors use to suppress immune attacks improved cancer immunotherapy responses in mice. Cancer cells can release antioxidants that interfere with the immune cells trying to kill them. Researchers have [...]
Scientists Find a Berry Compound That Helps Muscle Cells Burn Fat
Pterostilbene, a compound found naturally in some foods, affects how skeletal muscles process fats by stabilizing a protein called PPARδ and increasing its signaling activity. Pterostilbene, a natural compound found in blueberries, grapes, and [...]
Two Hidden Forces Help Build the Human Brain Before Birth
Scientists have uncovered two surprising forces that help guide how the human brain forms before birth. Before birth, the human brain is shaped in large part by an unusual class of stem cells known [...]
Researchers Uncover a Hidden Trigger Behind Chronic Inflammation
The findings offer new insights that could help guide the development of future therapies. A protein called human resistin may help flip on one of the immune system’s most powerful inflammatory switches. Researchers at [...]
Scientists Have Uncovered Previously Hidden Microbial Activity on Human Skin
The most abundant microbes on your skin may not be the ones doing most of the work. Human skin supports vast communities of bacteria, fungi, and viruses that can influence its protective barrier, immune [...]
Brazilian Tree Compounds Fight COVID-19 on Multiple Fronts
Scientists found compounds in a Brazilian tree that hit SARS-CoV-2 on multiple fronts, revealing a promising new lead in the search for COVID-19 treatments. Researchers have found that galloylquinic acids extracted from the leaves [...]
Cutting Two Amino Acids Slowed Prostate Cancer in Mice
A newly identified link between amino acid metabolism and cholesterol production may help prostate tumors adapt to hormone therapy. Prostate cancer can find ways around treatments designed to deprive tumors of the hormones they [...]
Largest-Ever Physics Survey Raises New Doubts About Our Model of the Universe
Physicists around the world remain deeply divided on key mysteries of the universe, from dark matter to quantum gravity. The standard cosmological model failed to gain majority support, and no leading theory dominated the [...]
Scientists Just Overturned a 100-Year-Old Belief About Bacteria in the Lungs
New findings raise questions about the role of microbes living in the lungs. More than 35 trillion bacteria live throughout the human body, forming microbiomes in the gut, mouth, lungs, skin, and urogenital tract. [...]
GHCE Concept
From the preface of the book Global Health Care Equivalency in the Age of Nanotechnology, Nanomedicine and Artificial Intelligence, Edited by Frank Boehm: Since the publication of my first book (Nanomedical Device and Systems [...]
Novartis, Ionis drug failure spurs questions
Pelacarsen didn’t protect heart health despite lowering levels of a protein particle, “Lp(a),” in a large clinical trial — a result with important implications for cardiovascular drug research. Dive Brief: An RNA drug from [...]
New injectable treatment helps the brain rebuild after stroke
Biomedical engineers at Duke University have created an injectable biomaterial that may help the brain recover from damage left behind by an ischemic stroke. In experiments with mice, the material transformed the cavity created [...]
Scientists Discover a Hidden “Immune Organ” Inside the Skull
Researchers discovered lymph node-like immune hubs inside skull bone marrow that appear to act as rapid-response centers for the brain. For decades, the brain was thought to operate largely apart from the immune system. [...]
