A cutting-edge AI acceleration platform powered by light rather than electricity could revolutionize how AI is trained and deployed.
Using photonic integrated circuits made from advanced III-V semiconductors, researchers have developed a system that vastly outperforms traditional silicon GPUs in both energy efficiency and speed. This technology could not only lower energy costs but also scale AI to new levels of performance, potentially transforming everything from data centers to future smart systems.
The AI Boom and Its Infrastructure Challenges
Artificial intelligence (AI) is rapidly transforming a wide range of industries. Powered by deep learning and vast datasets, AI systems require enormous computing power to train and operate. Today, most of this work relies on graphical processing units (GPUs), but their high energy consumption and limited scalability pose significant challenges. To support future growth in AI, more efficient and sustainable hardware solutions are needed.
A Leap Forward: Photonic Circuits for AI
A recent study published in the IEEE Journal of Selected Topics in Quantum Electronics introduces a promising alternative: an AI acceleration platform built on photonic integrated circuits (PICs). These optical chips offer better scalability and energy efficiency than traditional, GPU-based systems. Led by Dr. Bassem Tossoun, Senior Research Scientist at Hewlett Packard Labs, the research shows how PICs that incorporate III-V compound semiconductors can run AI workloads faster and with far less energy.
Unlike conventional hardware, which uses electronic distributed neural networks (DNNs), this new approach uses optical neural networks (ONNs), circuits that compute with light instead of electricity. Because they operate at the speed of light and minimize energy loss, ONNs hold great potential for accelerating AI more efficiently.
"While silicon photonics are easy to manufacture, they are difficult to scale for complex integrated circuits. Our device platform can be used as the building blocks for photonic accelerators with far greater energy efficiency and scalability than the current state-of-the-art," explains Dr. Tossoun.
The team used a heterogeneous integration approach to fabricate the hardware. This included the use of silicon photonics along with III-V compound semiconductors that functionally integrate lasers and optical amplifiers to reduce optical losses and improve scalability. III-V semiconductors facilitate the creation of PICs with greater density and complexity. PICs utilizing these semiconductors can run all operations required for supporting neural networks, making them prime candidates for next-generation AI accelerator hardware.
How the Platform Was Fabricated
The fabrication started with silicon-on-insulator (SOI) wafers that have a 400 nm-thick silicon layer. Lithography and dry etching were followed by doping for metal oxide semiconductor capacitor (MOSCAP) devices and avalanche photodiodes (APDs). Next, selective growth of silicon and germanium was performed to form absorption, charge, and multiplication layers of the APD. III-V compound semiconductors (such as InP or GaAs) were then integrated onto the silicon platform using die-to-wafer bonding. A thin gate oxide layer (Al₂O₃ or HfO₂) was added to improve device efficiency, and finally a thick dielectric layer was deposited for encapsulation and thermal stability.
A New Frontier in AI Hardware
"The heterogeneous III/V-on-SOI platform provides all essential components required to develop photonic and optoelectronic computing architectures for AI/ML acceleration. This is particularly relevant for analog ML photonic accelerators, which use continuous analog values for data representation," Dr. Tossoun notes.
This unique photonic platform can achieve wafer-scale integration of all of the various devices required to build an optical neural network on one single photonic chip, including active devices such as on-chip lasers and amplifiers, high-speed photodetectors, energy-efficient modulators, and non-volatile phase shifters. This enables the development of TONN-based accelerators with a footprint-energy efficiency that is 2.9 × 10² times greater than other photonic platforms and 1.4 × 10² times greater than the most advanced digital electronics.
Transforming AI with Light-Speed Efficiency
This is indeed a breakthrough technology for AI/ML acceleration, reducing energy costs, improving computational efficiency, and enabling future AI-driven applications in various fields. Going forward, this technology will enable datacenters to accommodate more AI workloads and help solve several optimization problems.
The platform will be addressing computational and energy challenges, paving the way for robust and sustainable AI accelerator hardware in the future!
Reference: "Large-Scale Integrated Photonic Device Platform for Energy-Efficient AI/ML Accelerators" by Bassem Tossoun, Xian Xiao, Stanley Cheung, Yuan Yuan, Yiwei Peng, Sudharsanan Srinivasan, George Giamougiannis, Zhihong Huang, Prerana Singaraju, Yanir London, Matěj Hejda, Sri Priya Sundararajan, Yingtao Hu, Zheng Gong, Jongseo Baek, Antoine Descos, Morten Kapusta, Fabian Böhm, Thomas Van Vaerenbergh, Marco Fiorentino, Geza Kurczveil, Di Liang and Raymond G. Beausoleil, 9 January 2025, IEEE Journal of Selected Topics in Quantum Electronics.
DOI: 10.1109/JSTQE.2025.3527904
News
Cancer’s Hidden Antioxidant Shield Helps It Escape the Immune System
Blocking an antioxidant protein that tumors use to suppress immune attacks improved cancer immunotherapy responses in mice. Cancer cells can release antioxidants that interfere with the immune cells trying to kill them. Researchers have [...]
Scientists Find a Berry Compound That Helps Muscle Cells Burn Fat
Pterostilbene, a compound found naturally in some foods, affects how skeletal muscles process fats by stabilizing a protein called PPARδ and increasing its signaling activity. Pterostilbene, a natural compound found in blueberries, grapes, and [...]
Two Hidden Forces Help Build the Human Brain Before Birth
Scientists have uncovered two surprising forces that help guide how the human brain forms before birth. Before birth, the human brain is shaped in large part by an unusual class of stem cells known [...]
Researchers Uncover a Hidden Trigger Behind Chronic Inflammation
The findings offer new insights that could help guide the development of future therapies. A protein called human resistin may help flip on one of the immune system’s most powerful inflammatory switches. Researchers at [...]
Scientists Have Uncovered Previously Hidden Microbial Activity on Human Skin
The most abundant microbes on your skin may not be the ones doing most of the work. Human skin supports vast communities of bacteria, fungi, and viruses that can influence its protective barrier, immune [...]
Brazilian Tree Compounds Fight COVID-19 on Multiple Fronts
Scientists found compounds in a Brazilian tree that hit SARS-CoV-2 on multiple fronts, revealing a promising new lead in the search for COVID-19 treatments. Researchers have found that galloylquinic acids extracted from the leaves [...]
Cutting Two Amino Acids Slowed Prostate Cancer in Mice
A newly identified link between amino acid metabolism and cholesterol production may help prostate tumors adapt to hormone therapy. Prostate cancer can find ways around treatments designed to deprive tumors of the hormones they [...]
Largest-Ever Physics Survey Raises New Doubts About Our Model of the Universe
Physicists around the world remain deeply divided on key mysteries of the universe, from dark matter to quantum gravity. The standard cosmological model failed to gain majority support, and no leading theory dominated the [...]
Scientists Just Overturned a 100-Year-Old Belief About Bacteria in the Lungs
New findings raise questions about the role of microbes living in the lungs. More than 35 trillion bacteria live throughout the human body, forming microbiomes in the gut, mouth, lungs, skin, and urogenital tract. [...]
GHCE Concept
From the preface of the book Global Health Care Equivalency in the Age of Nanotechnology, Nanomedicine and Artificial Intelligence, Edited by Frank Boehm: Since the publication of my first book (Nanomedical Device and Systems [...]
Novartis, Ionis drug failure spurs questions
Pelacarsen didn’t protect heart health despite lowering levels of a protein particle, “Lp(a),” in a large clinical trial — a result with important implications for cardiovascular drug research. Dive Brief: An RNA drug from [...]
New injectable treatment helps the brain rebuild after stroke
Biomedical engineers at Duke University have created an injectable biomaterial that may help the brain recover from damage left behind by an ischemic stroke. In experiments with mice, the material transformed the cavity created [...]
Scientists Discover a Hidden “Immune Organ” Inside the Skull
Researchers discovered lymph node-like immune hubs inside skull bone marrow that appear to act as rapid-response centers for the brain. For decades, the brain was thought to operate largely apart from the immune system. [...]
Engineered tRNAs and lipid nanoparticles target nonsense mutation cystic fibrosis
Researchers have developed a potential new approach for treating a form of cystic fibrosis caused by so-called nonsense mutations, combining chemically modified transfer RNAs with lipid nanoparticles designed to deliver the therapy directly to [...]
New pancreatic cancer drug carries a $39,800 monthly list price
A groundbreaking treatment for one of the most common forms of pancreatic cancer has been approved in pill form by the FDA. Revolution Medicines’ oral tablet daraxonrasib, branded as Rasonque, reduced the risk of [...]
Researchers Have Discovered a New Way To Reduce Chronic Nerve Pain
A cancer-linked protein called BRAF may help drive chronic nerve pain, and existing cancer drugs targeting it reduced pain sensitivity in preclinical models. Chronic nerve pain can persist long after an injury and often [...]
