A cutting-edge AI acceleration platform powered by light rather than electricity could revolutionize how AI is trained and deployed.
Using photonic integrated circuits made from advanced III-V semiconductors, researchers have developed a system that vastly outperforms traditional silicon GPUs in both energy efficiency and speed. This technology could not only lower energy costs but also scale AI to new levels of performance, potentially transforming everything from data centers to future smart systems.
The AI Boom and Its Infrastructure Challenges
Artificial intelligence (AI) is rapidly transforming a wide range of industries. Powered by deep learning and vast datasets, AI systems require enormous computing power to train and operate. Today, most of this work relies on graphical processing units (GPUs), but their high energy consumption and limited scalability pose significant challenges. To support future growth in AI, more efficient and sustainable hardware solutions are needed.
A Leap Forward: Photonic Circuits for AI
A recent study published in the IEEE Journal of Selected Topics in Quantum Electronics introduces a promising alternative: an AI acceleration platform built on photonic integrated circuits (PICs). These optical chips offer better scalability and energy efficiency than traditional, GPU-based systems. Led by Dr. Bassem Tossoun, Senior Research Scientist at Hewlett Packard Labs, the research shows how PICs that incorporate III-V compound semiconductors can run AI workloads faster and with far less energy.
Unlike conventional hardware, which uses electronic distributed neural networks (DNNs), this new approach uses optical neural networks (ONNs), circuits that compute with light instead of electricity. Because they operate at the speed of light and minimize energy loss, ONNs hold great potential for accelerating AI more efficiently.
"While silicon photonics are easy to manufacture, they are difficult to scale for complex integrated circuits. Our device platform can be used as the building blocks for photonic accelerators with far greater energy efficiency and scalability than the current state-of-the-art," explains Dr. Tossoun.
The team used a heterogeneous integration approach to fabricate the hardware. This included the use of silicon photonics along with III-V compound semiconductors that functionally integrate lasers and optical amplifiers to reduce optical losses and improve scalability. III-V semiconductors facilitate the creation of PICs with greater density and complexity. PICs utilizing these semiconductors can run all operations required for supporting neural networks, making them prime candidates for next-generation AI accelerator hardware.
How the Platform Was Fabricated
The fabrication started with silicon-on-insulator (SOI) wafers that have a 400 nm-thick silicon layer. Lithography and dry etching were followed by doping for metal oxide semiconductor capacitor (MOSCAP) devices and avalanche photodiodes (APDs). Next, selective growth of silicon and germanium was performed to form absorption, charge, and multiplication layers of the APD. III-V compound semiconductors (such as InP or GaAs) were then integrated onto the silicon platform using die-to-wafer bonding. A thin gate oxide layer (Al₂O₃ or HfO₂) was added to improve device efficiency, and finally a thick dielectric layer was deposited for encapsulation and thermal stability.
A New Frontier in AI Hardware
"The heterogeneous III/V-on-SOI platform provides all essential components required to develop photonic and optoelectronic computing architectures for AI/ML acceleration. This is particularly relevant for analog ML photonic accelerators, which use continuous analog values for data representation," Dr. Tossoun notes.
This unique photonic platform can achieve wafer-scale integration of all of the various devices required to build an optical neural network on one single photonic chip, including active devices such as on-chip lasers and amplifiers, high-speed photodetectors, energy-efficient modulators, and non-volatile phase shifters. This enables the development of TONN-based accelerators with a footprint-energy efficiency that is 2.9 × 10² times greater than other photonic platforms and 1.4 × 10² times greater than the most advanced digital electronics.
Transforming AI with Light-Speed Efficiency
This is indeed a breakthrough technology for AI/ML acceleration, reducing energy costs, improving computational efficiency, and enabling future AI-driven applications in various fields. Going forward, this technology will enable datacenters to accommodate more AI workloads and help solve several optimization problems.
The platform will be addressing computational and energy challenges, paving the way for robust and sustainable AI accelerator hardware in the future!
Reference: "Large-Scale Integrated Photonic Device Platform for Energy-Efficient AI/ML Accelerators" by Bassem Tossoun, Xian Xiao, Stanley Cheung, Yuan Yuan, Yiwei Peng, Sudharsanan Srinivasan, George Giamougiannis, Zhihong Huang, Prerana Singaraju, Yanir London, Matěj Hejda, Sri Priya Sundararajan, Yingtao Hu, Zheng Gong, Jongseo Baek, Antoine Descos, Morten Kapusta, Fabian Böhm, Thomas Van Vaerenbergh, Marco Fiorentino, Geza Kurczveil, Di Liang and Raymond G. Beausoleil, 9 January 2025, IEEE Journal of Selected Topics in Quantum Electronics.
DOI: 10.1109/JSTQE.2025.3527904
News
Human Bodies Are Producing Two Billion Tons of CO2 a Year
A new study reveals that the amount of carbon dioxide produced by human metabolism has increased dramatically over three decades. The carbon dioxide produced by human bodies as they convert food into energy increased [...]
A Hidden DNA Mechanism Could Explain How 20% of Human Cancers Develop
Researchers have identified an unexpected molecular vulnerability in cancers carrying BAF mutations. Mutations found in roughly 20% of human cancers may promote tumor growth by changing how DNA is organized inside cells. Researchers have [...]
Ebola kills over 5,300 in fastest-growing outbreak on record
Africa’s latest Ebola outbreak has killed nearly 5,400 people, the vast majority of them in the Democratic Republic of Congo (DRC), according to the continent’s top health agency. Africa Centres for Disease Control and [...]
China makes early progress in using sound waves to stimulate damaged brains
Chinese researchers are testing whether focused ultrasound can help restore consciousness in patients with severe brain injuries, adding to a growing international effort to use sound waves to stimulate deep brain structures without surgery. [...]
Micro-drones fly through the body thanks to ultrasound
At the EPFL, micro-drones have been developed that can be moved without a motor or battery.No motors, no batteries, no electronics on board, just small cavities that convert sound waves into thrust: this is [...]
A Single Enzyme Could Hold the Key to Treating a Devastating Brain Disorder
Blocking an enzyme’s production restored brain growth and healthy behaviors in mice engineered to develop Angelman syndrome, pointing to a possible treatment target. Children with Angelman syndrome begin to show difficulties with thinking and [...]
Scientists Develop a Clever New Way To Kill Cancer Cells From the Inside
Scientists have developed an experimental strategy that exploits a chemical byproduct of cancer cells to produce anticancer drugs directly inside them. Scientists in Japan have developed an experimental method that uses a chemical produced [...]
Our books are available worldwide!
Online Sellers other than Amazon, Routledge, and IOPP Indigo Global Health Care Equivalency in the Age of Nanotechnology, Nanomedicine and Artifcial Intelligence Global Health Care Equivalency In The Age Of Nanotechnology, Nanomedicine And Artificial [...]
After only a short training, people in a coma managed to send targeted signals
Researchers have succeeded in communicating with brain-injured patients who are unconscious. They see enormous potential in this for future treatments. Patients who lie motionless in bed after a severe brain injury and do not [...]
MIT Scientists Reprogram Immune Cells Inside the Body To Destroy Cancer
Natural killer cells reprogrammed inside mice eliminated lymphoma tumors and helped damaged livers heal, though whether this approach could help people with cancer or autoimmune disease remains unknown. To make a cancer treatment from [...]
Melanoma mRNA Vaccine Shows Promise in Preventing Disease Recurrence
Key takeaways: Phase 3 trial finds personalized intismeran plus pembrolizumab may better prevent high-risk melanoma recurrence after surgery The trial enrolled 1,137 patients and builds on phase 2 results showing about half the recurrence [...]
Scientists Discover a Powerful New Weapon Against a Dangerous Gut Infection
The promise of an experimental treatment for C. difficile gut infections lies partly in the bacteria it leaves alive, according to early laboratory and mouse research. Broad-spectrum antibiotics can disrupt the gut’s microbial community, [...]
Your Bones May Hold a Hidden Clue to Blood Cancer Survival
For people with blood cancers called myelodysplastic syndromes, osteoporosis may hold an overlooked clue to survival, a three-year observational study suggests. In blood cancers that develop in the bone marrow, an important clue to [...]
Researchers Discover What Reading for Pleasure May Be Doing to Your Brain
Reading for pleasure may offer surprising benefits for the brain, with research linking the habit to better mental health, stronger cognitive abilities, and a lower risk of dementia. Reading for pleasure may do far [...]
Scientists Discover a Hidden Trigger That Keeps Inflammation Alive
Inflammation persists after proteins detach from immune receptors, revealing a potential target for autoimmune treatments. Since a Nobel Prize-winning discovery in the 1990s identified molecules called Toll-like Receptors as the guardians of the human [...]
A Virus Gives Itself Away the Moment It Attacks
Researchers have found the trigger behind a powerful bacterial defense against viruses. Viruses that prey on bacteria could become an increasingly important tool for treating bacterial infections, particularly as antibiotic resistance makes some infections [...]
