A group of researchers recently published a paper in the journal ACS Nano Letters that demonstrated the feasibility of using deep learning to simulate the post-fabrication appearance of nano/microstructures fabricated by focused ion beam (FIB) milling in the two-dimensional (2D) projection of a scanning electron microscope (SEM) image.
FIB Milling Process and its Limitations
FIB milling is a “direct-write” fabrication technique performed by removing material from a target surface using a focused beam of ions. The technique is used as a standard tool in materials/bio/nano research, rapid prototyping, and semiconductor manufacturing as it can etch nanoscale features in almost every biomaterial, dielectric, semiconductor, and metal.
The result of every FIB milling process depends on a complex function of target material characteristics, scan pattern, spot size, beam current, and design geometry, specifically the pattern aspect ratio. Thus, creating an inclusive analytical model that describes all physical processes happening during milling is extremely challenging. Trial and error testing is usually performed to establish the optimal process parameters in order to achieve the desired outcome of a certain milling operation on the target surface. However, this testing method is time-consuming in nature.
Numerical, computational approaches to simulate FIB milling are often based on level set or string methods and Monte Carlo modeling of ion−atom interactions that track surface propagation over a duration. Although these approaches can reproduce three-dimensional (3D) or 2D cross-sectional profiles of FIB-milled holes or trenches in certain materials, they are mathematically complex and require detailed information on several parameters, such as physical form and atomic mass of the target, raster step size, dwell time, intensity profile, ion beam spot size, and ion flux, and angle of incidence and ion energy to a target surface.
Deep learning can offer an alternative approach as it can accurately predict the milling outcomes for arbitrary micro/nanostructural geometries in any target surface with the help of a suitably trained neural network. The method is fundamentally transforming scientific research owing to its ability to pattern recognition and empirically establish the functional algorithms of complex systems.
Evaluation of Deep Learning Approach to Predict Postfabrication Appearance of FIB-Milled Structures
In this study, researchers used deep learning to predict the post-fabrication appearance of 2D binary patterns that were FIB milled on a gold thin film. The SEM image acts as an extremely good indicator of process quality and accuracy. An FEI Helios Nanolab 600 DualBeam FIB/SEM system that includes a field-emission SEM with a 1-nanometer imaging resolution and a gallium ion gun with 20-nanometer milling resolution was employed in this study. The binary patterns were fabricated by raster scanning the ion beam in lines stepped from top to bottom and running from left to right.
The convolutional neural network (CNN) used to predict the ion beam dose from sample SEM images was constituted of four convolutional layers, with each layer formed of rectified linear unit (ReLU), pooling processes, and batch normalization. These layers were followed by a fully connected layer with one regression output. The network was initially trained on SEM images of chevrons FIB milled with dosage values in the sequence of 0.5, 1.0, 1.5, with a maximum dosage value of 17.5 mC/cm2.
The images were cropped to 299×299 pixels with random horizontal and vertical shifts of ±15 pixels in the chevron position relative to the frame center position. The training continued for 50 epochs, with a batch size of 8 and a learning rate of 0.00005, taking an overall three minutes on NVIDIA RTX2070 GPU. Subsequently, the CNN was tested on SEM images of chevrons that were milled with dosage values in the sequence of 0.25, 0.75, 1.25, up to a maximum value of 17.25 mC/cm2 and cropped to 299×299-pixels with every prediction taking 2.5 milliseconds.
The conditional generative adversarial network (cGAN) was used to simulate the FIB-milled sample SEM images. The network was constructed by a 4-layer discriminator and an 8-layer generator, with a learning rate of 0.0002 and L1 to discriminator loss ratio of 200, and trained for 5 epochs on an NVIDIA Titan Xp GPU, taking almost 45 hours. The SEM images were recorded at 710×710 pixels with 5 nanometer resolution and then rescaled to 355×355 pixels, to match the pixilation of binary designs.
Research Findings
The neural network accurately predicted the postfabrication appearance in SEM images of binary patterns fabricated by FIB milling over an extensive range of ion beam parameters, such as per-unit-area dosage, and sample design geometries that include arbitrary nano/microstructural dimensions and feature shapes. Every prediction was made within a few tens of milliseconds, and the accuracy of all predictions was more than 96%, which is sufficient to include the target- and instrument-specific artifacts.
Faster prediction with high accuracy significantly reduced the number of experimental dose-test iterations and time required in the optimization and development of new FIB processes. The method was also effective in rapidly evaluating the impact of process parameters and design modifications, and maintaining the performance in terms of consistency of outcomes from established FIB processes against aging of ion gun beam apertures and the ion source. Thus, the method can extend the useful lifetime of these components, which is specifically beneficial when they are utilized in highly repetitive tasks such as cross-sectional characterization.
To summarize, the findings of the study demonstrated that deep-learning-based prediction methodology can be deployed in almost real-time to improve reproducibility and expedite optimization of FIB processing.
News
Antibiotic Breakthrough: Revolutionary Chinese Study Paves Way for Superbug Defeating Drugs
New research reveals that fluorous lipopetides act as highly effective antibiotics. Bacterial infections resistant to multiple drugs, which no existing antibiotics can treat, represent a significant worldwide challenge. A research group from China has [...]
Signs of Multiple Sclerosis Show Up in Blood Years Before Symptoms Appear
UCSF scientists clear a potential path toward earlier treatment for a disease that affects nearly 1,000,000 people in the United States. By Levi Gadye In a discovery that could hasten treatment for patients with multiple [...]
Advanced RNA Sequencing Reveals the Drivers of New COVID Variants
A study reveals that a new sequencing technique, tARC-seq, can accurately track mutations in SARS-CoV-2, providing insights into the rapid evolution and variant development of the virus. The SARS-CoV-2 virus that causes COVID has the unsettling [...]
No More Endless Boosters? Scientists Develop One-for-All Virus Vaccine
End of the line for endless boosters? Researchers at UC Riverside have developed a new vaccine approach using RNA that is effective against any strain of a virus and can be used safely even by babies or the immunocompromised. Every [...]
How Are Hydrogels Shaping the Future of Biomedicine?
Hydrogels have gained widespread recognition and utilization in biomedical engineering, with their applications dating back to the 1960s when they were first used in contact lens production. Hydrogels are distinguished from other biomaterials in [...]
Nanovials method for immune cell screening uncovers receptors that target prostate cancer
A recent UCLA study demonstrates a new process for screening T cells, part of the body's natural defenses, for characteristics vital to the success of cell-based treatments. The method filters T cells based on [...]
New Research Reveals That Your Sense of Smell May Be Smarter Than You Think
A new study published in the Journal of Neuroscience indicates that the sense of smell is significantly influenced by cues from other senses, whereas the senses of sight and hearing are much less affected. A popular [...]
Deadly bacteria show thirst for human blood: the phenomenon of bacterial vampirism
Some of the world's deadliest bacteria seek out and feed on human blood, a newly-discovered phenomenon researchers are calling "bacterial vampirism." A team led by Washington State University researchers has found the bacteria are [...]
Organ Architects: The Remarkable Cells Shaping Our Development
Finding your way through the winding streets of certain cities can be a real challenge without a map. To orient ourselves, we rely on a variety of information, including digital maps on our phones, [...]
Novel hydrogel removes microplastics from water
Microplastics pose a great threat to human health. These tiny plastic debris can enter our bodies through the water we drink and increase the risk of illnesses. They are also an environmental hazard; found [...]
Researchers Discover New Origin of Deep Brain Waves
Understanding hippocampal activity could improve sleep and cognition therapies. Researchers from the University of California, Irvine’s biomedical engineering department have discovered a new origin for two essential brain waves—slow waves and sleep spindles—that are critical for [...]
The Lifelong Cost of Surviving COVID: Scientists Uncover Long-Term Effects
Many of the individuals released to long-term acute care facilities suffered from conditions that lasted for over a year. Researchers at UC San Francisco studied COVID-19 patients in the United States who survived some of the longest and [...]
Previously Unknown Rogue Immune Key to Chronic Viral Infections Discovered
Scientists discovered a previously unidentified rogue immune cell linked to poor antibody responses in chronic viral infections. Australian researchers have discovered a previously unknown rogue immune cell that can cause poor antibody responses in [...]
Nature’s Betrayal: Unmasking Lead Lurking in Herbal Medicine
A case of lead poisoning due to Ayurvedic medicine use demonstrates the importance of patient history in diagnosis and the need for public health collaboration to prevent similar risks. An article in CMAJ (Canadian Medical Association [...]
Frozen in Time: How a DNA Anomaly Misled Scientists for Centuries
An enormous meteor spelled doom for most dinosaurs 65 million years ago. But not all. In the aftermath of the extinction event, birds — technically dinosaurs themselves — flourished. Scientists have spent centuries trying [...]
‘Mini kidneys’ reveal new insights into metabolic defects in polycystic kidney disease
Scientists at Nanyang Technological University, Singapore (NTU Singapore) have successfully grown 'mini kidneys' in the lab and grafted them into live mice, revealing new insights into the metabolic defects and a potential therapy for [...]