A group of researchers recently published a paper in the journal ACS Nano Letters that demonstrated the feasibility of using deep learning to simulate the post-fabrication appearance of nano/microstructures fabricated by focused ion beam (FIB) milling in the two-dimensional (2D) projection of a scanning electron microscope (SEM) image.
FIB Milling Process and its Limitations
FIB milling is a “direct-write” fabrication technique performed by removing material from a target surface using a focused beam of ions. The technique is used as a standard tool in materials/bio/nano research, rapid prototyping, and semiconductor manufacturing as it can etch nanoscale features in almost every biomaterial, dielectric, semiconductor, and metal.
The result of every FIB milling process depends on a complex function of target material characteristics, scan pattern, spot size, beam current, and design geometry, specifically the pattern aspect ratio. Thus, creating an inclusive analytical model that describes all physical processes happening during milling is extremely challenging. Trial and error testing is usually performed to establish the optimal process parameters in order to achieve the desired outcome of a certain milling operation on the target surface. However, this testing method is time-consuming in nature.
Numerical, computational approaches to simulate FIB milling are often based on level set or string methods and Monte Carlo modeling of ion−atom interactions that track surface propagation over a duration. Although these approaches can reproduce three-dimensional (3D) or 2D cross-sectional profiles of FIB-milled holes or trenches in certain materials, they are mathematically complex and require detailed information on several parameters, such as physical form and atomic mass of the target, raster step size, dwell time, intensity profile, ion beam spot size, and ion flux, and angle of incidence and ion energy to a target surface.
Deep learning can offer an alternative approach as it can accurately predict the milling outcomes for arbitrary micro/nanostructural geometries in any target surface with the help of a suitably trained neural network. The method is fundamentally transforming scientific research owing to its ability to pattern recognition and empirically establish the functional algorithms of complex systems.
Evaluation of Deep Learning Approach to Predict Postfabrication Appearance of FIB-Milled Structures
In this study, researchers used deep learning to predict the post-fabrication appearance of 2D binary patterns that were FIB milled on a gold thin film. The SEM image acts as an extremely good indicator of process quality and accuracy. An FEI Helios Nanolab 600 DualBeam FIB/SEM system that includes a field-emission SEM with a 1-nanometer imaging resolution and a gallium ion gun with 20-nanometer milling resolution was employed in this study. The binary patterns were fabricated by raster scanning the ion beam in lines stepped from top to bottom and running from left to right.
The convolutional neural network (CNN) used to predict the ion beam dose from sample SEM images was constituted of four convolutional layers, with each layer formed of rectified linear unit (ReLU), pooling processes, and batch normalization. These layers were followed by a fully connected layer with one regression output. The network was initially trained on SEM images of chevrons FIB milled with dosage values in the sequence of 0.5, 1.0, 1.5, with a maximum dosage value of 17.5 mC/cm2.
The images were cropped to 299×299 pixels with random horizontal and vertical shifts of ±15 pixels in the chevron position relative to the frame center position. The training continued for 50 epochs, with a batch size of 8 and a learning rate of 0.00005, taking an overall three minutes on NVIDIA RTX2070 GPU. Subsequently, the CNN was tested on SEM images of chevrons that were milled with dosage values in the sequence of 0.25, 0.75, 1.25, up to a maximum value of 17.25 mC/cm2 and cropped to 299×299-pixels with every prediction taking 2.5 milliseconds.
The conditional generative adversarial network (cGAN) was used to simulate the FIB-milled sample SEM images. The network was constructed by a 4-layer discriminator and an 8-layer generator, with a learning rate of 0.0002 and L1 to discriminator loss ratio of 200, and trained for 5 epochs on an NVIDIA Titan Xp GPU, taking almost 45 hours. The SEM images were recorded at 710×710 pixels with 5 nanometer resolution and then rescaled to 355×355 pixels, to match the pixilation of binary designs.
Research Findings
The neural network accurately predicted the postfabrication appearance in SEM images of binary patterns fabricated by FIB milling over an extensive range of ion beam parameters, such as per-unit-area dosage, and sample design geometries that include arbitrary nano/microstructural dimensions and feature shapes. Every prediction was made within a few tens of milliseconds, and the accuracy of all predictions was more than 96%, which is sufficient to include the target- and instrument-specific artifacts.
Faster prediction with high accuracy significantly reduced the number of experimental dose-test iterations and time required in the optimization and development of new FIB processes. The method was also effective in rapidly evaluating the impact of process parameters and design modifications, and maintaining the performance in terms of consistency of outcomes from established FIB processes against aging of ion gun beam apertures and the ion source. Thus, the method can extend the useful lifetime of these components, which is specifically beneficial when they are utilized in highly repetitive tasks such as cross-sectional characterization.
To summarize, the findings of the study demonstrated that deep-learning-based prediction methodology can be deployed in almost real-time to improve reproducibility and expedite optimization of FIB processing.
News
Lipid nanoparticles discovered that can deliver mRNA directly into heart muscle cells
Cardiovascular disease continues to be the leading cause of death worldwide. But advances in heart-failure therapeutics have stalled, largely due to the difficulty of delivering treatments at the cellular level. Now, a UC Berkeley-led [...]
The basic mechanisms of visual attention emerged over 500 million years ago, study suggests
The brain does not need its sophisticated cortex to interpret the visual world. A new study published in PLOS Biology demonstrates that a much older structure, the superior colliculus, contains the necessary circuitry to perform the [...]
AI Is Overheating. This New Technology Could Be the Fix
Engineers have developed a passive evaporative cooling membrane that dramatically improves heat removal for electronics and data centers Engineers at the University of California San Diego have created an innovative cooling system designed to greatly enhance [...]
New nanomedicine wipes out leukemia in animal study
In a promising advance for cancer treatment, Northwestern University scientists have re-engineered the molecular structure of a common chemotherapy drug, making it dramatically more soluble and effective and less toxic. In the new study, [...]
Mystery Solved: Scientists Find Cause for Unexplained, Deadly Diseases
A study reveals that a protein called RPA is essential for maintaining chromosome stability by stimulating telomerase. New findings from the University of Wisconsin-Madison suggest that problems with a key protein that helps preserve chromosome stability [...]
Nanotech Blocks Infection and Speed Up Chronic Wound Recovery
A new nanotech-based formulation using quercetin and omega-3 fatty acids shows promise in halting bacterial biofilms and boosting skin cell repair. Scientists have developed a nanotechnology-based treatment to fight bacterial biofilms in wound infections. The [...]
Researchers propose five key questions for effective adoption of AI in clinical practice
While Artificial Intelligence (AI) can be a powerful tool that physicians can use to help diagnose their patients and has great potential to improve accuracy, efficiency and patient safety, it has its drawbacks. It [...]
Advancements and clinical translation of intelligent nanodrugs for breast cancer treatment
A comprehensive review in "Biofunct. Mater." meticulously details the most recent advancements and clinical translation of intelligent nanodrugs for breast cancer treatment. This paper presents an exhaustive overview of subtype-specific nanostrategies, the clinical benefits [...]
It’s Not “All in Your Head”: Scientists Develop Revolutionary Blood Test for Chronic Fatigue Syndrome
A 96% accurate blood test for ME/CFS could transform diagnosis and pave the way for future long COVID detection. Researchers from the University of East Anglia and Oxford Biodynamics have created a highly accurate [...]
How Far Can the Body Go? Scientists Find the Ultimate Limit of Human Endurance
Even the most elite endurance athletes can’t outrun biology. A new study finds that humans hit a metabolic ceiling at about 2.5 times their resting energy burn. When ultra-runners take on races that last [...]
World’s Rivers “Overdosing” on Human Antibiotics, Study Finds
Researchers estimate that approximately 8,500 tons of antibiotics enter river systems each year after passing through the human body and wastewater treatment processes. Rivers spanning millions of kilometers across the globe are contaminated with [...]
Yale Scientists Solve a Century-Old Brain Wave Mystery
Yale scientists traced gamma brain waves to thalamus-cortex interactions. The discovery could reveal how brain rhythms shape perception and disease. For more than a century, scientists have observed rhythmic waves of synchronized neuronal activity [...]
Can introducing peanuts early prevent allergies? Real-world data confirms it helps
New evidence from a large U.S. primary care network shows that early peanut introduction, endorsed in 2015 and 2017 guidelines, was followed by a marked decline in clinician-diagnosed peanut and overall food allergies among [...]
Nanoparticle blueprints reveal path to smarter medicines
Lipid nanoparticles (LNPs) are the delivery vehicles of modern medicine, carrying cancer drugs, gene therapies and vaccines into cells. Until recently, many scientists assumed that all LNPs followed more or less the same blueprint, [...]
How nanomedicine and AI are teaming up to tackle neurodegenerative diseases
When I first realized the scale of the challenge posed by neurodegenerative diseases, such as Alzheimer's, Parkinson's disease and amyotrophic lateral sclerosis (ALS), I felt simultaneously humbled and motivated. These disorders are not caused [...]
Self-Organizing Light Could Transform Computing and Communications
USC engineers have demonstrated a new kind of optical device that lets light organize its own route using the principles of thermodynamics. Instead of relying on switches or digital control, the light finds its own [...]















