Literature DB >> 35324209

Deep-Learning-Assisted Focused Ion Beam Nanofabrication.

Oleksandr Buchnev1, James A Grant-Jacob1, Robert W Eason1, Nikolay I Zheludev1,2, Ben Mills1, Kevin F MacDonald1.   

Abstract

Focused ion beam (FIB) milling is an important rapid prototyping tool for micro- and nanofabrication and device and materials characterization. It allows for the manufacturing of arbitrary structures in a wide variety of materials, but establishing the process parameters for a given task is a multidimensional optimization challenge, usually addressed through time-consuming, iterative trial-and-error. Here, we show that deep learning from prior experience of manufacturing can predict the postfabrication appearance of structures manufactured by focused ion beam (FIB) milling with >96% accuracy over a range of ion beam parameters, taking account of instrument- and target-specific artifacts. With predictions taking only a few milliseconds, the methodology may be deployed in near real time to expedite optimization and improve reproducibility in FIB processing.

Entities:  

Keywords:  deep learning; focused ion beam milling; nanofabrication

Mesh:

Year:  2022        PMID: 35324209      PMCID: PMC9097578          DOI: 10.1021/acs.nanolett.1c04604

Source DB:  PubMed          Journal:  Nano Lett        ISSN: 1530-6984            Impact factor:   12.262


Introduction

Focused ion beam (FIB) milling is a “direct-write” fabrication technique based on the removal of material from a target surface by a focused beam of ions.[1,2] It can etch features with nanometric resolution into almost any metal, semiconductor, dielectric, or biomaterial. As such, it has become a standard tool in semiconductor (i.e., microelectronics) manufacturing, rapid prototyping, and nano/bio/materials research. The end result of any FIB milling process is a complex function of beam current, spot size, scan pattern, target material characteristics, and design geometry, especially the aspect ratio of the pattern. Producing a comprehensive analytical model that describes the physical processes occurring during milling is consequently an intractable problem. Time-consuming, trial-and-error testing is therefore invariably required to establish optimal process parameters for achieving the intended outcome of a given milling operation on a given target. Computational, numerical approaches to simulating FIB milling are typically based on Monte Carlo modeling of ion–atom interactions and string or level set methods to track surface propagation over time.[3−8] They can reproduce 2D and 3D cross-sectional profiles of FIB-milled trenches or holes in certain materials but are mathematically complex and again require detailed knowledge of numerous parameters, such as ion energy and angle of incidence to a target surface, ion flux, ion beam spot size and intensity profile, dwell time and raster step size, atomic mass and physical form (e.g., mono/polycrystalline; amorphous) of target, etc. Deep learning offers an alternative approach whereby milling outcomes for arbitrary nano/microstructural geometries in any target medium can be accurately predicted by a suitably trained neural network. Deep learning is revolutionizing scientific research[9−14] because of its aptitude for pattern recognition and the capability to empirically establish the functional algorithms of complex systems.[15] For example, it has been shown that deep learning can improve laser machining processes,[16−18] including through the provision of feedback for real-time process control.[19−21] Here we show that deep learning can be used to simulate the postfabrication appearance of structures manufactured by FIB milling in the 2D projection of a scanning electron microscope image, as a very good (almost invariably the first, in situ) indicator of process accuracy and quality. With predictions generated on millisecond time scales, the approach can be deployed to reproducibility and precision in FIB manufacturing processes.

Results and Discussion

We demonstrate that deep learning can assist in predicting the postfabrication appearance of two-dimensional binary patterns FIB milled into a gold thin film (Figure ). Such structures are widely used in nanophotonic and metamaterial devices, seeded growth of nanostructures, and a range of other applications.[22−26]
Figure 1

Deep learning simulation of FIB milling. (a) Neural network is trained on a set of binary design patterns, corresponding SEM images of samples manufactured by FIB milling, and detail of the ion beam parameters used in their production. (b) Trained network is then able to accurately predict the outcome of FIB milling processes—the expected postfabrication appearance of samples in SEM imaging—for previously unseen designs. Optoelectronics Research Centre “Light” logo used with permission.

Deep learning simulation of FIB milling. (a) Neural network is trained on a set of binary design patterns, corresponding SEM images of samples manufactured by FIB milling, and detail of the ion beam parameters used in their production. (b) Trained network is then able to accurately predict the outcome of FIB milling processes—the expected postfabrication appearance of samples in SEM imaging—for previously unseen designs. Optoelectronics Research Centre “Light” logo used with permission. In this work, we used an FEI Helios Nanolab 600 DualBeam FIB/SEM system, which incorporates a gallium ion gun with a milling resolution of ∼20 nm and a field-emission scanning electron microscope (SEM) with imaging resolution down to ∼1 nm. In all cases, the binary patterns (i.e., comprising areas either exposed or not exposed to the ion beam) were fabricated by raster scanning the ion beam in lines running from left to right (as seen in images below), stepped from top to bottom. This consistency of procedure, as will be demonstrated, is essential to the effective application of deep learning to prediction of process outcomes. We first demonstrate the use of deep learning to relate the appearance of a simple geometric design—an isolated submicron chevron shape (Figure a)—in an SEM image to the ion beam parameters employed in its fabrication. To create a training and testing data set, we milled the chevron shape into a 50 nm thick (thermally evaporated) gold film nine times at 70 different FIB dosage settings, ranging from 0.25 to 17.5 mC/cm2 in 0.25 mC/cm2 steps, with a fixed ion beam current of 9.8 pA, creating 630 separate chevron elements. Figure a illustrates how the chevron’s appearance in SEM imaging changes with increasing ion beam dosage, from the top left (where it is insufficient for the design to penetrate the full thickness of the gold film) to the bottom right.
Figure 2

(a) SEM images of one of nine sets of 70 chevron structures milled into a 50 nm thick gold film with ion beam dosages ranging from 0.25 [top left] to 17.5 mC/cm2 (bottom right). The chevron design (i.e., input pattern for FIB milling) is shown above. Half of the images (as labeled) are used for neural network training; the other half for testing (panel b). Later experiments (see Figures –5) use a dose of 7 mC/cm2, as per the chevron image outlined in red. (b) Correlation between trained neural network predictions of mC/cm2 milling dosage from chevron SEM images in the testing set and actual (ground truth) dosage used in fabrication of the sample. (c) Histograms of pixel intensity for the set of chevron SEM images shown in panel a (peak count number amplitudes are normalized for clarity).

(a) SEM images of one of nine sets of 70 chevron structures milled into a 50 nm thick gold film with ion beam dosages ranging from 0.25 [top left] to 17.5 mC/cm2 (bottom right). The chevron design (i.e., input pattern for FIB milling) is shown above. Half of the images (as labeled) are used for neural network training; the other half for testing (panel b). Later experiments (see Figures –5) use a dose of 7 mC/cm2, as per the chevron image outlined in red. (b) Correlation between trained neural network predictions of mC/cm2 milling dosage from chevron SEM images in the testing set and actual (ground truth) dosage used in fabrication of the sample. (c) Histograms of pixel intensity for the set of chevron SEM images shown in panel a (peak count number amplitudes are normalized for clarity).
Figure 3

Training data set for FIB process simulation by a neural network, showing randomly generated binary designs (left of each pair) and corresponding FIB-milled sample SEM images (right), grouped by the ion beam current setting employed in sample fabrication.

Figure 5

(a) Binary design image of the Optoelectronics Research Centre’s “Light” logo. (b) Neural network-predicted (left column) and (c) actual FIB-milled sample SEM images of the logo, for an ion beam current setting of 9.8 pA. (d, e) Enlarged detail of central 100 × 100 pixel regions of b and c. (f, g) Pixel intensity profiles along the (f) horizontal and (g) vertical green and red lines in panels d and e, plotted in those colors (i.e., network-predicted profiles in green; fabricated sample SEM image profiles in red). The overlaid black lines are the corresponding binary design profiles (inverted with respect to panel a as white areas of the design are milled, becoming black in experimental samples). Optoelectronics Research Centre “Light” logo used with permission.

A convolutional neural network (CNN, see the Supporting Information) was trained using one half of the experimental SEM image data set and tested on the other. Figure b shows experimental versus predicted dose for the 315 images in the testing set; there is a clear correlation, with a root mean squared error of 0.52 mC/cm2. Although the method of dosage identification established by the neural network cannot be known, the set of pixel intensity histograms in Figure c provides some insight into the statistical differences among SEM images of chevrons milled with different ion beam settings: There is a clear trend toward higher pixel intensities (i.e., brighter images) with increasing dose, and a small peak at low pixel intensity emerges when the dose is high enough for the design to be milled through the full thickness of the gold film, exposing the silicon substrate (which appears black in SEM images). We next addressed the more complex challenge of simulating the FIB milling process for arbitrary patterns, aiming to accurately predict the outcome, i.e., what a sample will look like in an SEM image (as a strong indicator of process accuracy and quality), for previously unseen designs. This simulation is performed by a conditional generative adversarial network (cGAN)[27−29] trained on a set of 59 binary design and corresponding sample SEM images (Figure , see the Supporting Information for detail of the adversarial configuration used in network training). Designs comprised randomly generated arrangements of straight line and circle segments (each of random length and line width), so as to collectively include a very wide variety of straight/curved edges and intersection angles, at assorted orientations to the ion beam raster scan direction. They were fabricated using one of four ion gun aperture (beam current) settings with a fixed dosage of 7 mC/cm2 (sufficient to consistently penetrate the gold film without excessive overmilling of the substrate, as illustrated for the chevrons in Figure a by the highlighted SEM image). Training data set for FIB process simulation by a neural network, showing randomly generated binary designs (left of each pair) and corresponding FIB-milled sample SEM images (right), grouped by the ion beam current setting employed in sample fabrication. The trained network was subsequently asked to predict what SEM images of previously unseen binary designs would look like, were they to be fabricated with certain ion beam settings. Figure shows a comparison between predicted and actual FIB milling process outcomes for the acronymic logo of the UK’s Engineering and Physical Sciences Research Council at submicrometer font size (character height ∼360 nm). The accuracy of neural network predictions is evaluated here in terms of the mean magnitude of pixel intensity difference between predicted and real sample SEM images, above the noise level intrinsic to SEM imaging (i.e., of an unstructured surface). The correlation is extremely good, with the network achieving >96% accuracy over the entire trained order-of-magnitude ion beam current range: with increasing beam current, for example, increased overmilling of the design is correctly predicted, such as in the gradual disappearance of the gap between the letters P and S. Remarkably, the network correctly predicts defective shaping in the top left corner of each letter that is consistently observed across all ion current settings. This is an artifact (likely related to ion beam alignment and/or raster scan pattern) that has been identified by the network as systematically present within the training data set, while being imperceptible there to the human eye. The network has then accounted for this process artifact in its predictions of milling outcomes.
Figure 4

Comparison between neural network-predicted (left column) and actual FIB-milled sample SEM images (right column) for the EPSRC logo: (a) the binary design, and images with ion beam current (aperture) settings of (b) 9.8, (c) 28, (d) 48, and (e) 93 pA. Engineering and Physical Sciences Research Council (EPSRC) logo used with permission.

Comparison between neural network-predicted (left column) and actual FIB-milled sample SEM images (right column) for the EPSRC logo: (a) the binary design, and images with ion beam current (aperture) settings of (b) 9.8, (c) 28, (d) 48, and (e) 93 pA. Engineering and Physical Sciences Research Council (EPSRC) logo used with permission. Figure presents a more detailed, quantitative comparison between predicted and experimental images of our departmental “Light” logo, which features an assortment of curved and intersecting lines of varying width, akin to the training patterns. The prediction accuracy for the image as a whole (i.e., evaluated as above, as the mean magnitude of pixel intensity difference between predicted and real sample SEM images, above the unstructured surface noise floor) is >98%. Cross-sectional pixel intensity profiles through corresponding parts of the design provide insight into the network’s success in meeting its objective: It is tasked, in essence, with mapping the binary (input) profiles denoted by black lines in Figure f, g to the experimental sample profiles from SEM imaging (plotted in red), with a success metric being the difference between the latter and the dotted green lines, which show network-generated profiles. Even though the transformation is both highly nonlinear and dependent on the surrounding pixel intensities in all directions, there is strong correspondence over a range of feature sizes in the design between predicted and experimental sample profiles. Improvements in this correlation may be achieved through optimization of the training hyperparameters (e.g., number of epochs and learning rate; see further detail in the Supporting Information) and/or inclusion of additional training data, for example, to address circumstances in which the network’s predictive capability is found to be weak. (a) Binary design image of the Optoelectronics Research Centre’s “Light” logo. (b) Neural network-predicted (left column) and (c) actual FIB-milled sample SEM images of the logo, for an ion beam current setting of 9.8 pA. (d, e) Enlarged detail of central 100 × 100 pixel regions of b and c. (f, g) Pixel intensity profiles along the (f) horizontal and (g) vertical green and red lines in panels d and e, plotted in those colors (i.e., network-predicted profiles in green; fabricated sample SEM image profiles in red). The overlaid black lines are the corresponding binary design profiles (inverted with respect to panel a as white areas of the design are milled, becoming black in experimental samples). Optoelectronics Research Centre “Light” logo used with permission.

Conclusion

In summary, we have shown that a neural network can accurately predict the postfabrication appearance in scanning electron microscope images of samples manufactured by focused ion beam milling, over a wide range of sample design geometries (arbitrary micro/nanostructural feature shapes and dimensions), and ion beam parameters (current and per-unit-area dosage). With each prediction taking only a few tens of milliseconds, this capability can significantly reduce the time and the number of experimental dose-test iterations required in the development and optimization of new FIB processes It can also be employed to rapidly evaluate the impact of design or process parameter modifications, and to maintain performance (i.e., consistency of outcomes from established processes) against aging of the ion source and ion gun beam apertures, thereby increasing the useful lifetime of said components, particularly where employed in highly repetitive (e.g., cross-sectional characterization) tasks. Predictions are sufficiently accurate as to include instrument- and/or target material-specific artifacts. These cannot be accounted for in numerical or analytical approaches to simulating FIB milling. That they may be imperceptible to the human eye in training samples, or may appear as random (e.g., redeposition) defects in isolated test samples, raises the prospect that such networks could be deployed for early fault (e.g., beam alignment, aperture damage) detection and identification. In this proof-of-principle study, we trained a network to simulate a specific type of FIB milling task on a specific target medium, while varying ion current and dosage (i.e., keeping all other system parameters constant). In practice, one would train the network to the task(s) at hand (i.e., according to application context, such as in semiconductor wafer-based device characterization or in nanofabrication for plasmonics research), on a relevant variety of target materials, and with a full range of substrate and system metadata (e.g., film deposition methods, rates and thickness, crystal orientations, etc.; ion current, dosage, raster scan pattern, number of repetitions, ion source, aperture age, etc.). In this way, the network would accrue an “understanding” of the complex relationships among the numerous sample and system parameters that affect process outcomes. Indeed, we would argue that there is considerable scope for functional enhancement of FIB/SEM systems, as integrated micro/nanomanufacturing and sample characterization (i.e., fabrication and in situ diagnostic) platforms, through the application of machine learning methodologies. For example, we (as chemists, physicists, and materials scientists and as users of FIB milling tools) understand that families of materials have similar physical properties derived from similarities in composition and atomic/molecular structure. Neural networks are highly effective at discovering such patterns in complex, multidimensional data sets can similarly “learn” that there are relationships among types of material.[30−34] Thus, a network trained on, for example, conductive oxide compositions A, B, C, and D may “intuitively” perform very well in application to previously unseen composition E, if told simply that it is another conductive oxide, i.e., it would not require dedicated training on every new target material encountered. It is also possible that neural networks trained for applications to FIB process development and control could contribute to new scientific understanding of the milling process (i.e., ion beam–target interactions).[15,35−37]
  15 in total

1.  A review on the fabrication of substrates for surface enhanced Raman spectroscopy and their applications in analytical chemistry.

Authors:  Meikun Fan; Gustavo F S Andrade; Alexandre G Brolo
Journal:  Anal Chim Acta       Date:  2011-03-06       Impact factor: 6.558

2.  Level set approach for the simulation of focused ion beam processing on the micro/nano scale.

Authors:  Heung-Bae Kim; Gerhard Hobler; Andreas Steiger; Alois Lugstein; Emmerich Bertagnolli
Journal:  Nanotechnology       Date:  2007-06-05       Impact factor: 3.874

Review 3.  Deep learning.

Authors:  Yann LeCun; Yoshua Bengio; Geoffrey Hinton
Journal:  Nature       Date:  2015-05-28       Impact factor: 49.962

4.  Real-time particle pollution sensing using machine learning.

Authors:  James A Grant-Jacob; Benita S Mackay; James A G Baker; Daniel J Heath; Yunhui Xie; Matthew Loxham; Robert W Eason; Ben Mills
Journal:  Opt Express       Date:  2018-10-15       Impact factor: 3.894

5.  Simulating advanced focused ion beam nanomachining: a quantitative comparison of simulation and experimental results.

Authors:  Kyle T Mahady; Shida Tan; Yuval Greenzweig; Amir Raveh; Philip D Rack
Journal:  Nanotechnology       Date:  2018-09-14       Impact factor: 3.874

6.  Quo Vadis, Metasurfaces?

Authors:  Cheng-Wei Qiu; Tan Zhang; Guangwei Hu; Yuri Kivshar
Journal:  Nano Lett       Date:  2021-06-23       Impact factor: 11.189

7.  Modelling laser machining of nickel with spatially shaped three pulse sequences using deep learning.

Authors:  M D T McDonnell; J A Grant-Jacob; Y Xie; M Praeger; B S Mackay; R W Eason; B Mills
Journal:  Opt Express       Date:  2020-05-11       Impact factor: 3.894

8.  Artificial intelligence for photonics and photonic materials.

Authors:  Davide Piccinotti; Kevin F MacDonald; Simon A Gregory; Ian Youngs; Nikolay I Zheludev
Journal:  Rep Prog Phys       Date:  2021-01

9.  ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition.

Authors:  Dipendra Jha; Logan Ward; Arindam Paul; Wei-Keng Liao; Alok Choudhary; Chris Wolverton; Ankit Agrawal
Journal:  Sci Rep       Date:  2018-12-04       Impact factor: 4.379

10.  Highly accurate protein structure prediction with AlphaFold.

Authors:  John Jumper; Richard Evans; Alexander Pritzel; Tim Green; Michael Figurnov; Olaf Ronneberger; Kathryn Tunyasuvunakool; Russ Bates; Augustin Žídek; Anna Potapenko; Alex Bridgland; Clemens Meyer; Simon A A Kohl; Andrew J Ballard; Andrew Cowie; Bernardino Romera-Paredes; Stanislav Nikolov; Rishub Jain; Demis Hassabis; Jonas Adler; Trevor Back; Stig Petersen; David Reiman; Ellen Clancy; Michal Zielinski; Martin Steinegger; Michalina Pacholska; Tamas Berghammer; Sebastian Bodenstein; David Silver; Oriol Vinyals; Andrew W Senior; Koray Kavukcuoglu; Pushmeet Kohli
Journal:  Nature       Date:  2021-07-15       Impact factor: 49.962

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.