An official website of the United States government
Identifying the state of the colloidal self-assembly process is critical to monitoring and controlling the system into desired configurations. Recent application of convolutional neural networks with unsupervised clustering has shown a comparable performance to conventional approaches, in representing and classifying the states of a simulated 2D colloidal batch assembly system. Despite the early success, capturing the subtle differences among similar configurations still presents a challenge. To address this issue, we leverage a Siamese neural network to improve the accuracy of the state classification. Results from a Brownian dynamics-simulated electric field-mediated colloidal self-assembly system and a magnetic field-mediated colloidal self-assembly system demonstrate significant improvement from the original convolutional neural network-based approach. We anticipate the proposed improvement to further pave the way for automated monitoring and control of colloidal self-assembly processes in real time and real space.
more »
« less
Convolutional neural network-based colloidal self-assembly state classification
Colloidal self-assembly is a viable solution to making advanced metamaterials. While the physicochemical properties of the particles affect the properties of the assembled structures, particle configuration is also a critical determinant factor. Colloidal self-assembly state classification is typically achieved with order parameters, which are aggregate variables normally defined with nontrivial exploration and validation. Here, we present an image-based framework to classify the state of a 2-D colloidal self-assembly system. The framework leverages deep learning algorithms with unsupervised learning for state classification and a supervised learning-based convolutional neural network for state prediction. The neural network models are developed using data from an experimentally validated Brownian dynamics simulation. Our results demonstrate that the proposed approach gives a satisfying performance, comparable and even outperforming the commonly used order parameters in distinguishing void defective states from ordered states. Given the data-based nature of the approach, we anticipate its general applicability and potential automatability to different and complex systems where image or particle coordination acquisition is feasible.
more »
« less
- Award ID(s):
- 2218077
- PAR ID:
- 10411337
- Date Published:
- Journal Name:
- Soft Matter
- ISSN:
- 1744-683X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Detecting and analyzing the local environment is crucial for investigating the dynamical processes of crystal nucleation and shape colloidal particle self-assembly. Recent developments in machine learning provide a promising avenue for better order parameters in complex systems that are challenging to study using traditional approaches. However, the application of machine learning to self-assembly on systems of particle shapes is still underexplored. To address this gap, we propose a simple, physics-agnostic, yet powerful approach that involves training a multilayer perceptron (MLP) as a local environment classifier for systems of particle shapes, using input features such as particle distances and orientations. Our MLP classifier is trained in a supervised manner with a shape symmetry-encoded data augmentation technique without the need for any conventional roto-translations invariant symmetry functions. We evaluate the performance of our classifiers on four different scenarios involving self-assembly of cubic structures, two-dimensional and three-dimensional patchy particle shape systems, hexagonal bipyramids with varying aspect ratios, and truncated shapes with different degrees of truncation. The proposed training process and data augmentation technique are both straightforward and flexible, enabling easy application of the classifier to other processes involving particle orientations. Our work thus presents a valuable tool for investigating self-assembly processes on systems of particle shapes, with potential applications in structure identification of any particle-based or molecular system where orientations can be defined.more » « less
-
Optical and confocal microscopy is used to image the self-assembly of microscale colloidal particles. The density and size of self-assembled structures is typically quantified by hand, but this is extremely tedious. Here, we investigate whether machine learning can be used to improve the speed and accuracy of identification. This method is applied to confocal images of dense arrays of two-photon lithographed colloidal cones. RetinaNet, a deep learning implementation that uses a convolutional neural network, is used to identify self-assembled stacks of cones. Synthetic data is generated using Blender to supplement experimental training data for the machine learning model. This synthetic data captures key characteristics of confocal images, including slicing in the z-direction and Gaussian noise. We find that the best performance is achieved with a model trained on a mixture of synthetic data and experimental data. This model achieves a mean Average Precision (mAP) of ∼85%, and accurately measures the degree of assembly and distribution of self-assembled stack sizes for different cone diameters. Minor discrepancies between machine learning and hand labeled data is discussed in terms of the quality of synthetic data, and differences in cones of different sizes.more » « less
-
Understanding interparticle interactions has been one of the most important topics of research in the field of micro/nanoscale materials. Many significant characteristics of such materials directly stem from the way their building blocks interact with each other. In this work, we investigate the efficacy of a specific category of Machine Learning (ML) methods known as interaction networks in predicting interparticle interactions within colloidal systems. We introduce and study Local Neighborhood Graph Neural Networks (LN-GNNs), defined according to the local environment of colloidal particles derived from particle trajectory data. The LN-GNN framework is trained for unique categories of particle neighborhood environments in order to predict interparticle interactions. We compare the performance of the LN-GNN to a baseline interaction network with a simpler architecture and to an Instance-Based ML algorithm, which is computationally more expensive. We find that the prediction performance of LN-GNN measured as an average normalized mean absolute error outperforms the baseline interaction network by a factor of 2–10 for different local neighborhood configurations. Furthermore, LN-GNN’s performance turns out to be very comparable to the instance-based ML framework while being an order of magnitude less expensive in terms of the required computation time. The results of this work can provide the foundations for establishing accurate models of colloidal particle interactions that are derived from real particle trajectory data.more » « less
-
Abstract Rapid advancements in deep learning over the past decade have fueled an insatiable demand for efficient and scalable hardware. Photonics offers a promising solution by leveraging the unique properties of light. However, conventional neural network architectures, which typically require dense programmable connections, pose several practical challenges for photonic realizations. To overcome these limitations, we propose and experimentally demonstrate Photonic Neural Cellular Automata (PNCA) for photonic deep learning with sparse connectivity. PNCA harnesses the speed and interconnectivity of photonics, as well as the self-organizing nature of cellular automata through local interactions to achieve robust, reliable, and efficient processing. We utilize linear light interference and parametric nonlinear optics for all-optical computations in a time-multiplexed photonic network to experimentally perform self-organized image classification. We demonstrate binary (two-class) classification of images using as few as 3 programmable photonic parameters, achieving high experimental accuracy with the ability to also recognize out-of-distribution data. The proposed PNCA approach can be adapted to a wide range of existing photonic hardware and provides a compelling alternative to conventional photonic neural networks by maximizing the advantages of light-based computing whilst mitigating their practical challenges. Our results showcase the potential of PNCA in advancing photonic deep learning and highlights a path for next-generation photonic computers.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1039/D3SM00139C
