Search for: All records

Low-latency and low-power edge AI is crucial for Virtual Reality and Augmented Reality applications. Recent advances demonstrate that hybrid models, combining convolution layers (CNN) and transformers (ViT), often achieve a superior accuracy/performance tradeoff on various computer vision and machine learning (ML) tasks. However, hybrid ML models can present system challenges for latency and energy efficiency due to their diverse nature in dataflow and memory access patterns. In this work, we leverage architecture heterogeneity from Neural Processing Units (NPU) and Compute-In-Memory (CIM) and explore diverse execution schemas to efficiently execute these hybrid models. We introduce H4H-NAS, a two-stage Neural Architecture Search (NAS) framework to automate the design of efficient hybrid CNN/ViT models for heterogeneous edge systems featuring both NPU and CIM. We propose a two-phase incremental supernet training in our NAS framework to resolve gradient conflicts between sampled subnets caused by different types of blocks in a hybrid model search space. Our H4H-NAS approach is also powered by a performance estimator built with NPU performance results measured on real silicon, and CIM performance based on industry IPs. H4H-NAS searches hybrid CNN-ViT models with fine granularity and achieves significant (up to 1.34%) top-1 accuracy improvement on ImageNet. Moreover, results from our algorithm/hardware co-design reveal up to 56.08% overall latency and 41.72% energy improvements by introducing heterogeneous computing over baseline solutions. Overall, our framework guides the design of hybrid network architectures and system architectures for NPU+CIM heterogeneous systems. 

The “Histidine-brace” (His-brace) copper-binding site, composed of Cu(His)₂with a backbone amine, is found in metalloproteins with diverse functions. A primary example is lytic polysaccharide monooxygenase (LPMO), a class of enzymes that catalyze the oxidative depolymerization of polysaccharides, providing not only an energy source for native microorganisms but also a route to more effective industrial biomass conversion. Despite its importance, how the Cu His-brace site performs this unique and challenging oxidative depolymerization reaction remains to be understood. To answer this question, we have designed a biosynthetic model of LPMO by incorporating the Cu His-brace motif into azurin, an electron transfer protein. Spectroscopic studies, including ultraviolet-visible (UV–Vis) absorption and electron paramagnetic resonance, confirm copper binding at the designed His-brace site. Moreover, the designed protein is catalytically active towards both cellulose and starch, the native substrates of LPMO, generating degraded oligosaccharides with multiturnovers by C1 oxidation. It also performs oxidative cleavage of the model substrate 4-nitrophenyl-D-glucopyranoside, achieving a turnover number ~9% of that of a native LPMO assayed under identical conditions. This work presents a rationally designed artificial metalloenzyme that acts as a structural and functional mimic of LPMO, which provides a promising system for understanding the role of the Cu His-brace site in LPMO activity and potential application in polysaccharide degradation. 

In this work, we develop a new set of Bayesian models to perform registration of real-valued functions. A Gaussian process prior is assigned to the parameter space of time warping functions, and a Markov chain Monte Carlo (MCMC) algorithm is utilized to explore the posterior distribution. While the proposed model can be defined on the infinite-dimensional function space in theory, dimension reduction is needed in practice because one cannot store an infinite-dimensional function on the computer. Existing Bayesian models often rely on some pre-specified, fixed truncation rule to achieve dimension reduction, either by fixing the grid size or the number of basis functions used to represent a functional object. In comparison, the new models in this paper randomize the truncation rule. Benefits of the new models include the ability to make inference on the smoothness of the functional parameters, a data-informative feature of the truncation rule, and the flexibility to control the amount of shape-alteration in the registration process. For instance, using both simulated and real data, we show that when the observed functions exhibit more local features, the posterior distribution on the warping functions automatically concentrates on a larger number of basis functions. Supporting materials including code and data to perform registration and reproduce some of the results presented herein are available online. 

Evaluation of Gastrointestinal Stromal Tumors (GIST) during initial clinical staging, surgical intervention, and postoperative management can be challenging. Current imaging modalities ( e.g. , PET and CT scans) lack sensitivity and specificity. Therefore, advanced clinical imaging modalities that can provide clinically relevant images with high resolution would improve diagnosis. KIT is a tyrosine kinase receptor overexpressed on GIST. Here, the application of a specific DNA aptamer targeting KIT, decorated onto a fluorescently labeled porous silicon nanoparticle (pSiNP), is used for the in vitro & in vivo imaging of GIST. This nanoparticle platform provides high-fidelity GIST imaging with minimal cellular toxicity. An in vitro analysis shows greater than 15-fold specific KIT protein targeting compared to the free KIT aptamer, while in vivo analyses of GIST-burdened mice that had been injected intravenously (IV) with aptamer-conjugated pSiNPs show extensive nanoparticle-to-tumor signal co-localization (>90% co-localization) compared to control particles. This provides an effective platform for which aptamer-conjugated pSiNP constructs can be used for the imaging of KIT-expressing cancers or for the targeted delivery of therapeutics.