Procedural modeling is now the de facto standard of material modeling in industry. Procedural models can be edited and are easily extended, unlike pixel-based representations of captured materials. In this article, we present a semi-automatic pipeline for general material proceduralization. Given Spatially Varying Bidirectional Reflectance Distribution Functions (SVBRDFs) represented as sets of pixel maps, our pipeline decomposes them into a tree of sub-materials whose spatial distributions are encoded by their associated mask maps. This semi-automatic decomposition of material maps progresses hierarchically, driven by our new spectrum-aware material matting and instance-based decomposition methods. Each decomposed sub-material is proceduralized by a novel multi-layer noise model to capture local variations at different scales. Spatial distributions of these sub-materials are modeled either by a by-example inverse synthesis method recovering Point Process Texture Basis Functions (PPTBF) [ 30 ] or via random sampling. To reconstruct procedural material maps, we propose a differentiable rendering-based optimization that recomposes all generated procedures together to maximize the similarity between our procedural models and the input material pixel maps. We evaluate our pipeline on a variety of synthetic and real materials. We demonstrate our method’s capacity to process a wide range of material types, eliminating the need for artist designed material graphs required in previous work [ 38 , 53 ]. As fully procedural models, our results expand to arbitrary resolution and enable high-level user control of appearance.
more »
« less
Controlling Material Appearance by Examples
Despite the ubiquitous use of materials maps in modern rendering pipelines, their editing and control remains a challenge. In this paper, we present an example‐based material control method to augment input material maps based on user‐provided material photos. We train a tileable version of MaterialGAN and leverage its material prior to guide the appearance transfer, optimizing its latent space using differentiable rendering. Our method transfers the micro and meso‐structure textures of user provided target(s) photographs, while preserving the structure and quality of the input material. We show our methods can control existing material maps, increasing realism or generating new, visually appealing materials.
more » « less- Award ID(s):
- 2007283
- NSF-PAR ID:
- 10444115
- Publisher / Repository:
- Wiley-Blackwell
- Date Published:
- Journal Name:
- Computer Graphics Forum
- Volume:
- 41
- Issue:
- 4
- ISSN:
- 0167-7055
- Page Range / eLocation ID:
- p. 117-128
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Controlling the deformation of a soft body has potential applications in fields requiring precise control over the shape of the body. Areas such as medical robotics can use the shape control of soft robots to repair aneurysms in humans, deliver medicines within the body, among other applications. However, given known external loading, it is usually not possible to deform a soft body into arbitrary shapes if it is fabricated using only a single material. In this work, we propose a new physics-based method for the computational design of soft hyperelastic bodies to address this problem. The method takes as input an undeformed shape of a body, a specified external load, and a user desired final shape. It then solves an inverse problem in design using nonlinear optimization subject to physics constraints. The nonlinear program is solved using a gradient-based interior-point method. Analytical gradients are computed for efficiency. The method outputs fields of material properties which can be used to fabricate a soft body. A body fabricated to match this material field is expected to deform into a user-desired shape, given the same external loading input. Two regularizers are used to ascribe
a priori characteristics of smoothness and contrast, respectively, to the spatial distribution of material fields. The performance of the method is tested on three example cases in silico. -
Umetani, N. ; Wojtan, C. ; Vouga, E. (Ed.)Most non-photorealistic rendering (NPR) methods for line drawing synthesis operate on a static shape. They are not tailored to process animated 3D models due to extensive per-frame parameter tuning needed to achieve the intended look and natural transition. This paper introduces a framework for interactive line drawing synthesis from animated 3D models based on a learned style space for drawing representation and interpolation. We refer to style as the relationship between stroke placement in a line drawing and its corresponding geometric properties. Starting from a given sequence of an animated 3D character, a user creates drawings for a set of keyframes. Our system embeds the raster drawings into a latent style space after they are disentangled from the underlying geometry. By traversing the latent space, our system enables a smooth transition between the input keyframes. The user may also edit, add, or remove the keyframes interactively, similar to a typical keyframe-based workflow. We implement our system with deep neural networks trained on synthetic line drawings produced by a combination of NPR methods. Our drawing-specific supervision and optimization-based embedding mechanism allow generalization from NPR line drawings to user-created drawings during run time. Experiments show that our approach generates high-quality line drawing animations while allowing interactive control of the drawing style across frames.more » « less
-
more » « less
Abstract Histological staining is a vital step in diagnosing various diseases and has been used for more than a century to provide contrast in tissue sections, rendering the tissue constituents visible for microscopic analysis by medical experts. However, this process is time consuming, labour intensive, expensive and destructive to the specimen. Recently, the ability to virtually stain unlabelled tissue sections, entirely avoiding the histochemical staining step, has been demonstrated using tissue-stain-specific deep neural networks. Here, we present a new deep-learning-based framework that generates virtually stained images using label-free tissue images, in which different stains are merged following a micro-structure map defined by the user. This approach uses a single deep neural network that receives two different sources of information as its input: (1) autofluorescence images of the label-free tissue sample and (2) a “digital staining matrix”, which represents the desired microscopic map of the different stains to be virtually generated in the same tissue section. This digital staining matrix is also used to virtually blend existing stains, digitally synthesizing new histological stains. We trained and blindly tested this virtual-staining network using unlabelled kidney tissue sections to generate micro-structured combinations of haematoxylin and eosin (H&E), Jones’ silver stain, and Masson’s trichrome stain. Using a single network, this approach multiplexes the virtual staining of label-free tissue images with multiple types of stains and paves the way for synthesizing new digital histological stains that can be created in the same tissue cross section, which is currently not feasible with standard histochemical staining methods.
-
Purpose AlSi10Mg alloy is commonly used in laser powder bed fusion due to its printability, relatively high thermal conductivity, low density and good mechanical properties. However, the thermal conductivity of as-built materials as a function of processing (energy density, laser power, laser scanning speed, support structure) and build orientation, are not well explored in the literature. This study aims to elucidate the relationship between processing, microstructure, and thermal conductivity. Design/methodology/approach The thermal conductivity of laser powder bed fusion (L-PBF) AlSi10Mg samples are investigated by the flash diffusivity and frequency domain thermoreflectance (FDTR) techniques. Thermal conductivities are linked to the microstructure of L-PBF AlSi10Mg, which changes with processing conditions. The through-plane exceeded the in-plane thermal conductivity for all energy densities. A co-located thermal conductivity map by frequency domain thermoreflectance (FDTR) and crystallographic grain orientation map by electron backscattered diffraction (EBSD) was used to investigate the effect of microstructure on thermal conductivity. Findings The highest through-plane thermal conductivity (136 ± 2 W/m-K) was achieved at 59 J/mm 3 and exceeded the values reported previously. The in-plane thermal conductivity peaked at 117 ± 2 W/m-K at 50 J/mm 3 . The trend of thermal conductivity reducing with energy density at similar porosity was primarily due to the reduced grain size producing more Al-Si interfaces that pose thermal resistance. At these interfaces, thermal energy must convert from electrons in the aluminum to phonons in the silicon. The co-located thermal conductivity and crystallographic grain orientation maps confirmed that larger colonies of columnar grains have higher thermal conductivity compared to smaller columnar grains. Practical implications The thermal properties of AlSi10Mg are crucial to heat transfer applications including additively manufactured heatsinks, cold plates, vapor chambers, heat pipes, enclosures and heat exchangers. Additionally, thermal-based nondestructive testing methods require these properties for applications such as defect detection and simulation of L-PBF processes. Industrial standards for L-PBF processes and components can use the data for thermal applications. Originality/value To the best of the authors’ knowledge, this paper is the first to make coupled thermal conductivity maps that were matched to microstructure for L-PBF AlSi10Mg aluminum alloy. This was achieved by a unique in-house thermal conductivity mapping setup and relating the data to local SEM EBSD maps. This provides the first conclusive proof that larger grain sizes can achieve higher thermal conductivity for this processing method and material system. This study also shows that control of the solidification can result in higher thermal conductivity. It was also the first to find that the build substrate (with or without support) has a large effect on thermal conductivity.more » « less
