skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Harnessing Deep Learning of Point Clouds for Morphology Mimicking of Universal 3D Shape‐Morphing Devices
Shape‐morphing devices, a crucial branch in soft robotics, hold significant application value in areas like human–machine interfaces, biomimetic robotics, and tools for biological systems. To achieve 3D programmable shape morphing (PSM), the deployment of array‐based actuators is essential. However, a critical knowledge gap in 3D PSM is controlling the complex systems formed by these soft actuator arrays to mimic the morphology of the target shapes. This study, for the first time, represents the configuration of shape‐morphing devices using point cloud data and employing deep learning to map these configurations to control inputs. Shape Morphing Net (SMNet), a method that realizes the regression from point cloud to high‐dimensional control input vectors, is proposed. It has been applied to 3D PSM devices with three different actuator mechanisms, demonstrating its universal applicability to inversely reproduce the target shapes. Further, applied to previous 2D PSM devices, SMNet significantly enhances control precision from 82.23% to 97.68%. In the demonstrations of morphology mimicking, 3D PSM devices successfully replicate arbitrary target shapes obtained either through 3D scanning of physical objects or via 3D modeling software. The results show that within the deformable range of 3D PSM devices, accurate reproduction of the desired shapes is achievable.  more » « less
Award ID(s):
2301509
PAR ID:
10618572
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Wiley Advanced
Date Published:
Journal Name:
Advanced Intelligent Systems
ISSN:
2640-4567
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Miniature shape‐morphing soft actuators driven by external stimuli and fluidic pressure hold great promise in morphing matter and small‐scale soft robotics. However, it remains challenging to achieve both rich shape morphing and shape locking in a fast and controlled way due to the limitations of actuation reversibility and fabrication. Here, fully 3D‐printed, sub‐millimeter thin‐plate‐like miniature soft hydraulic actuators with shape memory effect (SME) for programable fast shape morphing and shape locking, are reported. It combines commercial high‐resolution multi‐material 3D printing of stiff shape memory polymers (SMPs) and soft elastomers and direct printing of microfluidic channels and 2D/3D channel networks embedded in elastomers in a single print run. Leveraging spatial patterning of hybrid compositions and expansion heterogeneity of microfluidic channel networks for versatile hydraulically actuated shape morphing, including circular, wavy, helical, saddle, and warping shapes with various curvatures, are demonstrated. The morphed shapes can be temporarily locked and recover to their original planar forms repeatedly by activating SME of the SMPs. Utilizing the fast shape morphing and locking in the miniature actuators, their potential applications in non‐invasive manipulation of small‐scale objects and fragile living organisms, multimodal entanglement grasping, and energy‐saving manipulators, are demonstrated. 
    more » « less
  2. Abstract Kirigami, a traditional paper cutting art, offers a promising strategy for 2D-to-3D shape morphing through cut-guided deformation. Existing kirigami designs for target 3D curved shapes rely on intricate cut patterns in thin sheets, making the inverse design challenging. Motivated by the Gauss-Bonnet theorem that correlates the geodesic curvature along the boundary with the Gaussian curvature, here, we exploit programming the curvature of cut boundaries rather than the complex cut patterns in kirigami sheets for target 3D curved morphologies through both forward and inverse designs. The strategy largely simplifies the inverse design. Leveraging this strategy, we demonstrate its potential applications as a universal and nondestructive gripper for delicate objects, including live fish, raw egg yolk, and a human hair, as well as dynamically conformable heaters for human knees. This study opens a new avenue to encode boundary curvatures for shape-programing materials with potential applications in soft robotics and wearable devices. 
    more » « less
  3. Abstract Shape‐morphing magnetic soft materials, composed of magnetic particles in a soft polymer matrix, can transform shape reversibly, remotely, and rapidly, finding diverse applications in actuators, soft robotics, and biomedical devices. To achieve on‐demand and sophisticated shape morphing, the manufacture of structures with complex geometry and magnetization distribution is highly desired. Here, a magnetic dynamic polymer (MDP) composite composed of hard‐magnetic microparticles in a dynamic polymer network with thermally responsive reversible linkages, which permits functionalities including targeted welding for magnetic‐assisted assembly, magnetization reprogramming, and permanent structural reconfiguration, is reported. These functions not only provide highly desirable structural and material programmability and reprogrammability but also enable the manufacturing of functional soft architected materials such as 3D kirigami with complex magnetization distribution. The welding of magnetic‐assisted modular assembly can be further combined with magnetization reprogramming and permanent reshaping capabilities for programmable and reconfigurable architectures and morphing structures. The reported MDP are anticipated to provide a new paradigm for the design and manufacture of future multifunctional assemblies and reconfigurable morphing architectures and devices. 
    more » « less
  4. In nature, animals with soft body parts demonstrate remarkable control over their shape, such as an elephant trunk wrapping around a tree branch to pick it up. However, most research on robotic manipulators focuses on controlling the end effector, partly because the manipulator’s arm is rigidly articulated. With recent advances in soft robotics research, controlling a soft manipulator into many different shapes will significantly improve the robot’s functionality, such as medical robots morphing their shape to navigate the digestive system and deliver drugs to specific locations. However, controlling the shape of soft robots is challenging due to their highly nonlinear dynamics that are computationally intensive. In this paper, we leverage a physics-informed, data-driven approach using the Koopman operator to realize the shape control of soft robots. We simulate the dynamics of a soft manipulator using a physics-based simulator (PyElastica) to generate the input-output data, which is then used to identify an approximated linear model based on the Koopman operator. We then formulate the shapecontrol problem as a convex optimization problem that is computationally efficient. Our linear model is over 12 times faster than the physics-based model in simulating the manipulator’s motion. Further, we can control a soft manipulator into different shapes using model predictive control. We envision that the proposed method can be effectively used to control the shapes of soft robots to interact with uncertain environments or enable shape-morphing robots to fulfill diverse tasks. 
    more » « less
  5. Abstract A new class of thin flexible structures is introduced that morph from flat into prescribed 3D shapes through strain mismatch between layers of a composite plate. To achieve control over the target shape, two different concepts are coupled. First, motivated by biological growth, strain mismatch is applied between the flat composite layers to transform it into a 3D shape. Depending on the amount of the applied strain mismatch, the transformation involves buckling into one of the available finite number of deformation modes. Second, inspired by kirigami, portions of the material are removed from one of the layers according to a specific pattern. This dramatically increases the number of possible 3D shapes and allows us to attain specific topologies. An experimental apparatus that allows precise control of the strain mismatch is devised. An inverse problem is posed, where starting from a given target shape, the physical parameters that make these shapes possible are determined. To show how the concept works, it focuses on circular composite plates and designs a kirigami pattern that yields a hemispherical structure. The analysis combines a theoretical approach with numerical simulations and physical experiments to understand and predict the shape transition from 2D to 3D. The tools developed here can be extended to attain arbitrary 3D shapes. The initially flat shape suggests that conventional additive manufacturing techniques can be used to functionalize the soft kirigami composite to fabricate, for example, deployable 3D structures, smart skins, and soft electromagnetic metasurfaces. 
    more » « less