skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Design and Evaluation of Human-Machine Interface for NEXUS: A Custom Microassembly System
Microassembly systems utilizing precision robotics have long been used for realizing 3-dimensional microstructures such as microrobots. Prior to assembly, such components are fabricated using Micro-Electro-Mechanical-System (MEMS) technology. The microassembly system then directs a microgripper through automated or human-controlled pick-and-place operations. In this paper, we describe a novel custom microassembly system, named NEXUS. The NEXUS integrates multi-degree of freedom (DOF) precision positioners, microscope computer vision, and micro-scale process tools such as a microgripper and vacuum tip. A semi-autonomous human-machine interface (HMI) is programmed by NI LabVIEW® to allow the operator to interact with the microassembly system. The NEXUS human-machine interface includes multiple functions, such as positioning, target detection, visual servoing, and inspection. The microassembly system’s HMI was used by operators to assemble various 3-dimensional microrobots such as the Solarpede, a novel light-powered stick-and-slip mobile microcrawler. Experimental results are reported in this paper that evaluate the system’s semi-autonomous capabilities in terms of assembly rate and yield and compare them to purely teleoperated assembly performance. Results show that the semi-automated capabilities of the microassembly system’s HMI offer a more consistent assembly rate of microrobot components.  more » « less
Award ID(s):
1828355 1734383
PAR ID:
10310565
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
14th International Conference on Micro- and Nanosystems (MNS)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Microassembly systems utilizing precision robotics have long been used for realizing three-dimensional microstructures such as microsystems and microrobots. Prior to assembly, microscale components are fabricated using micro-electromechanical-system (MEMS) technology. The microassembly system then directs a microgripper through a series of automated or human-controlled pick-and-place operations. In this paper, we describe a novel custom microassembly system, named NEXUS, that can be used to prototype MEMS microrobots. The NEXUS integrates multi-degrees-of-freedom (DOF) precision positioners, microscope computer vision, and microscale process tools such as a microgripper and vacuum tip. A semi-autonomous human–machine interface (HMI) was programmed to allow the operator to interact with the microassembly system. The NEXUS human–machine interface includes multiple functions, such as positioning, target detection, visual servoing, and inspection. The microassembly system's HMI was used by operators to assemble various three-dimensional microrobots such as the Solarpede, a novel light-powered stick-and-slip mobile microcrawler. Experimental results are reported in this paper to evaluate the system's semi-autonomous capabilities in terms of assembly rate and yield and compare them to purely teleoperated assembly performance. Results show that the semi-automated capabilities of the microassembly system's HMI offer a more consistent assembly rate of microrobot components and are less reliant on the operator's experience and skill. 
    more » « less
  2. This paper presents our work over the last decade in developing functional microrobotic systems, which include wireless actuation of microrobots to traverse complex surfaces, addition of sensing capabilities, and independent actuation of swarms of microrobots. We will discuss our work on the design, fabrication, and testing of a number of different mobile microrobots that are able to achieve these goals. These microrobots include the microscale magnetorestrictive asymmetric bimorph microrobot ( μ MAB), our first attempt at magnetic actuation in the microscale; the microscale tumbling microrobot ( μ TUM), our microrobot capable of traversing complex surfaces in both wet and dry conditions; and the micro-force sensing magnetic microrobot ( μ FSMM), which is capable of real-time micro-force sensing feedback to the user as well as intuitive wireless actuation. Additionally, we will present our latest results on using local magnetic field actuation for independent control of multiple microrobots in the same workspace for microassembly tasks. 
    more » « less
  3. The awareness of individuals’ biological status is critical for creating interactive and adaptive environments that can actively assist the users to achieve optimal outcomes. Accordingly, specialized human–machine interfaces—equipped with bioperception and interpretation capabilities—are required. To this end, we devised a multimodal cryptographic bio-human–machine interface (CB-HMI), which seamlessly translates the user’s touch-based entries into encrypted biochemical, biophysical, and biometric indices. As its central component, the CB-HMI features thin hydrogel-coated chemical sensors and inference algorithms to noninvasively and inconspicuously acquire biochemical indices such as circulating molecules that partition onto the skin (here, ethanol and acetaminophen). Additionally, the CB-HMI hosts physical sensors and associated algorithms to simultaneously acquire the user’s heart rate, blood oxygen level, and fingerprint minutiae pattern. Supported by human subject studies, we demonstrated the CB-HMI’s capability in terms of acquiring physiologically relevant readouts of target bioindices, as well as user-identifying and biometrically encrypting/decrypting these indices in situ (leveraging the fingerprint feature). By upgrading the common surrounding objects with the CB-HMI, we created interactive solutions for driving safety and medication use. Specifically, we demonstrated a vehicle-activation system and a medication-dispensing system, where the integrated CB-HMI uniquely enabled user bioauthentication (on the basis of the user’s biological state and identity) prior to rendering the intended services. Harnessing the levels of bioperception achieved by the CB-HMI and other intelligent HMIs, we can equip our surroundings with a comprehensive and deep awareness of individuals’ psychophysiological state and needs. 
    more » « less
  4. Recent advances in precision manufacturing technology and a thorough understanding of the properties of piezoelectric materials have made it possible for researchers to develop innovative microrobotic systems, which draw more attention to the challenges of utilizing microrobots in areas that are inaccessible to ordinary robots. This review paper provides an overview of the recent advances in the application of piezoelectric materials in microrobots. The challenges of microrobots in the direction of autonomy are categorized into four sections: mechanisms, power, sensing, and control. In each section, innovative research ideas are presented to inspire researchers in their prospective microrobot designs according to specific applications. Novel mechanisms for the mobility of piezoelectric microrobots are reviewed and described. Additionally, as the piezoelectric micro-actuators require high-voltage electronics and onboard power supplies, we review ways of energy harvesting technology and lightweight micro-sensing mechanisms that contain piezoelectric devices to provide feedback, facilitating the use of control strategies to achieve the autonomous untethered movement of microrobots. 
    more » « less
  5. In this paper, we propose a method for tracking a microrobot’s three-dimensional position using microscope machine vision. The microrobot, theSolid Articulated Four Axis Microrobot (sAFAM), is being developed to enable the assembly and manipulation of micro and nanoscale objects. In the future, arrays of sAFAMS working together can be integrated into a wafer-scale nanofactory, Prior to use, microrobots in this microfactory need calibration, which can be achieved using the proposed measurement technique. Our approach enables faster and more accurate mapping of microrobot translations and rotations, and orders of magnitude larger datasets can be created by automation. Cameras feeds on a custom microscopy system is fed into a data processing pipeline that enables tracking of the microrobot in real-time. This particular machine vision method was implemented with a help of OpenCV and Python and can be used to track the movement of other micrometer-sized features. Additionally, a script was created to enable automated repeatability tests for each of the six trajectories traversable by the robot. A more precise microrobot workable area was also determined thanks to the significantly larger datasets enabled by the combined automation and machine vision approaches. Keywords: Micro robotics, machine vision, nano microscale manufacturing. 
    more » « less