Vision serves as an essential sensory input for insects but consumes substantial energy resources. The cost to support sensitive photoreceptors has led many insects to develop high visual acuity in only small retinal regions and evolve to move their visual systems independent of their bodies through head motion. By understanding the trade-offs made by insect vision systems in nature, we can design better vision systems for insect-scale robotics in a way that balances energy, computation, and mass. Here, we report a fully wireless, power-autonomous, mechanically steerable vision system that imitates head motion in a form factor small enough to mount on the back of a live beetle or a similarly sized terrestrial robot. Our electronics and actuator weigh 248 milligrams and can steer the camera over 60° based on commands from a smartphone. The camera streams “first person” 160 pixels–by–120 pixels monochrome video at 1 to 5 frames per second (fps) to a Bluetooth radio from up to 120 meters away. We mounted this vision system on two species of freely walking live beetles, demonstrating that triggering image capture using an onboard accelerometer achieves operational times of up to 6 hours with a 10–milliamp hour battery. We also built a small, terrestrial robot (1.6 centimeters by 2 centimeters) that can move at up to 3.5 centimeters per second, support vision, and operate for 63 to 260 minutes. Our results demonstrate that steerable vision can enable object tracking and wide-angle views for 26 to 84 times lower energy than moving the whole robot.
- Award ID(s):
- 1812554
- NSF-PAR ID:
- 10316302
- Date Published:
- Journal Name:
- Mobicon'20
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
Flying insects have elastic materials within their exoskeletons that could reduce the energetic cost of flight if their wingbeat frequency is matched to a mechanical resonance frequency. Flapping at resonance may be essential across flying insects because of the power demands of small-scale flapping flight. However, building up large-amplitude resonant wingbeats over many wingstrokes may be detrimental for control if the total mechanical energy in the spring-wing system exceeds the per-cycle work capacity of the flight musculature. While the mechanics of the insect flight apparatus can behave as a resonant system, the question of whether insects flap their wings at their resonant frequency remains unanswered. Using previous measurements of body stiffness in the hawkmoth, Manduca sexta , we develop a mechanical model of spring-wing resonance with aerodynamic damping and characterize the hawkmoth's resonant frequency. We find that the hawkmoth's wingbeat frequency is approximately 80% above resonance and remains so when accounting for uncertainty in model parameters. In this regime, hawkmoths may still benefit from elastic energy exchange while enabling control of aerodynamic forces via frequency modulation. We conclude that, while insects use resonant mechanics, tuning wingbeats to a simple resonance peak is not a necessary feature for all centimetre-scale flapping flyers.more » « less
-
Assessing the ecological and economic impacts of non-native species is crucial to providing managers and policymakers with the information necessary to respond effectively. Most non-native species have minimal impacts on the environment in which they are introduced, but a small fraction are highly deleterious. The definition of ‘damaging’ or ‘high-impact’ varies based on the factors determined to be valuable by an individual or group, but interpretations of whether non-native species meet particular definitions can be influenced by the interpreter’s bias or level of expertise, or lack of group consensus. Uncertainty or disagreement about an impact classification may delay or otherwise adversely affect policymaking on management strategies. One way to prevent these issues would be to have a detailed, nine-point impact scale that would leave little room for interpretation and then divide the scale into agreed upon categories, such as low, medium, and high impact. Following a previously conducted, exhaustive search regarding non-native, conifer-specialist insects, the authors independently read the same sources and scored the impact of 41 conifer-specialist insects to determine if any variation among assessors existed when using a detailed impact scale. Each of the authors, who were selected to participate in the working group associated with this study because of their diverse backgrounds, also provided their level of expertise and uncertainty for each insect evaluated. We observed 85% congruence in impact rating among assessors, with 27% of the insects having perfect inter-rater agreement. Variance in assessment peaked in insects with a moderate impact level, perhaps due to ambiguous information or prior assessor perceptions of these specific insect species. The authors also participated in a joint fact-finding discussion of two insects with the most divergent impact scores to isolate potential sources of variation in assessor impact scores. We identified four themes that could be experienced by impact assessors: ambiguous information, discounted details, observed versus potential impact, and prior knowledge. To improve consistency in impact decision-making, we encourage groups to establish a detailed scale that would allow all observed and published impacts to fall under a particular score, provide clear, reproducible guidelines and training, and use consensus-building techniques when necessary.more » « less
-
more » « less
Precise form-fitting of prosthetic sockets is important for the comfort and well-being of persons with limb amputations. Capabilities for continuous monitoring of pressure and temperature at the skin-prosthesis interface can be valuable in the fitting process and in monitoring for the development of dangerous regions of increased pressure and temperature as limb volume changes during daily activities. Conventional pressure transducers and temperature sensors cannot provide comfortable, irritation-free measurements because of their relatively rigid construction and requirements for wired interfaces to external data acquisition hardware. Here, we introduce a millimeter-scale pressure sensor that adopts a soft, three-dimensional design that integrates into a thin, flexible battery-free, wireless platform with a built-in temperature sensor to allow operation in a noninvasive, imperceptible fashion directly at the skin-prosthesis interface. The sensor system mounts on the surface of the skin of the residual limb, in single or multiple locations of interest. A wireless reader module attached to the outside of the prosthetic socket wirelessly provides power to the sensor and wirelessly receives data from it, for continuous long-range transmission to a standard consumer electronic device such as a smartphone or tablet computer. Characterization of both the sensor and the system, together with theoretical analysis of the key responses, illustrates linear, accurate responses and the ability to address the entire range of relevant pressures and to capture skin temperature accurately, both in a continuous mode. Clinical application in two prosthesis users demonstrates the functionality and feasibility of this soft, wireless system.
-
Devices that can morph their functions on demand provide a rich yet unexplored paradigm for the next generation of electronic devices and sensors. For example, an antenna that can morph its shape can be used to adapt communication to different wireless standards or improve wireless signal reception. We utilize temperature-sensitive shape memory alloys (SMA) to realize a shape morphing antenna (ShMoA). In the designed architecture, multiple conjoined shape memory alloy sections form the antenna. The shape morphing of this antenna is achieved through temperature control. Different temperature threshold levels are used for programming the shape. Besides its conventional use for RF applications, ShMoA can serve as a multi-level temperature sensor, analogous to thermoreceptors in an insect antenna. ShMoA essentially combines the function of temperature sensing, embedded computing for detection of threshold crossings, and radio frequency readout, all in the single construct of a shape-morphing antenna (ShMoA) without the need for any battery or peripheral electronics. The ShMoA can be employed as bio-inspired wireless temperature sensing antennae on mobile robotic flies, insects, drones and other robots. It can also be deployed as programmable antennas for multi-standard wireless communication.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3372224.3419981
