skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Measuring compound eye optics with microscope and microCT images
Abstract With a great variety of shapes and sizes, compound eye morphologies give insight into visual ecology, development, and evolution, and inspire novel engineering. In contrast to our own camera-type eyes, compound eyes reveal their resolution, sensitivity, and field of view externally, provided they have spherical curvature and orthogonal ommatidia. Non-spherical compound eyes with skewed ommatidia require measuring internal structures, such as with MicroCT (µCT). Thus far, there is no efficient tool to characterize compound eye optics, from either 2D or 3D data, automatically. Here we present two open-source programs: (1) the ommatidia detecting algorithm (ODA), which measures ommatidia count and diameter in 2D images, and (2) a µCT pipeline (ODA-3D), which calculates anatomical acuity, sensitivity, and field of view across the eye by applying the ODA to 3D data. We validate these algorithms on images, images of replicas, and µCT eye scans from ants, fruit flies, moths, and a bee.  more » « less
Award ID(s):
1750833 1557007
PAR ID:
10402483
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Communications Biology
Volume:
6
Issue:
1
ISSN:
2399-3642
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract BackgroundInsects have evolved complex visual systems and display an astonishing range of adaptations for diverse ecological niches. Species ofDrosophila melanogastersubgroup exhibit extensive intra- and interspecific differences in compound eye size. These differences provide an excellent opportunity to better understand variation in insect eye structure and the impact on vision. Here we further explored the difference in eye size betweenD. mauritianaand its sibling speciesD. simulans. ResultsWe confirmed thatD. mauritianahave rapidly evolved larger eyes as a result of more and wider ommatidia thanD. simulanssince they recently diverged approximately 240,000 years ago. The functional impact of eye size, and specifically ommatidia size, is often only estimated based on the rigid surface morphology of the compound eye. Therefore, we used 3D synchrotron radiation tomography to measure optical parameters in 3D, predict optical capacity, and compare the modelled vision to in vivo optomotor responses. Our optical models predicted higher contrast sensitivity forD. mauritiana, which we verified by presenting sinusoidal gratings to tethered flies in a flight arena. Similarly, we confirmed the higher spatial acuity predicted forDrosophila simulanswith smaller ommatidia and found evidence for higher temporal resolution. ConclusionsOur study demonstrates that even subtle differences in ommatidia size between closely relatedDrosophilaspecies can impact the vision of these insects. Therefore, further comparative studies of intra- and interspecific variation in eye morphology and the consequences for vision among otherDrosophilaspecies, other dipterans and other insects are needed to better understand compound eye structure–function and how the diversification of eye size, shape, and function has helped insects to adapt to the vast range of ecological niches. 
    more » « less
  2. Abstract The vision system of arthropods such as insects and crustaceans is based on the compound-eye architecture, consisting of a dense array of individual imaging elements (ommatidia) pointing along different directions. This arrangement is particularly attractive for imaging applications requiring extreme size miniaturization, wide-angle fields of view, and high sensitivity to motion. However, the implementation of cameras directly mimicking the eyes of common arthropods is complicated by their curved geometry. Here, we describe a lensless planar architecture, where each pixel of a standard image-sensor array is coated with an ensemble of metallic plasmonic nanostructures that only transmits light incident along a small geometrically-tunable distribution of angles. A set of near-infrared devices providing directional photodetection peaked at different angles is designed, fabricated, and tested. Computational imaging techniques are then employed to demonstrate the ability of these devices to reconstruct high-quality images of relatively complex objects. 
    more » « less
  3. Arthropods’ eyes are effective biological vision systems for object tracking and wide field of view because of their structural uniqueness; however, unlike mammalian eyes, they can hardly acquire the depth information of a static object because of their monocular cues. Therefore, most arthropods rely on motion parallax to track the object in three-dimensional (3D) space. Uniquely, the praying mantis (Mantodea) uses both compound structured eyes and a form of stereopsis and is capable of achieving object recognition in 3D space. Here, by mimicking the vision system of the praying mantis using stereoscopically coupled artificial compound eyes, we demonstrated spatiotemporal object sensing and tracking in 3D space with a wide field of view. Furthermore, to achieve a fast response with minimal latency, data storage/transportation, and power consumption, we processed the visual information at the edge of the system using a synaptic device and a federated split learning algorithm. The designed and fabricated stereoscopic artificial compound eye provides energy-efficient and accurate spatiotemporal object sensing and optical flow tracking. It exhibits a root mean square error of 0.3 centimeter, consuming only approximately 4 millijoules for sensing and tracking. These results are more than 400 times lower than conventional complementary metal-oxide semiconductor–based imaging systems. Our biomimetic imager shows the potential of integrating nature’s unique design using hardware and software codesigned technology toward capabilities of edge computing and sensing. 
    more » « less
  4. Astonishing functional diversity exists among arthropod eyes, yet eye development relies on deeply conserved genes. This phenomenon is best understood for early events, whereas fewer investigations have focused on the influence of later transcriptional regulators on diverse eye organizations and the contribution of critical support cells, such as Semper cells (SCs). As SCs in Drosophila melanogaster secrete the lens and function as glia, they are critical components of ommatidia. Here, we perform RNAi-based knockdowns of the transcription factor cut (CUX in vertebrates), a marker of SCs, the function of which has remained untested in these cell types. To probe for the conserved roles of cut , we investigate two optically different compound eyes: the apposition optics of D. melanogaster and the superposition optics of the diving beetle Thermonectus marmoratus . In both cases, we find that multiple aspects of ocular formation are disrupted, including lens facet organization and optics as well as photoreceptor morphogenesis. Together, our findings support the possibility of a generalized role for SCs in arthropod ommatidial form and function and introduces Cut as a central player in mediating this role. 
    more » « less
  5. The Drosophila eye is an outstanding model system for exploring fundamental mechanisms of growth and development. The adult eye is composed of a perfect hexagonal lattice of ∼750 unit eyes, or ommatidia, each containing precisely 20 well-characterized cells. The eye develops from the eye/antennal imaginal disc, a flattened epithelial sac. During larval and pupal development, cells in the disc grow and undergo compartmentalisation, cell cycle arrest, differentiation, directed movement, and apoptosis, all utilising gene networks and signalling pathways similar to those in vertebrates. The genetic accessibility of Drosophila, together with the precision of eye development, makes the fly retina an extremely useful system with which to investigate the roles of genes and signalling pathways in development. 
    more » « less