Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 5:00 PM ET until 8:00 PM ET on Friday, September 11 due to maintenance. We apologize for the inconvenience.


This content will become publicly available on July 19, 2027

Title: Dronevision, Holodecks, and Spatial Computing Using Flying Light Specks
This SIGGRAPH 2026 Frontiers workshop discusses Flying Light Specks (FLSs), their application use cases, current status, and future research directions. An FLS is a miniature drone equipped with a lighting apparatus. It is a building block of next-generation displays, ranging from desktop Dronevision (DV) systems to room-sized holodecks and outdoor spatial-computing environments. Swarms of FLSs will illuminate graphics and animations visible to the naked eye, allowing users to interact with them using their bare hands. This workshop describes the emerging technology behind this exciting area of research. Topics include a classification of FLS devices with LightBender and its 2D lighting apparatus as an example, an end-to-end architecture from content generation to illumination and interaction, physicalization of virtual objects for bare-hand interaction, and a monitoring environment to evaluate and refine the quality of user experience while ensuring their safety. This visionary workshop articulates how these technologies will be used to realize DVs, holodecks, and spatial computing. It describes the use of complementary technologies that realize the vision of these systems. An example is HoloTiles by Lanny Smoot, SIGGRAPH 2026 keynote speaker, as the flooring of a holodeck. More generally, we examine robots of varying forms, morphologies, and functions in relation to DV, holodecks, and spatial computing. This workshop is the prelude to the Third International Conference on Holodecks that takes place on the campus of the University of Southern California on July 24, 2026. The conference includes a tour of our Fly lab with hands-on experience using our authoring tools, FLSs, and illuminations.  more » « less
Award ID(s):
2425754 2232382
PAR ID:
10695947
Author(s) / Creator(s):
Publisher / Repository:
ACM
Date Published:
ISBN:
9798400725531
Page Range / eLocation ID:
1 to 3
Subject(s) / Keyword(s):
Flying Light Specks Dronevision Holodecks Spatial Computing
Format(s):
Medium: X
Location:
Los Angeles CA USA
Sponsoring Org:
National Science Foundation
More Like this
  1. Authoring tools typically convert 3D animation data into 2D rasterized formats for display, a process that imposes computational burdens, degrades depth fidelity, and complicates the recovery of original 3D information. This paper presents the first known direct integration of Blender, a widely used 3D animation tool, with Dronevision (DV), a 3D multimedia display composed of synchronized Flying Light Specks (FLSs). In addition to raster-based pipelines, this integration enables real-time, high-fidelity illumination of 3D animations directly in physical space. Our system leverages Blender’s piecewise animation model—comprising manually placed keyframes and mathematically defined interpolation functions—to generate spatiotemporal trajectories that are mapped to the motion of autonomous FLS drones. We introduce the concept of a display clock that is maintained by each FLS and synchronized across all FLSs using a broadcast based protocol. Our techniques have a fixed complexity independent of the number of FLSs. They enable a DV to scale to millions and billions of FLSs. 
    more » « less
  2. This paper presents the design and implementation of a circular flight pattern for use by a 3D multimedia display, a Dronevision (DV). A DV uses drones configured with light sources, Flying Light Specks (FLSs), that are battery powered. The flight pattern enables a swarm of FLSs to enter an opening, granting them access to the charging coils to charge their batteries. We present two algorithms for an FLS to travel from its current coordinate to rendezvous with its assigned slot on the flight pattern, Shortest Distance (SD) and Fastest Rendezvous Time (FRT). In addition to quantifying the tradeoff associated with these algorithms, we present an implementation using a swarm of Crazyflie drones with Vicon localization. 
    more » « less
  3. Ghandeharizadeh S. (Ed.)
    Swarm-Merging, SwarMer, is a decentralized framework to localize Flying Light Specks (FLSs) to render 2D and 3D shapes. An FLS is a miniature sized drone equipped with one or more light sources to generate different colors and textures with adjustable brightness. It is battery powered, network enabled with storage and processing capability to implement a decentralized algorithm such as SwarMer. An FLS is unable to render a shape by itself. SwarMer uses the inter-FLS relationship effect of its organizational framework to compensate for the simplicity of each individual FLS, enabling a swarm of cooperating FLSs to render complex shapes. SwarMer is resilient to network packet loss, FLSs failing, and FLSs leaving to charge their battery. It is fast, highly accurate, and scales to remain effective when a shape consists of a large number of FLSs. 
    more » « less
  4. Ghandeharizadeh S. (Ed.)
    Today's robotic laboratories for drones are housed in a large room. At times, they are the size of a warehouse. These spaces are typically equipped with permanent devices to localize the drones, e.g., Vicon Infrared cameras. Significant time is invested to fine-tune the localization apparatus to compute and control the position of the drones. One may use these laboratories to develop a 3D multimedia system with miniature sized drones configured with light sources. As an alternative, this brave new idea paper envisions shrinking these room-sized laboratories to the size of a cube or cuboid that sits on a desk and costs less than 10K dollars. The resulting Dronevision (DV) will be the size of a 1990s Television. In addition to light sources, its Flying Light Specks (FLSs) will be network-enabled drones with storage and processing capability to implement decentralized algorithms. The DV will include a localization technique to expedite development of 3D displays. It will act as a haptic interface for a user to interact with and manipulate the 3D virtual illuminations. It will empower an experimenter to design, implement, test, debug, and maintain software and hardware that realize novel algorithms in the comfort of their office without having to reserve a laboratory. In addition to enhancing productivity, it will improve safety of the experimenter by minimizing the likelihood of accidents. This paper introduces the concept of a DV, the research agenda one may pursue using this device, and our plans to realize one. 
    more » « less
  5. We intend to host the workshop at the EDM 2026 conference. There is a growing community of researchers at the intersection of data mining, AI, and computing education research. The objective of the CSEDM workshop is to facilitate a discussion among this research community, with a focus on how data mining can be uniquely applied in computing education research. For example, what new techniques are needed to analyze program code and CS log data? How can theoretical and empirical insights from computing education research inform the design, interpretation, and validation of data mining models? The workshop is meant to be an interdisciplinary event at the intersection of EDM and Computing Education Research. Researchers, faculty, and students are encouraged to share their AI- and data-driven methodologies, analytical frameworks, and empirical findings that demonstrate how data transforms and deepen out understanding of how students learn Computer Science (CS) skills. This full-day workshop will feature paper presentations and discussions to foster cross-disciplinary exchange and future partnerships. 
    more » « less