skip to main content


Title: ARrow: A Real-Time AR Rowing Coach
Rowing requires physical strength and endurance in athletes as well as a precise rowing technique. The ideal rowing stroke is based on biomechanical principles and typically takes years to master. Except for time-consuming video analysis after practice, coaches currently have no means to quantitatively analyze a rower’s stroke sequence and body movement. We propose ARrow, an AR application for coaches and athletes that provides real-time and situated feedback on a rower’s body position and stroke. We use computer vision techniques to extract the rower’s 3D skeleton and to detect the rower’s stroke cycle. ARrow provides visual feedback on three levels: Tracking of basic performance metrics over time, visual feedback and guidance on a rower’s stroke sequence, and a rowing ghost view that helps synchronize the body movement of two rowers. We developed ARrow in close collaboration with international rowing coaches and demonstrated its usefulness in a user study with athletes and coaches.  more » « less
Award ID(s):
2107328
NSF-PAR ID:
10435030
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
EuroVis - Short Papers
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Mantis shrimp swim via metachronal rowing, a pattern in which the pleopods (swimming limbs) stroke sequentially, starting with the last pair and followed by anterior neighbors. A similar swimming pattern is used at various sizes, Reynolds numbers, and advance ratios by diverse organisms including ciliates, ctenophores, copepods, krill, and lobsters. Understanding this type of locomotion is important because it is widespread and may inspire the design of underwater vehicles where efficiency, robustness, and maneuverability are desired. However, detailed measurements of the flow around free-swimming, metachronally rowing organisms are scarce, especially for organisms swimming in a high Reynolds number regime (Re ≥ 104). In this study, we present time-resolved, planar PIV measurements of a swimming peacock mantis shrimp (Odontodactylus scyllarus). Simultaneous kinematics measurements of the animal, which had body and pleopod lengths of 114 and 20 mm, respectively, reveal mean swimming speeds of 0.2–1.9 m s−1 and pleopod beat frequencies of 3.6–13 Hz, corresponding to advance ratios of 0.75–1.84 and body-based Reynolds numbers of 23,000–217,000. Further, the animal’s stroke is not purely metachronal, with a long phase lag between initiation of the first and fifth pleopod power strokes. Flow measurements in the sagittal plane show that each stroking pleopod pair creates a posteriorly moving tip vortex which evades destruction by the recovery strokes of other pleopod pairs. The vortex created by the anteriormost pleopod pair is the strongest and, owing to the animal’s high advance ratio, is intercepted by the power stroke of the posteriormost pleopod pair. The vortex strength increases as a result of this interaction, which may increase swimming speed or efficiency. A relationship for vortex interception by the posterior pleopod is proposed that relates the phase lag between the interacting pleopods to the beat frequency, distance between those pleopods, and speed of the vortex relative to the animal. We describe this interaction with a novel parameter called the interpleopod vortex phase matching Strouhal number StIVPM which is equal to the phase lag between interacting pleopods. This new nondimensional parameter may be useful in predicting the conditions where a constructive interaction may occur in other species or in physical models. Finally, we relate the advance ratio to the Reynolds number ratio, the ratio between the body-based Reynolds number and the pleopod-based Reynolds number. The importance of these parameters in promoting the interpleopod vortex interactions identified here, in dynamically scaled experiments, and in wake signatures behind schooling metachronal swimmers is discussed. 
    more » « less
  2. Wearables are a multi-billion-dollar business with more growth expected. Wearable technology is fully entrenched at multiple levels of athletic competition, especially at the National Collegiate Athletic Association (NCAA) and professional levels where these solutions are used to gain competitive advantages by assessing health and performance of elite athletes. However, through the National Science Foundation (NSF) Innovation Corps (I-Corps) training experience, a different story emerged based on pilot interviews from coaches and trainers regarding the lack of trust in wearables, and how the technology falls short of measuring what practitioners need. An NSF I-Corps project was funded to interview over 100 strength and conditioning coaches (S&CCs) and athletic trainers (ATs) regarding the current state of wearables at the NCAA and professional levels. Through 113 unstructured interviews, a conceptual map of relationships amongst themes and sub-themes regarding wearable technology emerged through the grouping of responses into meaning units (MUs). Interview findings revealed that discussions by S&CCs and ATs regarding wearables could be grouped into themes tied to (a) the organizational environment, (b) the athlete, and (c) the analyst or data scientist. Through this project, key findings and lessons learned were aggregated into sub-themes including: the sports ecosystem and organizational structure, brand development, recruiting, compliance and gamification of athletes, baselining movement and injury mitigation, internal and external loads, “return tos,” and quantifying performance. These findings can be used by practitioners to understand general technology practices and where to close the gap between what is available versus what is needed. 
    more » « less
  3. null (Ed.)
    Synopsis Numerous aquatic invertebrates use drag-based metachronal rowing for swimming, in which closely spaced appendages are oscillated starting from the posterior, with each appendage phase-shifted in time relative to its neighbor. Continuously swimming species such as Antarctic krill generally use “pure metachronal rowing” consisting of a metachronal power stroke and a metachronal recovery stroke, while burst swimming species such as many copepods and mantis shrimp typically use “hybrid metachronal rowing” consisting of a metachronal power stroke followed by a synchronous or nearly synchronous recovery stroke. Burst swimming organisms need to rapidly accelerate in order to capture prey and/or escape predation, and it is unknown whether hybrid metachronal rowing can augment acceleration and swimming speed compared to pure metachronal rowing. Simulations of rigid paddles undergoing simple harmonic motion showed that collisions between adjacent paddles restrict the maximum stroke amplitude for pure metachronal rowing. Hybrid metachronal rowing similar to that observed in mantis shrimp (Neogonodactylus bredini) permits oscillation at larger stroke amplitude while avoiding these collisions. We comparatively examined swimming speed, acceleration, and wake structure of pure and hybrid metachronal rowing strategies by using a self-propelling robot. Both swimming speed and peak acceleration of the robot increased with increasing stroke amplitude. Hybrid metachronal rowing permitted operation at larger stroke amplitude without collision of adjacent paddles on the robot, augmenting swimming speed and peak acceleration. Hybrid metachronal rowing generated a dispersed wake unlike narrower, downward-angled jets generated by pure metachronal rowing. Our findings suggest that burst swimming animals with small appendage spacing, such as copepods and mantis shrimp, can use hybrid metachronal rowing to generate large accelerations via increasing stroke amplitude without concern of appendage collision. 
    more » « less
  4. Abstract We present an experimental investigation of spatial audio feedback using smartphones to support direction localization in pointing tasks for people with visual impairments (PVIs). We do this using a mobile game based on a bow-and-arrow metaphor. Our game provides a combination of spatial and non-spatial (sound beacon) audio to help the user locate the direction of the target. Our experiments with sighted, sighted-blindfolded, and visually impaired users shows that (a) the efficacy of spatial audio is relatively higher for PVIs than for blindfolded sighted users during the initial reaction time for direction localization, (b) the general behavior between PVIs and blind-folded individuals is statistically similar, and (c) the lack of spatial audio significantly reduces the localization performance even in sighted blind-folded users. Based on our findings, we discuss the system and interaction design implications for making future mobile-based spatial interactions accessible to PVIs. 
    more » « less
  5. Quantitative assessment of movement using motion capture provides insights on mobility which are not evident from clinical evaluation. Here, in older individuals that were healthy or had suffered a stroke, we aimed to investigate their balance in terms of changes in body kinematics and muscle activity. Our research question involved determining the effects on post- compared to pre-sensorimotor training exercises on maintaining or improving balance. Our research hypothesis was that training would improve the gait and balance by increasing joint angles and extensor muscle activities in lower extremities and spatiotemporal measures of stroke and elderly people. This manuscript describes a motion capture-based evaluation protocol to assess joint angles and spatiotemporal parameters (cadence, step length and walking speed), as well as major extensor and flexor muscle activities. We also conducted a case study on a healthy older participant (male, age, 65) and an older participant with chronic stroke (female, age, 55). Both participants performed a walking task along a path with a rectangular shape which included tandem walking forward, right side stepping, tandem walking backward, left side stepping to the starting location. For the stroke participant, the training improved the task completion time by 19 s. Her impaired left leg had improved step length (by 0.197 m) and cadence (by 10 steps/min) when walking forward, and cadence (by 12 steps/min) when walking backward. The non-impaired right leg improved cadence when walking forward (by 15 steps/min) and backward (by 27 steps/min). The joint range of motion (ROM) did not change in most cases. However, the ROM of the hip joint increased significantly by 5.8 degrees (p = 0.019) on the left leg side whereas the ROMs of hip joint and knee joint increased significantly by 4.1 degrees (p = 0.046) and 8.1 degrees (p = 0.007) on the right leg side during backward walking. For the healthy participant, the significant changes were only found in his right knee joint ROM having increased by 4.2 degrees (p = 0.031) and in his left ankle joint ROM having increased by 5.5 degrees (p = 0.006) during the left side stepping. 
    more » « less