An official website of the United States government
Certified orientation and mobility specialists (COMS) work with clients who are blind or visually impaired (BVI) to help them travel independently with confidence. Part of this process involves creating a narrative description of a route and using specific techniques to help the client internalize it. We focus on the problem of automatically generating a narrative description of an indoor route based on a recording from a smartphone. These automatically generated narrations could be used in cases where a COMS is not available or to enable clients to independently practice routes that were originally learned with the help of a COMS. Specifically, we introduce Clew3D, a mobile app that leverages LIDAR-equipped iOS devices to identify orientation and mobility (O&M) landmarks and their relative location along a recorded route. The identified landmarks are then used to provide a spoken narration modeled after traditional O&M techniques. Our solution is co-designed with COMS and uses methods and language that they employ when creating route narrations for their clients. In addition to presenting Clew3D, we report the results of an analysis conducted with COMS regarding techniques and terminology used in traditional, in-person O&M instruction. We also discuss challenges posed by vision-based systems to achieve automatic narrations that are reliable. Finally, we provide an example of an automatically generated route description and compare it with the same route provided by a COMS.
more »
« less
Digital Technologies in Orientation and Mobility Instruction for People Who are Blind or Have Low Vision
This paper investigates the tools and practices used by Orientation and Mobility (O&M) specialists in instructing people who are blind or have low vision in concepts, skills, and techniques for safe and independent travel. Based on interviews with experienced instructors who practice in different O&M settings we find that a shortage of qualified specialists and restrictions on in-person activities during COVID-19 has accelerated interest in remote instruction and assessment, while widespread adoption of smartphones with accessibility support has driven interest in assistive apps. This presents both opportunities and challenges for a practice that is traditionally conducted in-person and assessed through qualitative observations. In response we identify multiple opportunities for HCI research in service of O&M, including: supporting a 'physician's assistant' model of remote O&M instruction and assessment, matching O&M instructors' clients with guide dogs, highlighting clients' progress towards O&M goals, and collaboratively planning routes and monitoring clients' independent travel progress.
more »
« less
- PAR ID:
- 10432153
- Date Published:
- Journal Name:
- Proceedings of the ACM on Human-Computer Interaction
- Volume:
- 6
- Issue:
- CSCW2
- ISSN:
- 2573-0142
- Page Range / eLocation ID:
- 1 to 25
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
STEM undergraduate instructors teaching remote courses often use traditional lecture-based instruction, despite evidence that active learning methods improve student engagement and learning outcomes. One simple way to use active learning online is to incorporate exploratory learning. In exploratory learning, students explore a novel activity (e.g., problem solving) before a lecture on the underlying concepts and procedures. This method has been shown to improve learning outcomes during in-person courses, without requiring the entire course to be restructured. The current study examined whether the benefits of exploratory learning extend to a remote undergraduate physics lesson, taught synchronously online. Undergraduate physics students (N = 78) completed a physics problem-solving activity either before instruction (explore-first condition) or after (instruct-first condition). Students then completed a learning assessment of the problem-solving procedures and underlying concepts. Despite lower accuracy on the learning activity, students in the explore-first condition demonstrated better understanding on the assessment, compared to students in the instruct-first condition. This finding suggests that exploratory learning can serve as productive failure in online courses, challenging students but improving learning, compared to the more widely-used lecture-then-practice method.more » « less
-
This work-in-progress paper presents an innovative practice of using oral exams to maintain academic integrity and promote student engagement in large-enrollment engineering courses during remote instruction. With the abrupt and widespread transition to distance learning and assessment brought on by the COVID-19 pandemic, there has been a registered upsurge in academic integrity violations globally. To address the challenge of compromised integrity, in the winter quarter of 2021 we have implemented oral exams across six mostly high-enrollment mechanical and electrical engineering undergraduate courses. We present our oral exam design parameters in each of the courses and discuss how oral exams relate to academic integrity, student engagement, stress, and implicit bias. We also address the challenge of scalability, as most of our oral exams were implemented in large classes, where academic integrity and student-instructor disconnection have generally gotten disproportionately worse during remote learning. Our survey results indicate that oral exams have positively contributed to academic integrity in our courses. Based on our preliminary study and experiences, we expect oral exams can be effectively leveraged to hinder cheating and foster academic honesty in students, even when in-person instruction and assessment resumes.more » « less
-
null (Ed.)Digital fabrication courses that relied on physical makerspaces were severely disrupted by COVID-19. As universities shut down in Spring 2020, instructors developed new models for digital fabrication at a distance. Through interviews with faculty and students and examination of course materials, we recount the experiences of eight remote digital fabrication courses. We found that learning with hobbyist equipment and online social networks could emulate using industrial equipment in shared workshops. Furthermore, at-home digital fabrication offered unique learning opportunities including more iteration, machine tuning, and maintenance. These opportunities depended on new forms of labor and varied based on student living situations. Our findings have implications for remote and in-person digital fabrication instruction. They indicate how access to tools was important, but not as critical as providing opportunities for iteration; they show how remote fabrication exacerbated student inequities; and they suggest strategies for evaluating trade-offs in remote fabrication models with respect to learning objectives.more » « less
-
Marshall, Pamela Ann (Ed.)ABSTRACT The initial phase of the COVID-19 pandemic changed the nature of course delivery from largely in-person to exclusively remote, thus disrupting the well-established pedagogy of the Genomics Education Partnership (GEP; https://www.thegep.org ). However, our web-based research adapted well to the remote learning environment. As usual, students who engaged in the GEP’s Course-based Undergraduate Research Experience (CURE) received digital projects based on genetic information within assembled Drosophila genomes. Adaptations for remote implementation included moving new member faculty training and peer Teaching Assistant office hours from in-person to online. Surprisingly, our faculty membership significantly increased and, hence, the number of supported students. Furthermore, despite the mostly virtual instruction of the 2020–2021 academic year, there was no significant decline in student learning nor attitudes. Based on successfully expanding the GEP CURE within a virtual learning environment, we provide four strategic lessons we infer toward democratizing science education. First, it appears that increasing access to scientific research and professional development opportunities by supporting virtual, cost-free attendance at national conferences attracts more faculty members to educational initiatives. Second, we observed that transitioning new member training to an online platform removed geographical barriers, reducing time and travel demands, and increased access for diverse faculty to join. Third, developing a Virtual Teaching Assistant program increased the availability of peer support, thereby improving the opportunities for student success. Finally, increasing access to web-based technology is critical for providing equitable opportunities for marginalized students to fully participate in research courses. Online CUREs have great potential for democratizing science education.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1145/3555622
