Faculty Bibliography

Curbs serve as vital borders that delineate safe pedestrian zones from potential vehicular traffic hazards. Curbs also represent a primary spatial hazard during dynamic navigation with significant stumbling potential. Such vulnerabilities are particularly exacerbated for persons with blindness and low vision (PBLV). Accurate visual-based discrimination of curbs is paramount for assistive technologies that aid PBLV with safe navigation in urban environments. Herein, we investigate the efficacy of curb segmentation for foundation models. We introduce the largest curb segmentation dataset to date to benchmark leading foundation models. Our results show that state-of-the-art foundation models face significant challenges in curb segmentation. This is due to their low precision and recall with poor performance distinguishing curbs from curb-like objects or non-curb areas, such as sidewalks. In addition, the best-performing model averaged a 3.70-s inference time, underscoring problems in providing real-time assistance. In response, we propose solutions including filtered bounding box selections to achieve more accurate curb segmentation. Overall, despite the immediate flexibility of foundation models, their application for practical assistive technology applications still requires refinement. This research highlights the critical need for specialized datasets and tailored model training to address navigation challenges for PBLV and underscores implicit weaknesses in foundation models.

This study explores the use of virtual reality (VR) as an innovative tool to enhance awareness, understanding of accessibility for persons with vision loss (VL), and acceptance. Through a VR-based workshop developed in collaboration with New York City's Department Of Transportation, participants experienced immersive simulations of VL and related immersive mobility challenges. The methodology included the development of a VR environment, simulations of vision loss, testing with the DOT team during the workshop, and an assessment of changes in participants' knowledge, confidence in addressing accessibility challenges, and overall perception through pre- and post-intervention questionnaires. Participants included urban planners, designers, and architects. Results showed a significant increase in awareness of VL-related challenges that affect design guidelines, as well as improved confidence in addressing such challenges. Participants also expressed strong support for VR as a pedagogical tool, noting its potential for reshaping professional practices, improving capacity building, and enhancing inclusive design. The study demonstrates the effectiveness of VR as an experiential learning platform, fostering empathy and a long-term commitment to integrating VL considerations into urban design. These findings highlight the transformative potential of VR in advancing equity and accessibility in urban environments.

PURPOSE/UNASSIGNED:People with blindness and low vision (pBLV) face challenges in navigating. Mobility aids are crucial for enhancing independence and safety. This paper presents an electronic travel aid that leverages a haptic-based, higher-order sensory substitution approach called Virtual Whiskers, designed to help pBLV navigate obstacles effectively, efficiently, and safely. MATERIALS AND METHODS/UNASSIGNED:Virtual Whiskers is equipped with a plurality of modular vibration units that operate independently to deliver haptic feedback to users. Virtual Whiskers features two navigation modes: open path mode and depth mode, each addressing obstacle negotiation from different perspectives. The open path mode detects and delineates a traversable area within an analyzed field of view and then guides the user in the most traversable direction with adaptive vibratory feedback. Depth mode assists users in negotiating obstacles by highlighting spatial areas with prominent obstacles; haptic feedback is generated by re-mapping proximity to vibration intensity. We recruited 10 participants with blindness or low vision for user testing of Virtual Whiskers. RESULTS/UNASSIGNED:Both approaches reduce hesitation time (idle periods) and decrease the number of cane contacts with objects and walls. CONCLUSIONS/UNASSIGNED:Virtual Whiskers is a promising obstacle negotiation strategy that demonstrates great potential to assist with pBLV navigation.

Curbs separate the edge of raised sidewalks from the street and are crucial to locate in urban environments as they help delineate safe pedestrian zones from dangerous vehicular lanes. However, the curbs themselves are also significant navigation hazards, particularly for people who are blind or have low vision (pBLV). The challenges faced by pBLV in detecting and properly orienting themselves for these abrupt elevation changes can lead to falls and serious injuries. Despite recent advancements in assistive technologies, the detection and early warning of curbs remains a largely unsolved challenge. This paper aims to tackle this gap by introducing a novel, multi-faceted sensory substitution approach hosted on a smart wearable; the platform leverages an RGB camera and an embedded system to capture and segment curbs in real time and provide early warning and orientation information. The system utilizes a YOLOv8 segmentation model which has been trained on our custom curb dataset to interpret camera input. The system output consists of adaptive auditory beeps, abstract sonifications, and speech, which convey curb distance and orientation. Through human-subjects experimentation, we demonstrate the effectiveness of the system as compared to the white cane. Results show that our system can provide advanced warning through a larger safety window than the cane, while offering nearly identical curb orientation information. Future enhancements will focus on expanding our curb segmentation dataset, improving distance estimations through advanced 3D sensors and AI-models, refining system calibration and stability, and developing user-centric sonification methods to cater for a diverse range of visual impairments.

BACKGROUND:Patients with disabilities face widespread barriers to accessing surgical care given inaccessible health systems, resulting in poor clinical outcomes and perpetuation of health inequities. One barrier is the lack of education, and therefore awareness, among trainees/providers, of the need for reasonable accommodations for surgical patients with disabilities. METHODS:We conducted a scoping review of the literature on the current state of disabilities curricula in medical education and graduate residency curriculum. RESULTS:While the literature does demonstrate a causal link between reasonable accommodation training and positive patient-provider relationships and improved clinical outcomes, in practice, disability-focused curricula are rare and often limited in time and to awareness-based didactic courses in medical education and surgical training. CONCLUSIONS:The absence of structured curricula to educate on anti-ableism and care for patients with disabilities promotes a system of structural "ableism." Expanding disability curricula for medical students and trainees may be an opportunity to intervene and promote better surgical care for all patients.

BACKGROUND:Visual disability is a growing problem for many middle-aged and older adults. Conventional mobility aids, such as white canes and guide dogs, have notable limitations that have led to increasing interest in electronic travel aids (ETAs). Despite remarkable progress, current ETAs lack empirical evidence and realistic testing environments and often focus on the substitution or augmentation of a single sense. OBJECTIVE:This study aims to (1) establish a novel virtual reality (VR) environment to test the efficacy of ETAs in complex urban environments for a simulated visual impairment (VI) and (2) evaluate the impact of haptic and audio feedback, individually and combined, on navigation performance, movement behavior, and perception. Through this study, we aim to address gaps to advance the pragmatic development of assistive technologies (ATs) for persons with VI. METHODS:The VR platform was designed to resemble a subway station environment with the most common challenges faced by persons with VI during navigation. This environment was used to test our multisensory, AT-integrated VR platform among 72 healthy participants performing an obstacle avoidance task while experiencing symptoms of VI. Each participant performed the task 4 times: once with haptic feedback, once with audio feedback, once with both feedback types, and once without any feedback. Data analysis encompassed metrics such as completion time, head and body orientation, and trajectory length and smoothness. To evaluate the effectiveness and interaction of the 2 feedback modalities, we conducted a 2-way repeated measures ANOVA on continuous metrics and a Scheirer-Ray-Hare test on discrete ones. We also conducted a descriptive statistical analysis of participants' answers to a questionnaire, assessing their experience and preference for feedback modalities. RESULTS:Results from our study showed that haptic feedback significantly reduced collisions (P=.05) and the variability of the pitch angle of the head (P=.02). Audio feedback improved trajectory smoothness (P=.006) and mitigated the increase in the trajectory length from haptic feedback alone (P=.04). Participants reported a high level of engagement during the experiment (52/72, 72%) and found it interesting (42/72, 58%). However, when it came to feedback preferences, less than half of the participants (29/72, 40%) favored combined feedback modalities. This indicates that a majority preferred dedicated single modalities over combined ones. CONCLUSIONS:AT is crucial for individuals with VI; however, it often lacks user-centered design principles. Research should prioritize consumer-oriented methodologies, testing devices in a staged manner with progression toward more realistic, ecologically valid settings to ensure safety. Our multisensory, AT-integrated VR system takes a holistic approach, offering a first step toward enhancing users' spatial awareness, promoting safer mobility, and holds potential for applications in medical treatment, training, and rehabilitation. Technological advancements can further refine such devices, significantly improving independence and quality of life for those with VI.

BACKGROUND:Health and healthcare disparities for surgical patients with blindness and low vision (pBLV) stem from inaccessible healthcare systems that lack universal design principles or, at a minimum, reasonable accommodations (RA). OBJECTIVES/OBJECTIVE:We aimed to identify barriers to developing and implementing RAs in the surgical setting and provide a review of best practices for providing RAs. METHODS:We conducted a search of PubMed for evidence of reasonable accommodations, or lack thereof, in the surgical setting. Articles related to gaps and barriers to providing RAs for pBLV or best practices for supporting RAs were reviewed for the study. RESULTS:Barriers to the implementation of reasonable accommodations, and, accordingly, best practices for achieving equity for pBLV, relate to policies and systems, staff knowledge and attitudes, and materials and technology. CONCLUSIONS:These inequities for pBLV require comprehensive frameworks that offer, maintain, and support education about disability disparities and RAs in the surgical field. Providing RAs for surgical pBLV, and all patients with disabilities is an important and impactful step towards creating a more equitable and anti-ableist health system.

UNav is a computer-vision-based localization and navigation aid that provides step-by-step route instructions to reach selected destinations without any infrastructure in both indoor and outdoor environments. Despite the initial literature highlighting UNav's potential, clinical efficacy has not yet been rigorously evaluated. Herein, we assess UNav against standard in-person travel directions (SIPTD) for persons with blindness or low vision (PBLV) in an ecologically valid environment using a non-inferiority design. Twenty BLV subjects (age = 38 ± 8.4; nine females) were recruited and asked to navigate to a variety of destinations, over short-range distances (<200 m), in unfamiliar spaces, using either UNav or SIPTD. Navigation performance was assessed with nine dependent variables to assess travel confidence, as well as spatial and temporal performances, including path efficiency, total time, and wrong turns. The results suggest that UNav is not only non-inferior to the standard-of-care in wayfinding (SIPTD) but also superior on 8 out of 9 metrics, as compared to SIPTD. This study highlights the range of benefits computer vision-based aids provide to PBLV in short-range navigation and provides key insights into how users benefit from this systematic form of computer-aided guidance, demonstrating transformative promise for educational attainment, gainful employment, and recreational participation.