Design of Augmented Reality Interface Catalyzed for the Visually Impaired Using Digital Image Processing and Tactile Haptic Feedback

Abstract

This research proposes to create an Augmented Reality Interface for the Visually newlineImpaired, enabling a way of haptically interacting with the computer system by newlinecreating a virtual workstation, facilitating a natural and intuitive way to accomplish a newlinemultitude of computer based tasks (such as emailing, word processing, storing and newlineretrieving files from the computer, making a phone call, searching the web etc.). newlineThe proposed system utilizes a combination of a haptic glove device, a gesture based newlinecontrol system, and an Augmented Reality computer interface which creates an newlineimmersive interaction between the blind user and the computer. The gestures are newlinerecognized, and the user is provided with audio and vibratory haptic feedbacks. This newlineuser interface allows the user to actually touch, feel and physically interact with newlinedigital controls and virtual real estate of a computer system. The system acts like a newlinebridge between the GUI (Graphical User Interface) and the blind users and is built newlinewith visually impairment in mind, thus it leverages a new type of UI (User Interface) newlineoptimized for haptic feedbacks and gesture based control. A test of applicability was conducted with a few blind power users and professionals for comparison with their currently used systems, and the tests showcased promising positive results in terms of ease of use and tasks accomplished with respect to time and effort. newline newline