Welcome to ScribeAR!
Test out our live transcriber platform now!
Mission
ScribeAR is comprised of undergraduate and graduate students at the University of Illinois. As a group identifying as ScirbeAR, we are a University of Illinois Urbana- Champaign sponsored research group in the computer science department. Our mission is to make a large classroom or lecture hall an equal opportunity for all students.
Research Interests
Real-time captioning is an effective communication access tool for the Deaf and Hard of Hearing by converting inaccessible speech into accessible text. Currently, the use of captioning is often limited to very controlled environments (e.g., a specific movie or a class), rendering them incompatible with casual social settings. Existing systems often require the user to break their line-of-sight when reading captions, causing the loss of visual information. This has significant accessibility implications in educational and social settings.
Fortunately, these challenges can be overcome with recent advances in augmented-reality hardware and automated speech recognition technologies. Heads-up display headsets can be used to stream the captions directly in theuser’s line of sight, maintaining access to visual information. Automated speech recognition can be used to eliminate the dependence on expensive human captioning services, reducing the barrier to entry.
We have utilized these technologies to develop ScribeAR, a lightweight platform used for live transcription. Designed with HTML5 to be platform agnostic, it can be used on multiple devices and AR headsets. ScribeAR integrates various different transcription services ranging from live transcription to Microsoft Azure. ScribeAR aims to provide a practical and non-intrusive transcription service appropriate for every situation.We also hope to specifically utilize ScribeAR to improve access to education for Deaf and Hard of Hearing students on the UIUC campus and other educational institutions.