Li H A

An haptic assistant bridging the communication gap between the normal and deaf-blind people

Inspiration

Helen killer born in 1880, became

deaf blind at 19 months. She grew

to be a remarkable figures in

american history. with the help of

Anne Sullivan her teacher she learned

to communicate through tactile signs.

she went on to graduate from Radcliffe

College.

source:

Li H A

Team

My name is Harsha, and I hail from India. Presently, I am pursuing a master's degree, majoring in Computer Science at IIIT Hyderabad. My motivation lies in utilizing technology to enhance the standard of living.

Harsha Satya Vardhan

The Problem

160 million

are affected by deafblindness world wide

Li H A

6%

of the population aged 75 and above being affected

Aged 3-31

a total of 9,809 children and youth with deaf-blindness were identified in the

United States alone, in 2021

source:

sense international

WFDB

NCDB

The Solution

source:

100% accessible without any wearables

Powered by

Microsoft Azure

OpenAI

Azure AI Speech

Compatible in all

mobile devices

Li H A

Our Services

Li H A

• Far
  

It consists of two interfaces :

• Chatting interface for blind-deaf person
  
• Chatting interface for a normal person

A deaf blind person can send message by

tapping the screen of the app

• Short tap is dot ( . )
  
• Long tap is dash ( - )

The Morse code written by blind-deaf person is converted to plain english while sending the message to a normal person. Incoming message from a Normal person to a deaf-blind person is converted into vibrations of dot & dash for blind and deaf person.

Our Services

Li H A

• Near
  

• This feature is used when both blind-deaf person and normal person are at same place and want to communicate to each other.
  

• When a normal person speaks, it is converted into vibrations via morse code in real time for blind-deaf person to understand the message
  

• Blind-deaf person can give reply in real-time by tapping the screen of the app and it is converted into speech.
  

Playback speed: 2x

Li H A

Li H A

Far

• Upon receiving input, when you press the optimise button it translates non-English content into English, leveraging the capabilities of the OpenAI Assistant API.
  

• This translation step is followed by a crucial optimization process, where the English text is refined to be concise without altering its meaning.
  

• Specifically prompted for Morse code transmission, this optimization strategy notably reduces the text size by approximately 26%.
  

Far

Li H A

• Using this interface the deaf blind person can receive the message from the normal person by morse code and understand it using vibrations of the mobile

• And can send the messages to normal person which are converted to normal text inbetween

Li H A

Playback speed: 2x

Far

Li H A

• The deaf blind person can not only chat with normal person by swiping right
• If he want to chat with openAI assistant by swiping up his message is send to the openAI assistant and he receives the response

• The assistant is prompted carefully for the custom use case
  

Near

Li H A

• The deaf blind person can convert the morse to speech

• Normal person can communicate using Azure speech to text which is translated to text and phone vibrations
  

QR Code Scanner

Real Time Solution

Openai Assistant

Socket connection

Li H A

NEAR - Real Time Solution

Azure Speech to Text

Azure Text to Speech

Li H A

Business model

Li H A

Subscrption based

Communicate with normal people

Communicate with openAI assistant

Speech to Text and vice versa

No external hardware

$ 1

Li H A

behind the barriers of silence and darkness their

are minds eager to connect, learn and contribute