Published Paper Details:

In this paper, we derive a concept from the study of the various ideas and put forward a concept to help differently abled means disabled person to communicate by using a real-time visual-audio translator human computer interface, as by this the difficulty is to be removed. As the human evolved through the ages the communicating factors and medium can as they learn that it is important to communicate as to develop, to express the thoughts and convey the ideas, innovation, imagination and creativity with the fellow beings. As by the ages the modes changes naturally first non-verbal then verbal it was all in nature be we have to progress, but by this a little but the significant population of people is been barred, as in this only country about at the most 3% people cannot speak as they are dumb or they cannot listen as by this they are deaf, and at the least 2% of the population is blind that is they cannot see. Hence the gestures and sign language is the non-verbal mode of communication for deaf or dumb people but by this all the people who have not familiar with this knowledge with them the communication can be barred by this means there have been to remove this barrier, a medium is develop by this the hand gesture is taken as input from the camera and then the image is been processed this is called image processing (with tensorflow) and the after that the gesture is recognized and text on the screen is been displayed and as for output the gesture which is recognized is been given out in the form of the sound (voice) from the speaker by this a dumb or deaf person can communicate with blind person. For another conversation from blind person to dumb or deaf person, as the blind person can speak in this the input is taken as speech from the microphone and then the speech recognition takes place and then the text is given out as on the screen which can be read by the dumb or deaf person as they can see, in this Speech processing is used. By this application interface our aim which is to have communication between two disabled person and also between disabled person and other person can be done, as the system provide us the new innovation, been natural, user friendly and not so complicated in the way of interaction between computer interface and human beings.