A Project Presentation on

"ASSISTIVE SYSTEM FOR BLIND, DEAF AND DUMB

PEOPLE”

1
 Introduction
 Existing System and it’s disadvantages
 Problem Statement
 Literature Survey
 Objectives
 Proposed System and it’s advantages
 Benefits to the society
 Technology used
 References

2
 Hand gesture recognition system is widely used technology for helping the
deaf, dumb and blind people.
 Communication for blind person is achieved using camera.
 Human hand has remained a popular choice to convey information in
situations where other forms like speech cannot be used.
 We aim for developing an deaf and dumb gesture recognize system for
establishing communication between the deaf and the dumb people.
 Gestures are considered as the most natural expressive way for
communications between human and computers in virtual system.
 Hand gestures which can represent ideas using unique shapes and finger
orientation have a scope for human machine interaction.

3
 Traditionally, gesture recognition method was divided into two categories
namely vision-based and sensor-based method.
 In vision-based method, the computer camera is an input device for
various gestures of hands and figures.
 In sensor-based systems, gloves are used which can achieve the accurate
positions of hand gesture.
 But wearing it continuously is not possible.
 Finger Reader is a wearable device in a finger.
 Blinds who wear this can access the plain printed text through audio
feedback as they scan text line with their fingers.
 Finger reader is not accurate for electronic devices.

4
 Finger Reader is a wearable device in a finger.

 Blinds want the assistance of other neighbours to use braille script which
is time consuming and finger reader is not a language independent system
and limited for English language.

 It is not possible for all the masses to learn the sign language to
understand whatever is said through gestures.

 Therefore, the communication gap still exists between deaf and dumb
people.

 Dumb people can simply tilt the message by sign language which could
not be understandable by other people.

 System consisting solution for all the three disabilities does not exist.

5
 In our society we have people with disabilities.
 Blind persons can read documents only in Braille Script
 The technology is developing day by day but no significant developments
are undertaken for the betterment of these people.
 About nine billion people in the world are deaf and dumb
 Communications between deaf-mute and a normal person have always
been a challenging task.
 Sign language helps deaf and dumb people to communicate with other
people.
 But not all people understand sign language.

6
LITERATURE SURVEY
SL .NO TITLE AUTHOR YEAR ADVANTAGE DISADVANTAGE METHODOLOGY

1. Hand gesture Hua Li 2019 Sensor based Every Person Should Novel hand gesture
recognition Lifan Wu implementatio carry Leap Sensor. recognition system
enhancement Huan Wang, n is easy to Works only for some based on Leap
based on Cheng Han implement gestures. Motion gen. 2
spatial fuzzy Wei Quan This Paper only
matching in Jianping Zhao focuses on
Leap Motion Dumb Person

2. Hand Zaid Omar 2018 Uses Limited gestures and Vision based
recognition Ming Jing Cheok information No orientation recognition
and sign Mohommad about how
recognition Hisham Jaward humans
techniques interact

3. Gesture Prerna Sharma 2018 Provides No assistance for Posture

Recognition Naman communicatio blind people Recognition
System Sharma n gesture and System
posture based
implementati
on for non
wearable
devices

7
LITERATURE SURVEY Contd
SL .NO TITLE AUTHOR YEAR ADVANTAGE DISADVANTAGE METHODOLOGY

4. Continuous sign Zhihao Zhang 2017 Good Not real time Reinforcement
language Junfu Pu recognition Learning
recognition Liansheng Accuracy
using Zhuang
reinforcement Wengang
learning Zhou
Houqiang Li

5. Design and Itunuoluwa 2016 NLP based It only works A Text-to-

Implementation Isewon implementatio for Stored speech
of Text To n are high in Samples synthesizer
Speech accuracy This Paper only
Conversion for focus on Blind
Visually Person
Impaired People

6. Dynamic Hand Cheng- 2016 Recognizes More training Extraction

Posture Chang L. on order 15- needed methods and
Identification Chung-Lin 20 postures feature
H extraction
methodology

8
 The visually impaired people can able to understand the words easily by
tesseract software.
 The vocally impaired people can communicate their message through text
which can be read out by espeak.

 The deaf people can able to hear others speech from text.

9
 The proposed system consists of:
 input – microphone to record voice modulation, camera to capture image,
keyboard to type a message
 output – speaker and device screen to display the texts and the images.

 The user can give reply as text message and the device does text-to-speech
(TTS) conversion, the output is obtained from a small and powerful speaker.

 The image is captured through the camera and the reading of a text can be
achieved by text-to-speech (TTS) conversion.

 The device also recognizes the gestures of the users and will displays the
words related to it, then the device does speech-to-text (STT) conversion and
displays it on the device screen, based on what the normal person conveys. It
takes inputs from the microphone

10
 Deaf, dumb and blind can overcome their disabilities and can express their
views to others.

 Solution for deaf, dumb and blind in one device.

 It is language independent and user friendly.

 It is a portable device with a very low cost.

 Life becomes much easier with the help of this device and they can
manage their sites by themselves.

11
 Provides an easy option for disable persons to read or convey anything.
 Disabled person can compete with real word.
 Provides and easy option for communication between deaf, dumb and
blind.
 Cost effective solution for communication.

12
Software Requirements:
 Operating System: Windows 10
 Coding Language: Python
 Software used: Open cv, Tesseract, espeak

Hardware Requirements:
 System: Pentium IV 2.4GHz

 Hard disk: 500GB

 RAM: 4GB

 Any desktop/laptop system with above configuration or higher level.

13
[1] Mitra S., Acharya T., : Gesture Recognition – A survey,
IEEE Transactions on systems, man, and cybernetics—Part C:
Application and Reviews, Vol. 37, No. 3, (2007).
[2] Hu Z., Wang G., Lin X., Yan H., : Recovery of upper body poses
in static images based on joints detection. Pattern Recognition
Letters (30). pp. 503– 512, (2009).
[3] Nguyen T. N., Huynh H. H., : Static hand gesture recognition
using artificial neural network, Journal of Image and Graphics,
Volume 1, and No.1, (2013).
[4] Anderson J. A., : An Introduction to Neural Network. 3rd Ed.
Library of Congress Cataloging in publication Data. 651p, (1997).
[5] Baker K., : Singular Value Decomposition Tutorial. 24p, (2005).

14
[6] Ibraheem N.A., Khan R.Z.,: Vision based gesture recognition using neural
networks approaches: a review. International Journal of human Computer
Interaction (IJHCI). 3(1), (2012).
[7] Symeonidis K.,: Hand Gesture Recognition Using Neural Networks, MS
Thesis. University of Surrey, UK, (2000).
[8] Ranganath C.W. Ng, S.,: Real-time gesture recognition system and
application, Image and Vision Computing, Vol. 20, Issues 13-14, pp. 993-1007,
(2002).
[9] Licsar, Sziranyi T., : Dynamic training of hand gesture recognition system,
IEEE, 0-7695-2128-2/04, (2004).
[10] Ivekovic S., and Trucco E.,: Human body pose estimation with PSO. IEEE
Congress on Evolutionary Computation Sheraton Vancouver Wall Centre
Hotel. Vancouver, BC, Canada, (2006).

15
16