Sei sulla pagina 1di 69

Hand Gesture Recognition For Indian Sign Language

CHAPTER 1

INTRODUCTION

1.1 PROBLEM DEFINITION


Dept. of ECE, RYMEC

Page 1

Hand Gesture Recognition For Indian Sign Language

Generally dumb people use sign language for communication but they find difficulty in
communicating with others who do not understand sign language. Sign language is not universal;
it changes from country to country. Recognition of sign language is to provide most important
opportunity for deaf community.
It is based on the need of developing an electronic device that can translate sign language
into speech in order to make the communication to take place between the mute communities
with general public. This project aims to lower this barrier in communication.

1.2 MOTIVATION
Sign language is the most natural way of expression for the deaf community. The urge to
support the integration of deaf people into the hearing society made the automatic sign language
recognition. This project is motivated by a thought of ensuring that deaf people have equality of
opportunity and full participation in society. By developing sign language recognition system a
hearing impaired person can easily interact with a normal person at different levels in the society.
We have attempted to design a basic system of sign language pertaining to Indian sign language.

1.3 APPROACH
In this project we are developing an electronic device that bridges the communication gap
between the mute communities and the general public based on ARM 7.First we made a brief
study of all the methods pertaining to general gesture recognition systems using various
techniques. Then we studied about the Indian sign language which is used conveniently by the
mute community in their daily life.

1.4 SIGNIFICANCE OF PROJECT


People, who are not deaf, never try to learn the sign language for interacting with deaf
people. This becomes a cause of isolation of deaf people. But, if an embedded system can be
programmed in such a way that it can translate sign language to text format, the difference

Dept. of ECE, RYMEC

Page 2

Hand Gesture Recognition For Indian Sign Language


between normal people and deaf community can be minimized. The main objective of our
project is to fill the communication gap between deaf community and normal people in India.
In todays life several applications in education and entertainment-such as interactive
learning modules, lecture presentations and 3-D games which have speech input and output
capabilities. Speech and hearing impaired humans require real time sign language gesture
recognition and generation to use these applications. Hence our project paves the way to fulfill
all these necessities.

1.5 FEATURES

The ARM7TDMI is a member of the Advanced RISC Machines (ARM) family of


general purpose 32-bit microprocessors, which offer high performance for very low
power consumption and price. The ARM architecture is based on Reduced Instruction Set
Computer (RISC) principles, and the instruction set and related decode mechanism are

much simpler than those of micro programmed Complex Instruction Set Computers.
LPC2148 combines microcontroller with embedded high speed flash memory ranging
from 32kB to 512kB. Due to its tiny size and low power consumption, LPC2148 is ideal

for applications where miniaturization is a key requirement.


Data glove is used which is a normal cloth driving gloves fitted with sensors along the
length of each finger and thumb. Mute people can use the gloves to perform hand gesture
and it will be converted into speech so that normal people can understand their

expression. This project provides the map for developing such a digital glove.
Various softwares such as KEIL, FLASHMAGIC, X-CTU, TEXT ALOUD are used in
our project.

1.6 ADVANTAGES

Cost effective system.


Compact system.
High performance.
Low Power Consumption..
Simple, fast and easy to implement

1.7 DISADVANTAGES

Putting these devices on takes time and can be quite cumbersome.

Dept. of ECE, RYMEC

Page 3

Hand Gesture Recognition For Indian Sign Language

Human hands vary in shape and size. So some users cannot wear these input devices.
In these systems, where hand tracking is required, some type of noise is bound to be
associated with the data.
Accuracy is one of the most critical components to provide robust recognition.

1.8 APPLICATIONS

Medically monitoring patients.


Communicating in video conferencing.
Distance learning / tele-teaching assistance.

1.9 ORGANIZATION
The overall report is organized in a systematic manner so as to make it convenient for the
reader in following the concepts.

Chapter 2 provides the literature survey which is done regarding the project and the

papers referred with respect to the project.


Chapter 3 provides the brief study of the sign language.
Chapter 4 shows the block diagram and detailed explanation of each block.
Chapter 5 includes the detailed explanation of hardware used in this project.
Chapter 6 includes the detailed explanation of software used in this project.
Chapter 7 shows the results and analysis of our project.
Chapter 8 shows the advantages and disadvantages of using this particular system and

application of our project.


As no work progresses without reference, conclusion discussion and future work, these
topics are noted in chapter 9.

Dept. of ECE, RYMEC

Page 4

Hand Gesture Recognition For Indian Sign Language

CHAPTER 2

LITERATURE SURVEY

Dept. of ECE, RYMEC

Page 5

Hand Gesture Recognition For Indian Sign Language

2.1 INTRODUCTION
In the world of sign language, and gestures a lot of research work has been done over the
past three decades. In present scenario, gesture recognition systems, facilitate communication
between the deaf and hearing people in real world situations. In order to improve the accuracy of
recognition, many researchers have deployed methods such as HMM, Artificial neural networks,
and, Kinect platform. Effective algorithms for segmentation, classification, pattern matching and
recognition have evolved, but this creates both, challenges and opportunities for sign language
recognition related research.

2.2 RELATED WORK


In the last two decades, several different methods of potential applications in the
advanced gesture recognition system have been suggested, but these differ from one to another in
their models. Some of them are Neural Network, HMMs, and Fuzzy systems.
The past decades have witnessed two specific patterns for categories of sign language
recognition.
The first category is dependent upon electromechanical devices for example: The glove
based systems. They can be used for measuring different parameters of gestures such as hand and
finger position, angles, and tip recognitions etc.
The second category revolved around the use of machine vision and image processing
techniques to formulate vision based hand gesture recognition systems.
The related research works done based on these categories are:
Dept. of ECE, RYMEC

Page 6

Hand Gesture Recognition For Indian Sign Language

Ming, Huei developed a system based on windowed template matching recognition


strategy. It focuses on recognizing a continuous flow of signs in ASL, by enhancing the

functionalities of the traditional data glove.


Starner and Pentland presented a high accuracy computer vision based method, which
used Hidden Markov Models for ASL recognition. They used the traditional dual camera

method, one for tracking users hand, and the other mounted on the desk.
Caridakis and Diamenti designed a robust system for consistent hand tracking and
preservation of the resulting contours. Their scheme incorporated Markov chains, HMM,

self- organizing maps for segmentation and feature extraction.


Loeding and Sarkar developed a system which made use of signemes i.e., parts of signs
that are present in most occurrences, taken from videos.
TABLE 2.1: RECENT TRENDS IN SIGN LANGUAGE RECOGNITION [1]

YEAR
2012

WORK DONE
A continuous sign language
recognition
system
for
Ethiopian sign language to
recognize gestures against
complex background.

2011

Sign Language recognition


using
1.Kinect Technology and
2. Neural Networks.

2010

A human Computer interface


which works on images as
well as videos.

2009

A system used Hidden Markov


Models, boundary tracing and
fingertip detection.

Dept. of ECE, RYMEC

Page 7

METHOD
Two main parts Candidate
gesture selection (CGS) and
Hand movement trajectory
determination (HMTD) to
recognize gestures against
plain
and
complex
background.
Microsoft Kinect Sensor was
used to recognize American
sign
language.A
new
architecture using the neural
networks was developed.
This method first cancels
background and noise effects
on the image, it then classifies
the gesture features using a
multiclass support vector
machine classifier.
Boundary
edge
detection
algorithm was used for Edge
Detection,
clipping
and
boundary tracing. HMMs were
used to recognize gestures in

Hand Gesture Recognition For Indian Sign Language


real time.

2.3 DRAWBACKS OF THE PREVIOUS RESEARCH WORKS


In dynamic hand gesture recognition, the trajectory estimation in vision based system
may require to apply complex algorithm to track hand and fingers using silhouettes and edges.

The major drawback of colour based localization techniques is the variability of skin
colour footprint in different lighting conditions. This frequently results in undetected skin

regions or falsely detected non-skin textures.


In Neural Networks technique, network training can be very time-consuming and does
not guarantee good results. It also requires re-training of entire network if hand gestures

are added or removed.


As with multi-level neural networks, the hidden nature of Hidden Markov Models makes

it difficult to observe their internal behavior.


Using Image processing technique, the drawbacks will be that high-resolution cameras
are used and hence it is not economic for common people. The system may not be
portable due to the use of cameras. The low level features of histograms results in a
disadvantage of this technique.

2.4 OUR APPROACH

Glove based systems represent one of the most important efforts aimed at acquiring hand
movement data. Mute people can use the gloves to perform hand gesture and it will be converted
into speech so that normal people can understand their expression. The trajectory estimation is
quite simple and straight forward in glove-based hand gesture recognition system that provides
spatial information directly which overcomes the problem in image processing.
Dept. of ECE, RYMEC

Page 8

Hand Gesture Recognition For Indian Sign Language


Since embedded system is dedicated to specific tasks, design engineers can optimize it to
reduce the size and cost of the product and increase the reliability and performance.
This approach uses embedded technology (ARM7). The LPC2148 microcontrollers are
based on 16-bit/32-bit ARM7TDMI-S CPU with real-time emulation and embedded trace
support. Due to their tiny size and low-power consumption, LPC2148 are ideal for applications
where miniaturization is a key requirement. The ARM memory interface has been designed to
allow the performance potential to be realized without incurring high costs in the memory
system.

Dept. of ECE, RYMEC

Page 9

Hand Gesture Recognition For Indian Sign Language

CHAPTER 3

INDIAN SIGN LANGUAGE

3.1 INTRODUCTION

Dept. of ECE, RYMEC

Page 10

Hand Gesture Recognition For Indian Sign Language


Sign languages are natural languages that use different means of expression for
communication in everyday life. More particularly, it is a means of communication for hearing
impaired. Thus, it provides replacement for speech among deaf and mute people. Examples of
some sign languages are the American Sign Language, British sign language, Indian sign
language, Japanese sign language and so on.
Sign language are well structured language with a phonology, morphology, syntax and
grammar distinctive from spoken languages. The structure of a spoken language makes use of
words linearly i.e., one after the other, where as a sign language makes use of several body
movements simultaneously in the spatial as well as in temporal space. The linguistic characters
of a sign language are different than that of spoken language due to existence of several
components affecting the context such as the use of facial expressions and head movements in
addition to hand movements.

3.1.1 FACTS OF SIGN LANGUAGE


Sign language has its own grammatical structure independent of any spoken or written
language.
The majority of deaf children are born to hearing parents and therefore do not acquire
sign language as a mother tongue. They need to learn it at school.
Minority of deaf children are born to deaf parents. They acquire sign language as a
mother tongue.
Some studies reveal that children can learn sign language earlier than they can learn to
speak.

3.2 INDIAN SIGN LANGUAGE


India, with its one billion people, is the second most populated country in the world. It is
estimated that there are over a million people who are profoundly deaf and approximately 10
million hard of hearing people, in India. No formal census data are available. These figures are
extrapolated from the number of people who are deaf and hard of hearing, in Western nations
(1 for individuals who are deaf and 10 for the hard of hearing).
Dept. of ECE, RYMEC

Page 11

Hand Gesture Recognition For Indian Sign Language

It would be realistic to believe that the actual number of people who are deaf and hard of
hearing is much higher, because of poor hygienic conditions and lack of adequate medical
services in India. Based on these numbers, one of every five people who are deaf in the world,
lives in India. According to an UNESCO report in the 1980s, only 5% of children who were
deaf attended any special educational programme. Applied to the present situation, this would
mean that only 50,000 children, who are deaf, receive any education while the other 950,000 are
left to their own devices.

3.2.1 ORIGIN OF INDIAN SIGN LANGUAGE


In regard to the degree of intelligence necessary for the invention and use of gesture
speech there is a great variety of opinion among scientific investigators. At a very early period of
savage state, the necessity for communication developed certain signs, visible and vocal, which
met the wants of the necessity felt at that time. In all probability vocal signs were not at first as
rapidly developed as gestures, but though of slower growth they finally crowded out, and in a
measure took the place of facial expression and body movements so that by that time when the
later stage or period of savagery or perhaps barbarism was reached each group in this unfolding
process which might be called a family, band or tribe had retained only a few of their original
operations of thought a rude and imperfect articulate language.
Indian sign language also known as Plains sign language was developed by Indian
society to meet a need for clear communication between tribes that spoke different languages. As
with any native language, Indian sign language was in danger of dying out and being lost. In
1930 the U.S Government sponsored a conference on Indian sign language that included the
production of a film, The Indian Sign Language. This film is reportedly stored at the National
Archives.
The concept of sign language interpreting is fairly new to the Indian sub-continent.
Although sign language has been in existence for many centuries in India, the first ever

Dept. of ECE, RYMEC

Page 12

Hand Gesture Recognition For Indian Sign Language


professional training in Indian sign language interpreting began in 2001 at The Indian sign
language cell at Ali Yavar Jung National institute for the hearing handicapped in Mumbai.[2]

3.2.2: RESEARCH WORK ON INDIAN SIGN LANGUAGE


For a country the size of India, the paucity of research on people who are deaf and hard
of hearing is not understandable. Miles, compiled a historical bibliography on the education
of children who are handicapped in South Asia and found only a few citations relative to
deafness and the education of children who are Deaf over a span of 4,000 years. Miles pointed
out that until the 20th century, deafness was considered as punishment for sins of earlier
incarnations. People who were deaf were not allowed to inherit property by law, until the
beginning of the 20th Century. With the prevalence of such beliefs, it is not surprising that Indian
society does not make deaf education a priority. Until 1978, it was generally believed that there
was no Indian Sign Language (ISL).
Banerjee compared signs used in three schools for the deaf situated in Bengal (present W.
Bengal and part of Assam). His conclusion was that gestures used in each school were different.
He believed that signing started in India in the 18th century but its use was strongly discouraged,
as signing was believed to impede learning to read. In 1975, Madan Vasishta sent a questionnaire
to the heads of the 117 schools for the deaf in India. Almost all the respondents agreed that there
was no Indian Sign Language. They did, however, acknowledge that deaf children used some
kind of collection of gestures. A similar survey was conducted by D. Deshmukh 20 years later,
again using questionnaires sent out to schools for the Deaf. Some of the responses show the same
misconceptions about sign language, saying, for instance, that signing is based on spoken
language, or is based on English, or that, it is difficult to provide a sign for every spoken
word. However, there were also some statements that showed a more positive attitude towards
manual communication, and here respondents did talk about sign language, rather than
gestures. Increasing awareness about the nature of sign languages is evidenced in statements
such as: Through sign languages, there is free and easy communication, Sign language is
the mother tongue of the Deaf.

Dept. of ECE, RYMEC

Page 13

Hand Gesture Recognition For Indian Sign Language


Linguistic work on Indian Sign Language (ISL) began in the 1970s. In 1977, Vasishta,
Woodward, and Wilson visited India with partial support from the National Science Foundation
(USA) and collected signs from four major urban centers (Delhi, Calcutta, Bombay, and
Bangalore) for linguistic analyses. Vasishta et al., found that ISL is a language in its own right
and is indigenous to the Indian subcontinent. Subsequent efforts by Vasishta et al between 1977
and 1982 resulted in four dictionaries of ISL regional varieties. The All India Federation of the
Deaf supposedly distributed these dictionaries to selected programmes serving the Deaf in India.
In 2001, another dictionary was published by the Ramakrishna Mission Vidyalaya in
Coimbatore. [3]

Dept. of ECE, RYMEC

Page 14

Hand Gesture Recognition For Indian Sign Language

FIGURE 3.1 GESTURES IN INDIAN SIGN LANGUAGE

Dept. of ECE, RYMEC

Page 15

Hand Gesture Recognition For Indian Sign Language

CHAPTER 4
BLOCK DIAGRAM
AND
WORKING METHODOLOGY

4.1 BLOCK DIAGRAM

Dept. of ECE, RYMEC

Page 16

Hand Gesture Recognition For Indian Sign Language

GLOV
E

ARM-7

LCD

LPC 2148

POW
ER

PC

POWER
ON
RESET

RESET

Figure 4.1: Block diagram

4.2 DESCRIPTION OF BLOCK DIAGRAM


Glove: Glove is used which is normal cloth-driven glove fitted with sensors. Sensors placed on
the thumb act as inputs. The placement of the sensors on the other four fingers is such that they
help in making the exact gesture of Indian sign language.

Power Supply: Power supply is designed to convert high voltage AC mains electricity to a
suitable low voltage supply for electronic circuits and other devices. 5V regulated supply is used.

LM7805 is used for 5V regulated supply.


Output current in excess of 0.5A
It accepts input voltage range from 7V to 15V
No external components
Internal thermal overload protection
Internal short circuit current-limiting
Output transistor safe-area compensation

Dept. of ECE, RYMEC

Page 17

Hand Gesture Recognition For Indian Sign Language

Output voltages of 5V, 12V, and 15V

Figure 4.2: Block Diagram of Power Supply

Each of the blocks is described in more detail below:

Transformer - steps down high voltage AC mains to low voltage AC.

Rectifier - converts AC to DC, but the DC output is varying.

Smoothing - smoothes the DC from varying greatly to a small ripple.

Regulator - eliminates ripple by setting DC output to a fixed voltage.

ARM7: ARM7TDMI-S is a general purpose 32-bit microprocessor which offers high


performance and very low power consumption. The ARM architecture is based on reduced
instruction set computer (RISC) principle. The ARM7TDMI-S processor has two instruction
sets. They are standard 32-bit ARM set and a 16-bit Thumb-set. The LPC2148 contains two
analog to digital converters. These converters are single 10-bit successive approximation analog
to digital converters. The total number of available ADC inputs for LPC2148 is 14.[4]

LCD: A liquid crystal display (LCD) is a flat panel display, electronic visual display or video
display that uses the light modulating properties of liquid crystals (LCs). LCs do not emit light
directly. LCDs are more energy efficient and offer safer disposal. Its low electrical power
consumption enables it to be used in battery-powered electronic equipment.

4.3 WORKING METHODOLOGY


Dept. of ECE, RYMEC

Page 18

Hand Gesture Recognition For Indian Sign Language

The cables are connected from the port of ARM processor to the PC.
After powering up the system, press RESET button.
Now, open the X-CTU terminal window and TEXTALOUD window in PC.
When a gesture for an alphabet according to the Indian sign language is made, the input
sensors placed on the thumb come in contact with the respective sensor placed on the

other four fingers; the pertaining alphabet is displayed on the LCD.


The alphabet displayed on the LCD is given as an input to the X-CTU terminal where the
respective alphabet can be viewed on the PC.
Some additional sensors are placed which when come in contact with the input sensors
displays pre-defined sentences on the LCD as well as the X-CTU terminal.
The text on the X-CTU terminal window is copied and pasted on the TEXTALOUD
window that gives a voice output.

Dept. of ECE, RYMEC

Page 19

Hand Gesture Recognition For Indian Sign Language

CHAPTER 5
HARDWARE DETAILS

5.1 ARM Micro Controller


5.1.1 Brief History of ARM

Dept. of ECE, RYMEC

Page 20

Hand Gesture Recognition For Indian Sign Language

ARM is acronym for Advanced RISC Machines.


Founded in the year 1990 and it is owned by Acorn, Apple and VLSI.
Known before becoming ARM as computer manufacturer.

5.1.2 Why ARM Here?

ARM is one of the most licensed and thus widespread processor cores in the world.
Used especially in portable devices due to low power consumption and reasonable

performance.
Several interesting extensions are available.
Includes special instruction set namely thumb instruction set.

There are many types of ARM micro controllers such as ARM6, ARM7, ARM9, ARM10,
ARM11 etc.
The type of micro controller used in this project is ARM7TDMI.

5.1.3 ARM7 Architecture

32-bit RISC-processor core (32-bit instructions).


37 pieces of 32-bit integer registers (16 available).
Pipelined (includes 3 stages).
Cached (depending on the implementation).
Von Neumann-type bus structure.
32 -bit data types.
7 modes of operation (usr, fiq, irq, svc, abt, sys, und).

Simple structure and reasonably good speed to power consumption ratio.

5.1.4 ARM7 Register Set

Register structure depends on mode of operation.


16 pieces of 32-bit integer registers R0 - R15 are available in ARM-mode (usr, user).
R0 - R12 are general purpose registers.
R13 is Stack Pointer (SP).

Dept. of ECE, RYMEC

Page 21

Hand Gesture Recognition For Indian Sign Language

R14 is subroutine Link Register.


Holds the value of R15 when BL-instruction is executed.
R15 is Program Counter (PC).
Bits 1 and 0 are zeroes in ARM-state (32-bit addressing).
R16 is state register (CPSR, Current Program Status Register).
There are 37 ARM registers in total of which variable amount is available as banked

registers depending on the mode of operation.


R13 functions always as stack pointer.
R14 functions as link register in other than sys and usr modes.
SPSR = Saved Program Status Register.
Flag register Mode-bits tell the processor operating mode and thus the registers
available.[6]

Figure 5.1: Flag Register

5.1.5 ARM7TDMI

TDMI stands for

Thumb instruction set

Debug-interface

Multiplier (hardware)

Interrupt (fast interrupts)

ARM Thumb
Dept. of ECE, RYMEC

Page 22

Hand Gesture Recognition For Indian Sign Language

T (Thumb)-extension shrinks the ARM instruction set to 16-bit word length i.e. 35-40%
amount of memory compared is saved when compared to 32-bit instruction set.

Extension enables simpler and significantly cheaper realization of processor system.


Instructions take only half of memory than with 32-bit instruction set without significant
decrease in performance or increase in code size.

Extension is made to instruction decoder at the processor pipeline.

Registers are of 32-bit size.

Thumb Extension

Thumb-instruction decoder is placed in pipeline.

Change to Thumb-mode happens by turning the state of multiplexers feeding the


instruction decoders and data bus.

A1 selects the 16-bit half word from the 32-bit bus.

Figure 5.2: Execution of Thumb Instruction

Thumb-State Registers

Only lower part of the register immediately available.


Upper register set (R8-R15) can be used with assembler code.
Instructions MOV, CMP and ADD are available between register sets.

Dept. of ECE, RYMEC

Page 23

Hand Gesture Recognition For Indian Sign Language

Figure 5.3: Thumb and ARM State Registers

5.2

LPC2148 Details
LPC2148 combines microcontroller with embedded high speed flash memory ranging

from 32kB to 512kB. A 128-bit wide memory interface and unique accelerator architecture
enable 32-bit code execution at the maximum clock rate. For critical code size applications, the
alternative 16-bit Thumb mode reduces code by more than 30% with minimal performance
penalty.
Due to its tiny size and low power consumption, LPC2148 is ideal for applications where
miniaturization is a key requirement. Serial communications interfaces ranging from a USB 2.0
Full-speed device, multiple UARTs, SPI, SSP to I2C-bus and on-chip SRAM of 8kB up to 40kB,
make these devices very well suited for communication gateways and protocol converters,
providing both large buffer size and high processing power.[7]

5.2.1 Key Features


Dept. of ECE, RYMEC

Page 24

Hand Gesture Recognition For Indian Sign Language

16-bit/32-bit ARM7TDMI-S microcontroller in a tiny LQFP64 package.


8kB to 40kB of on-chip static RAM and 32kB to 512kB of on-chip flash memory. 128-bit

wide interface/accelerator enables high-speed 60MHz operation.


In-System Programming/In-Application Programming (ISP/IAP) via on-chip boot loader
software. Single flash sector or full chip erase in 400ms and programming of 256 bytes in

1ms.
Embedded ICE RT and Embedded Trace interfaces offer real-time debugging with the

on-chip Real Monitor software and high-speed tracing of instruction execution.


USB 2.0 Full-speed compliant device controller with 2kB of endpoint RAM. In addition,

the LPC2148 provides 8kB of on-chip RAM accessible to USB by DMA.


Two 10-bit ADCs provide a total of 6/14 analog inputs, with conversion times as low as

2.44s per channel.


Single 10-bit DAC provides variable analog output.
Two 32-bit timers/external event counters (with four capture and four compare channels

each), PWM unit (six outputs) and watchdog.


Low power Real-Time Clock (RTC) with independent power and 32kHz clock input.
Multiple serial interfaces including two UARTs (16C550), two Fast I2C-bus (400kbit/s),

SPI and SSP with buffering and variable data length capabilities.
Vectored Interrupt Controller (VIC) with configurable priorities and vector addresses.
Up to 45 of 5 V tolerant fast general purpose I/O pins in a tiny LQFP64 package.
Up to 21 external interrupt pins available.
60 MHz maximum CPU clock available from programmable on-chip PLL with settling

time of 100s.
On-chip integrated oscillator operates with an external crystal from 1MHz to 25MHz.
Power saving modes include idle and Power-down.
Individual enable/disable of peripheral functions as well as peripheral clock scaling for

additional power optimization.


Processor wake-up from Power-down mode via external interrupt or BOD.
Single power supply chip with POR and BOD circuits:
CPU operating voltage range of 3.0V to 3.6V (3.3V 10 %) with 5V tolerant I/O pads.

Dept. of ECE, RYMEC

Page 25

Hand Gesture Recognition For Indian Sign Language

5.2.2 Block Diagram

Dept. of ECE, RYMEC

Page 26

Hand Gesture Recognition For Indian Sign Language

Figure 5.4: LPC2148 Block Diagram

5.2.3 Pinning Diagram

Dept. of ECE, RYMEC

Page 27

Hand Gesture Recognition For Indian Sign Language

Figure 5.5: LPC2148 Pin Diagram

5.2.4 Architectural Overview


Dept. of ECE, RYMEC

Page 28

Hand Gesture Recognition For Indian Sign Language

The LPC2148 is a general purpose 32-bit microprocessor, which offers high performance
and very low power consumption. The architecture is based on Reduced Instruction Set
Computer (RISC) principles, and the instruction set and related decode mechanism are much
simpler than those of micro programmed Complex Instruction Set Computers (CISC). This
simplicity results in a high instruction throughput and impressive real-time interrupt response
from a small and cost-effective processor core.
Pipeline techniques are employed so that all parts of the processing and memory systems
can operate continuously. Typically, while one instruction is being executed, its successor is
being decoded, and a third instruction is being fetched from memory.
The LPC2148 processor employs a unique architectural strategy known as Thumb, which
makes it ideally suited to high-volume applications with memory restrictions, or applications
where code density is an issue.[8]

The key idea behind Thumb is that of a super-reduced instruction set. Essentially, the
LPC2148 processor has two instruction sets:

The standard 32-bit ARM set.


A 16-bit Thumb set.

The Thumb sets 16-bit instruction length allows it to approach twice the density of
standard ARM code while retaining most of the ARMs performance advantage over a traditional
16-bit processor using 16-bit registers. This is possible because Thumb code operates on the
same 32-bit register set as ARM code. Thumb code is able to provide up to 65 % of the code size
of ARM, and 160 % of the performance of an equivalent ARM processor connected to a 16-bit
memory system.

The particular flash implementation in the LPC2148 allows for full speed execution also
in ARM mode. It is recommended to program performance critical and short code sections (such
Dept. of ECE, RYMEC

Page 29

Hand Gesture Recognition For Indian Sign Language


as interrupt service routines and DSP algorithms) in ARM mode. The impact on the overall code
size will be minimal but the speed can be increased by 30% over Thumb mode.

5.2.5 On-Chip Flash Memory


The LPC2148 incorporate a 512kB flash memory system. This memory may be used for
both code and data storage. Programming of the flash memory may be accomplished in several
ways. It may be programmed In System through the serial port. The application program may
also erase and/or program the flash while the application is running, allowing a great degree of
flexibility for data storage field firmware upgrades, etc. Due to the architectural solution chosen
for an on-chip boot loader, flash memory available for users code on LPC2148 is 500kB. The
LPC2148 flash memory provides a minimum of 100,000 erase/write cycles and 20 years of dataretention.

5.2.6 On-Chip Static RAM


On-chip static RAM may be used for code and/or data storage. The SRAM may be
accessed as 8-bit, 16-bit, and 32-bit. LPC2148 provides 32kB of static RAM. In LPC2148 only,
an 8kB SRAM block intended to be utilized mainly by the USB can also be used as a general
purpose RAM for data storage and code storage and execution.

5.2.7 Memory Map


The LPC2148 memory map incorporates several distinct regions, as shown in figure 5.6.
Dept. of ECE, RYMEC

Page 30

Hand Gesture Recognition For Indian Sign Language

Figure 5.6: LPC2148 Memory Map

5.2.8 10-bit ADC

Dept. of ECE, RYMEC

Page 31

Hand Gesture Recognition For Indian Sign Language


The LPC2148 contains two analog to digital converters. These converters are single 10bit successive approximation analog to digital converters. While ADC0 has six channels, ADC1
has eight channels. Therefore, total number of available ADC inputs for LPC2148 is 14.

Features

10 bit successive approximation analog to digital converter.


Measurement range of 0 V to VREF (2.0 V VREF VDDA).
Each converter capable of performing more than 400,000 10-bit samples per second.
Every analog input has a dedicated result register to reduce interrupt overhead.
Burst conversion mode for single or multiple inputs.
Optional conversion on transition on input pin or timer match signal.
Global Start command for both converters.

5.2.9 10-bit DAC


The DAC enables the LPC2148 to generate a variable analog output. The maximum DAC
output voltage is the VREF voltage.

Features

10-bit DAC.
Buffered output.
Power-down mode available.
Selectable speed versus power.

5.2.10 UARTs (Universal Asynchronous Receiver and Transmitter)

Dept. of ECE, RYMEC

Page 32

Hand Gesture Recognition For Indian Sign Language


The LPC2148 contains two UARTs, UART0 and UART1. In addition to standard
transmit and receive data lines, the LPC2148 UART1 also provide a full modem control
handshake interface. Compared to previous LPC2000 microcontrollers, UARTs in LPC2148
introduce a fractional baud rate generator for both UARTs, enabling these microcontrollers to
achieve standard baud-rates such as 115200 with any crystal frequency above 2MHz.

Features

16 byte Receive and Transmit FIFOs (First In First Out).


Register locations confirm to 550 industry standard.
Receiver FIFO trigger points at 1, 4, 8, and 14 bytes
Built-in fractional baud rate generator covering wide range of baud rates without a need

for external crystals of particular values.


Transmission FIFO control enables implementation of software (ON/OFF) flow control

on both UARTs.
LPC2148 UART1 equipped with standard modem interface signals. This module also
provides full support for hardware flow control.

UART1 Features

UART1 is identical to UART0, with the addition of a modem interface.


16 byte Receive and Transmit FIFOs.
Register locations confirm to 550 industry standard.
Receiver FIFO triggers points at 1, 4, 8, and 14 bytes.
Built-in fractional baud rate generator with auto bauding capabilities.
Mechanism that enables software and hardware flow control implementation.
Standard modem interface signals included with flow control fully supported in
hardware.

5.2.11 Crystal Oscillator


On-chip integrated oscillator operates with external crystal in range of 1 MHz to 25MHz.

Dept. of ECE, RYMEC

Page 33

Hand Gesture Recognition For Indian Sign Language


The oscillator output frequency, fosc and the ARM processor clock frequency is referred to as
CCLK for purposes of rate equations, etc. fosc and CCLK are the same value unless the PLL
(Phase Locked Loop) is running and connected.

5.2.12 Power Control


The LPC2148 supports two reduced power modes:
o Idle mode
o Power down mode.

In Idle mode, execution of instructions is suspended until either a reset or interrupt


occurs. Peripheral functions continue operation during idle mode and may generate interrupts to
cause the processor to resume execution. Idle mode eliminates power used by the processor
itself, memory systems and related controllers, and internal buses.
In Power-down mode, the oscillator is shut down and the chip receives no internal clocks.
The processor state and registers, peripheral registers, and internal SRAM values are preserved
throughout Power-down mode and the logic levels of chip output pins remain static. The Powerdown mode can be terminated and normal operation resumed by either a reset or certain specific
interrupts that are able to function without clocks. Since all dynamic operation of the chip is
suspended, Power-down mode reduces chip power consumption to nearly zero.
Selecting an external 32 kHz clock instead of the PCLK as a clock-source for the on-chip
RTC (Real Time Clock) will enable the microcontroller to have the RTC active during Powerdown mode. Power-down current is increased with RTC active. However, it is significantly lower
than in idle mode. A Power Control for Peripherals feature allows individual peripherals to be
turned off if they are not needed in the application, resulting in additional power savings during
active and idle mode.

5.3 LCD (Liquid Crystal Display)

Dept. of ECE, RYMEC

Page 34

Hand Gesture Recognition For Indian Sign Language


A liquid crystal display (LCD) is a flat panel display, electronic visual display or video
display that uses the light modulating properties of liquid crystals (LCs). LCs do not emit light
directly. LCDs are more energy efficient and offer safer disposal. Its low electrical power
consumption enables it to be used in battery-powered electronic equipment. It is an electronically
modulated optical device made up of any number of segments filled with liquid crystals and
arrayed in front of a light source (backlight) or reflector to produce images in color or
monochrome. The most flexible ones use an array of small pixels. As LCD panels produce no
light of their own, they require an external lighting mechanism to be easily visible. On most
displays, this consists of a cold cathode fluorescent lamp that is situated behind the LCD panel.
For battery-operated units (e.g. laptops) this requires an inverter to convert DC to AC.

The below figure 3.14 shows a general purpose alphanumeric 16x2 LCD. A 16x2 LCD means it
can display 16 characters per line and there are 2 such lines. In this LCD each character is
displayed in 5x8 pixel matrix.

Figure 5.7: A General Purpose Alphanumeric LCD

Dept. of ECE, RYMEC

Page 35

Hand Gesture Recognition For Indian Sign Language

Connecting an LCD display to a microcontroller

Figure 5.8: LCD Connections to Microcontroller

5.4 RS-232
In telecommunications, RS-232 is a standard for serial binary data signals connecting
between a DTE (Data terminal equipment) and a DCE (Data Circuit-terminating Equipment). It
is commonly used in computer serial ports. In RS-232, data is sent as a time-series of bits. Both
synchronous and asynchronous transmissions are supported by the standard. In addition to the
data circuits, the standard defines a number of control circuits used to manage the connection
between the DTE and DCE. Each data or control circuit only operates in one direction that is,
signaling from a DTE to the attached DCE 23 or the reverse. Since transmit data and receive data
are separate circuits, the interface can operate in a full duplex manner, supporting concurrent data
flow in both directions. The standard does not define character framing within the data stream, or
character encoding.

Dept. of ECE, RYMEC

Page 36

Hand Gesture Recognition For Indian Sign Language


Figure 5.9: RS 232
Table 5.1: RS 232 Signals

5.4.1 RS-232 Signals

Transmitted Data (TxD)


Data sent from DTE to DCE.
Received Data (RxD)
Data sent from DCE to DTE.
Request To Send (RTS)
Asserted (set to 0) by DTE to prepare DCE to receive data. This may require action on the
part of the DCE, e.g. transmitting a carrier or reversing the direction of a half-duplex line.
Clear To Send (CTS)
Asserted by DCE to acknowledge RTS and allow DTE to transmit.

Data Terminal Ready (DTR)


Asserted by DTE to indicate that it is ready to be connected. If the DCE is a modem, it
should go "off hook" when it receives this signal. If this signal is deasserted, the modem
should respond by immediately hanging up.
Dept. of ECE, RYMEC

Page 37

Hand Gesture Recognition For Indian Sign Language

Data Set Ready (DSR)


Asserted by DCE to indicate an active connection. If DCE is not a modem (e.g. a nullmodem cable or other equipment), this signal should be permanently asserted (set to 0),
possibly by a jumper to another signal.
Carrier Detect (CD)
Asserted by DCE when a connection has been established with remote equipment.
Ring Indicator (RI)
Asserted by DCE when it detects a ring signal from the telephone line.

5.5 MAX232

Figure 5.10: MAX232

MAX232 is a dual driver/receiver that includes a capacitive voltage generator to supply


TIA/EIA-232-F voltage levels from as single 5V supply. Each receiver converts TIA/EIA-232-F
inputs to 5V TTL/CMOS levels. These receivers have a typical threshold of 1.3V, a typical
hysteresis of 0.5V and can accept 30V inputs. Each driver converts TTL/CMOS input levels into
TIA/EIA-232-F levels.
FEATURES:

Dept. of ECE, RYMEC

Page 38

Hand Gesture Recognition For Indian Sign Language

Meets or exceeds TIA/EIA-232-F and ITU-recommendation V.28


Operates from a single 5V power supply with 1F charge pump capacitors
Operates upto 120 Kbps.
Two drivers and two receivers.

30V Input Levels

Low Supply Current . . . 8mA Typical

Designed to be Interchangeable With Maxim MAX232

ESD Protection Exceeds JESD 22 2000-V Human-Body Model (A114-A)


Applications

TIA/EIA-232-F

Battery-Powered Systems

Terminals

Modems

Computers

Dept. of ECE, RYMEC

Page 39

Hand Gesture Recognition For Indian Sign Language

CHAPTER 6

SOFTWARE DETAILS

6.1

KEIL Development Tool


Keil

assembly.

software
-vision

provides
4,

the

the
new

ease

of writing

the

IDE

from

Software

Keil

code

in either
combines

or

Project

management, Source Code Editing and Program Debugging in one powerful environment. It acts
as a cross-compiler.

6.1.1 Basic Keil

1. Open Keil from the Start menu.


2. The Figure below shows the basic names of the windows referred in this document.
Dept. of ECE, RYMEC

Page 40

Hand Gesture Recognition For Indian Sign Language

Figure 6.1: Basic Window of Keil

6.1.2 Starting a new Assembler Project


1. Select New Project from the Project Menu.

Dept. of ECE, RYMEC

Page 41

Hand Gesture Recognition For Indian Sign Language

Figure 6.2: Window Shows How to Create A New Project

2.
3.
4.
5.
6.
7.
8.

Name the project Project_Demo


Click on the Save Button.
The device window will be displayed.
Select the part you will be using to test with. For now we will use the NXP (Phillips).
Double Click on the NXP (Phillips).
Scroll down and select the LPC2148 Part.
Click OK.

6.1.3 Creating Source File

1. Click File Menu and select New.

Dept. of ECE, RYMEC

Page 42

Hand Gesture Recognition For Indian Sign Language

Figure 6.3: Window Shows How to Create A New File

2.
3.
4.
5.
6.

A new window will open up in the Keil IDE.


Write/Copy the code into the new window.
Click on File menu and select Save as
Name the file TEST.c.
Click the Save Button.

6.1.4 Adding File to the Project

1. Expand Target 1 in the Tree Menu.

Dept. of ECE, RYMEC

Page 43

Hand Gesture Recognition For Indian Sign Language

Figure 6.4: Window Shows How to Expand The Target

2. Click on Project and select Targets, Groups, and Files


3. Click on Groups/Add Files tab
4. Under Available Groups select Source Group 1
5. Click Add Files to Group button
6. Change file type to Asm Source file(*.a*; *.src)
7. Click on toggle.a51
8. Click Add button
9. Click Close Button
10. Click OK button when you return to Target, Groups, Files dialog box
11. Expand the Source Group 1 in the Tree menu to ensure that the file was added to the project.

6.1.5 Creating HEX for the Part

1. Click on Target 1 in Tree menu.


2. Click on Project Menu and select Options for Target 1.

Dept. of ECE, RYMEC

Page 44

Hand Gesture Recognition For Indian Sign Language

Figure 6.5: Window Shows How to Add A File to Source

3.
4.
5.
6.
7.

Select Target Tab.


Change Xtal (Mhz) from 50.0 to 11.0592.
Select Output Tab.
Click on Create Hex File check box.
Click OK Button.

8. Click on Project Menu and select rebuild all Target Files


9. In the Build Window it should report 0 Errors (s), 0 Warnings
10. You are now ready to Program your Part

6.1.6 Testing Program in Debugger

1. Comment out line ACALL DELAY by placing a Semicolon at the beginning. This will allow
you to see the port change immediately.
2. Click on the File Menu and select Save.
Dept. of ECE, RYMEC

Page 45

Hand Gesture Recognition For Indian Sign Language

Figure 6.6: Window Shows How to Debug A File

3. Click on Project Menu and select rebuild all Target Files.


4. In the Build Window it should report 0 Errors (s), 0 Warnings.
5. Click on Debug Menu and Select Start/Stop Debug Session.

6.1.7 Running the Keil Debugger

1.
2.
3.
4.

The Keil Debugger should be now be Running.


Click on Peripherals. Select I/O Ports, Select Port 1
A new window should port will pop up.
Step through the code by pressing F11 on the Keyboard. The Parallel Port 1 Box should

change as you completely step through the code.


5. To exit out, Click on Debug Menu and Select Start/Stop Debug Session.

6.2

Flash Magic

6.2.1 General Description


Dept. of ECE, RYMEC

Page 46

Hand Gesture Recognition For Indian Sign Language


ARM micro controller Development Board support major chips From Philips For
programming that are flash programmable microcontrollers that supports serial programming of
devices. Flash microcontroller can be erased and re-written as many times as possible. Flexibility
to reprogram number of times and its low cost make it ideal for use in a wide areas of
applications.This product is a combination of intelligent hardware and software. Bootloader
Inside the Chip that understands a protocol received from computer through serial port . On
computer side software called Flash Magic is started that identifies the hardware and the chip
inserted. Program for the target microcontroller can be now either read back or sent as Intel
format HEX file. Support locking of devices to prevent reading back of programmed chip. After
locking the chip can still be erased and used again for loading new programs.Atmel series can
only test in this Development Board.

Features

Support major Philips devices


Lock of programs in chip supported to prevent program copying
ZIF socket on-board Compatible 40 pin Microcontrollers
Auto Erase before writing and Auto Verify after writing
Informative status bar and access to latest programmed file
Simple and Easy to use

Dept. of ECE, RYMEC

Page 47

Hand Gesture Recognition For Indian Sign Language

Main Window

Advanced Options Window

Dept. of ECE, RYMEC

Page 48

Hand Gesture Recognition For Indian Sign Language

Terminal Settings Window

Device Database

6.3 X-CTU

Dept. of ECE, RYMEC

Page 49

Hand Gesture Recognition For Indian Sign Language


X-CTU is a Windows-based application provided by Digi. This program was designed to
interact with the firmware files found on Digis RF products and to provide a simple-to-use
graphical user interface to them.
X-CTU is designed to function with all Windows-based computers running Microsoft
Windows 98 SE and above. When properly installed it can be launched by clicking on the icon
on the PC desktop (see Figure 2) or selecting from the Start menu (see Figure 1).

FIGURE 1

FIGURE 2

When launched, you will see four tabs across the top of the program (see Figure 3). Each
of these tabs has a different function. The four tabs are: PC Settings: Allows a customer to select
the desired COM port and configure that port to fit the radios settings. Range Test: Allows a
customer to perform a range test between two radios. Terminal: Allows access to the computers
COM port with a terminal emulation program. This tab also allows the ability to access the
radios firmware using AT commands (for a complete listing of the radios AT commands, please
see the product manuals available online). Modem Configuration: Allows the ability to program
the radios firmware settings via a graphical user interface. This tab also allows customers the
ability to change firmware versions.

Dept. of ECE, RYMEC

Page 50

Hand Gesture Recognition For Indian Sign Language

The Terminal tab has three basic functions: Terminal emulator Ability to send and receive
predefined data pacts (Assemble packet) Ability to send and receive data in Hex and ASCII
formats (Show/Hide hex)
The main terminal window
The main white portion of this tab is where most of the communications information will
occur while using X-CTU as a terminal emulator. The text in blue is what has been typed in and
directed out to the radios serial port while the red text is the incoming data from the radios
serial port.
Dept. of ECE, RYMEC

Page 51

Hand Gesture Recognition For Indian Sign Language

6.4 TEXTALOUD SOFTWARE


The use of computer generated, synthetic speech is getting more and more mainstream.
Text file readers are a common class of speech apps and as a nifty extra many of them let you
turn text files into spoken audio directly. The audio file or files can then be listened on the road
using some hardware mp3 player, efficiently stored on the computer for later listening or burned
on a set of regular audio Cds.
Dept. of ECE, RYMEC

Page 52

Hand Gesture Recognition For Indian Sign Language


TextAloud is a very useful and easy-to-use text to speech utility for an attractively low
price (about 20 US dollars). It shines in turning multiple files to compressed audio very quickly
and also offers basic text editing, pronunciation and voice changing features. Unlike most free
readers, it supports both SAPI 4 and SAPI 5 for maximal coverage and offers some low-vision
features, too.
FEATURES

TEXTALOUD software is used to convert text into spoken audio. People who do not
like to read can just download this software and after converting that data to audio they

can listen. It will reduce high stress as well.


Text that is converted to audio can be listened to on your PC and can be created as MP3
or WMA files for use of in portable devices like iPods, MP3 players, CD players and
PocketPCs. This can reduce the time spent on machines and enables you to listen while

travelling.
This software consists of advanced pronunciation tools. This can increase our

pronunciation skills without going to any institutes or using any other software.
This software has optional premium voices for a wide variety of accents and languages.

Many famous voices are also present.


Text aloud is used by windows users and also MAC users. Toolbar plug-ins for internet
explorer, Firefox, and Outlook are also available so you do not have to waste any time.

Dept. of ECE, RYMEC

Page 53

Hand Gesture Recognition For Indian Sign Language

CHAPTER 7
RESULTS AND ANALYSIS

7.1 HAND GESTURE RECOGNITION SYSTEM MODULE


This is the figure of our module for hand gesture recognition system. Mainly this system
consists of two parts, those are:
ARM-7 CONTROLLER PART
GLOVE WITH SENSORS.
As shown in the figure, the glove is worn by a dumb person and the gestures are
recognized using the whole system module.

Dept. of ECE, RYMEC

Page 54

Hand Gesture Recognition For Indian Sign Language

Figure 7.1 Hand Gesture Recognition System Module

7.1.1 ARM 7 BOARD


This is the figure showing the ARM-7 BOARD with respect to our project.

Dept. of ECE, RYMEC

Page 55

Hand Gesture Recognition For Indian Sign Language

Figure 7.2 ARM-7 BOARD

7.2 RESULT ANALYSIS


Status When Power Switch is ON

Dept. of ECE, RYMEC

Page 56

Hand Gesture Recognition For Indian Sign Language

Display of the character A

Display of the character E

Display of the character I

Dept. of ECE, RYMEC

Page 57

Hand Gesture Recognition For Indian Sign Language

Display of the character O

Display of the character U

Display of the character S

Dept. of ECE, RYMEC

Page 58

Hand Gesture Recognition For Indian Sign Language

Display of the character H

Display of the character T

Display of the character R


Dept. of ECE, RYMEC

Page 59

Hand Gesture Recognition For Indian Sign Language

Display of the character N

Display of the character L

Display of the sentence Your name plz


Dept. of ECE, RYMEC

Page 60

Hand Gesture Recognition For Indian Sign Language

Display of the sentence Emergency Help

Display of the sentence Cost of This Product?

7.3 COMPARISON CHART

Dept. of ECE, RYMEC

Page 61

Hand Gesture Recognition For Indian Sign Language

Parameters
Speed
(Operating
Frequency)

Microcontrollers

Memory

RAM

FLASH

Supply
voltage

Area
(Pin Package)

Cost

8051
microcontroller

12MHz

128
bytes

4 KB

2.5-6V

40- pin

80/-

P89V51RD2

20-40MHz

1 KB

64 KB

4.5-5.5V

40-pin

130/-

LPC2148

60MHz

40 KB

512 KB

6V

64-pin

400/-

TMS570LS10116

140MHz

128 KB

1024KB

3.3V

144-pin

850/-

ATxmega64A3U

12-32MHz

4 KB

64 KB

1.6-3.6V

64-pin

230/-

Table 7.1 Comparison of LPC2148 with Other Microcontrollers

Table Description:

Speed and memory are better in LPC2148 than compared to 8051 which are the main

parameters to be considered in our project.


Except cost all other parameters are good in LPC2148 when compared to P89V51RD2.
TMS570LS10116 is an advanced microcontroller which is better in all parameters when
compared to LPC2148, but it is easier for beginners to work with LPC2148 as it uses
RISC, whereas TMS570LS10116 uses Complex instruction set which is comparatively

difficult.
The cost of TMS570LS10116 is twice than that of LPC2148, so LPC2148 is most
suitable for our project.

Dept. of ECE, RYMEC

Page 62

Hand Gesture Recognition For Indian Sign Language

Even when compared to ATxmega64A3U, LPC2148 is better in all parameters with


respect to our project.

Dept. of ECE, RYMEC

Page 63

Hand Gesture Recognition For Indian Sign Language

CHAPTER 8

ADVANTAGES, DISADVANTAGES
AND APPLICATIONS

8.1 ADVANTAGES

Cost effective system.


Compact system.
High performance.

Dept. of ECE, RYMEC

Page 64

Hand Gesture Recognition For Indian Sign Language

Low Power Consumption..


Simple, fast and easy to implement

8.2 DISADVANTAGES

Wearing the glove takes time and can be quite cumbersome.


Human hands vary in shape and size. So some users cannot wear these input devices.
In these systems, where hand tracking is required, some type of noise is bound to be
associated with the data.

8.3 APPLICATIONS

Developing aids for dumb people.


Recognizing sign language.
Medically monitoring patients.
Communicating in video conferencing.
Distance learning / tele-teaching assistance.
It can be applied on real systems to play games.
Could be applied on a mobile-robot control.[3]

Dept. of ECE, RYMEC

Page 65

Hand Gesture Recognition For Indian Sign Language

CHAPTER 9

CONCLUSION AND FUTURE


ENHANCEMENT

9.1 CONCLUSION
Sign language is a useful tool to ease the communication between the deaf or mute
community and the normal people. Yet there is a communication barrier between these
communities with normal people. This project aims to lower the communication gap between the
deaf or mute community and the normal world. This project was meant to be a prototype to
Dept. of ECE, RYMEC

Page 66

Hand Gesture Recognition For Indian Sign Language


check the feasibility of recognizing sign language using sensor gloves. With this project the deaf
or mute people can use the gloves to perform sign language and it will be converted in to speech
so that normal people can easily understand.
After the survey on the approaches used in various vocabulary- based sign language
recognition systems, we can give opinion about the methodologies involved. The system is
suitable for static ISL signs. This system is sufficient to claim a working system for native
Indian sign language alphabet. Thus, the proposed approach will be useful and will have a
sufficient amount of accuracy to recognize a hand sign gesture.

9.2 FUTURE ENHANCEMENT


The completion of this prototype suggests that sensor gloves can be used for partial sign
language recognition. More sensors can be employed to recognize full sign language. A handy
and portable hardware device with built-in translating system, speakers and group of body
sensors along with the pair of data gloves can be manufactured so that a deaf and dumb person
can communicate to any normal person anywhere. In future there can be many possible
improvements that will broaden the scope of this work.

Perfection in monitoring and sensing of the dynamic movements involved in


Microcontroller and Sensors Based Gesture Vocalizer.

Virtual reality application e.g., replacing the conventional input devices like joy sticks in
Video games with the data glove.
The Robot control system to regulate machine activity at remote sensitive sites.
Designing of wireless transceiver system for Microcontroller and Sensors Based
Gesture Vocalizer.

Dept. of ECE, RYMEC

Page 67

Hand Gesture Recognition For Indian Sign Language

REFERENCES
[1].Paranjape Ketki Vijay, Naphade Nilakshi Suhas, Chafekar Suparna Chandrashekhar &
Deshpande Ketaki Dhananjay, Recent Developments In Sign Language Recognition: A
Review, Volume-1, Issue-2, 2012, ISSN (Print): 2278-5140.
[2]. Ulrike Zeshan, Madan M.Vasishta, Meher Sethna, Implementation Of Indian Sign
Language In Educational Settings, Vol.16, No.1, 2005.
[3]. The Indian Sign Language,William.P.clark.
Dept. of ECE, RYMEC

Page 68

Hand Gesture Recognition For Indian Sign Language


[4]. Praveen Kumar S Havalagi, Shruthi Urf Nivedita, The Amazing Digital Gloves That Give
Voice To The Voiceless ISSN: 2231-1963.
[5].Sushmita Mitra and Tinku Acharya, Gesture Recognition: A Survey, IEEE Transactions
On Systems, Man, and CyberneticsPART C: Applications and Reviews, VOL. 37, NO. 3,
MAY 2007, pp. 311-324.
[6]. Sanshzar Kettebekov, Mohammed Yeasin and Rajeev Sharma, Improving Continuous
Gesture Recognition with Spoken Prosody, Proceedings of the 2003 IEEE Computer
Society Conference on Computer Vision and Pattern Recognition (CVPR03), ISBN # 10636919/03, pp.1-6.
[7]. Masumi Ishikawa and Hiroko Matsumura, Recognition of a Hand-Gesture Based on Self
organization Using a Data Glove, ISBN # 0-7803- 5871-6/99, pp. 739-745.
[8]. Farid Parvini, Dennis McLeod, Cyrus Shahabi, Bahareh Navai, Baharak Zali, and Shahram
Ghandeharazadeh, An Approach to Glove-Based gesture recognition, 2009.
[8]. Noor Adnan Ibraheem, RafiqulZaman Khan, Survey On Various Gesture Recognition
Technologies and Techniques, Volume 50-No.7, July 2012, ISSN: 0975-8887.

Dept. of ECE, RYMEC

Page 69

Potrebbero piacerti anche