Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
CHAPTER 1
INTRODUCTION
Page 1
Generally dumb people use sign language for communication but they find difficulty in
communicating with others who do not understand sign language. Sign language is not universal;
it changes from country to country. Recognition of sign language is to provide most important
opportunity for deaf community.
It is based on the need of developing an electronic device that can translate sign language
into speech in order to make the communication to take place between the mute communities
with general public. This project aims to lower this barrier in communication.
1.2 MOTIVATION
Sign language is the most natural way of expression for the deaf community. The urge to
support the integration of deaf people into the hearing society made the automatic sign language
recognition. This project is motivated by a thought of ensuring that deaf people have equality of
opportunity and full participation in society. By developing sign language recognition system a
hearing impaired person can easily interact with a normal person at different levels in the society.
We have attempted to design a basic system of sign language pertaining to Indian sign language.
1.3 APPROACH
In this project we are developing an electronic device that bridges the communication gap
between the mute communities and the general public based on ARM 7.First we made a brief
study of all the methods pertaining to general gesture recognition systems using various
techniques. Then we studied about the Indian sign language which is used conveniently by the
mute community in their daily life.
Page 2
1.5 FEATURES
much simpler than those of micro programmed Complex Instruction Set Computers.
LPC2148 combines microcontroller with embedded high speed flash memory ranging
from 32kB to 512kB. Due to its tiny size and low power consumption, LPC2148 is ideal
expression. This project provides the map for developing such a digital glove.
Various softwares such as KEIL, FLASHMAGIC, X-CTU, TEXT ALOUD are used in
our project.
1.6 ADVANTAGES
1.7 DISADVANTAGES
Page 3
Human hands vary in shape and size. So some users cannot wear these input devices.
In these systems, where hand tracking is required, some type of noise is bound to be
associated with the data.
Accuracy is one of the most critical components to provide robust recognition.
1.8 APPLICATIONS
1.9 ORGANIZATION
The overall report is organized in a systematic manner so as to make it convenient for the
reader in following the concepts.
Chapter 2 provides the literature survey which is done regarding the project and the
Page 4
CHAPTER 2
LITERATURE SURVEY
Page 5
2.1 INTRODUCTION
In the world of sign language, and gestures a lot of research work has been done over the
past three decades. In present scenario, gesture recognition systems, facilitate communication
between the deaf and hearing people in real world situations. In order to improve the accuracy of
recognition, many researchers have deployed methods such as HMM, Artificial neural networks,
and, Kinect platform. Effective algorithms for segmentation, classification, pattern matching and
recognition have evolved, but this creates both, challenges and opportunities for sign language
recognition related research.
Page 6
method, one for tracking users hand, and the other mounted on the desk.
Caridakis and Diamenti designed a robust system for consistent hand tracking and
preservation of the resulting contours. Their scheme incorporated Markov chains, HMM,
YEAR
2012
WORK DONE
A continuous sign language
recognition
system
for
Ethiopian sign language to
recognize gestures against
complex background.
2011
2010
2009
Page 7
METHOD
Two main parts Candidate
gesture selection (CGS) and
Hand movement trajectory
determination (HMTD) to
recognize gestures against
plain
and
complex
background.
Microsoft Kinect Sensor was
used to recognize American
sign
language.A
new
architecture using the neural
networks was developed.
This method first cancels
background and noise effects
on the image, it then classifies
the gesture features using a
multiclass support vector
machine classifier.
Boundary
edge
detection
algorithm was used for Edge
Detection,
clipping
and
boundary tracing. HMMs were
used to recognize gestures in
The major drawback of colour based localization techniques is the variability of skin
colour footprint in different lighting conditions. This frequently results in undetected skin
Glove based systems represent one of the most important efforts aimed at acquiring hand
movement data. Mute people can use the gloves to perform hand gesture and it will be converted
into speech so that normal people can understand their expression. The trajectory estimation is
quite simple and straight forward in glove-based hand gesture recognition system that provides
spatial information directly which overcomes the problem in image processing.
Dept. of ECE, RYMEC
Page 8
Page 9
CHAPTER 3
3.1 INTRODUCTION
Page 10
Page 11
It would be realistic to believe that the actual number of people who are deaf and hard of
hearing is much higher, because of poor hygienic conditions and lack of adequate medical
services in India. Based on these numbers, one of every five people who are deaf in the world,
lives in India. According to an UNESCO report in the 1980s, only 5% of children who were
deaf attended any special educational programme. Applied to the present situation, this would
mean that only 50,000 children, who are deaf, receive any education while the other 950,000 are
left to their own devices.
Page 12
Page 13
Page 14
Page 15
CHAPTER 4
BLOCK DIAGRAM
AND
WORKING METHODOLOGY
Page 16
GLOV
E
ARM-7
LCD
LPC 2148
POW
ER
PC
POWER
ON
RESET
RESET
Power Supply: Power supply is designed to convert high voltage AC mains electricity to a
suitable low voltage supply for electronic circuits and other devices. 5V regulated supply is used.
Page 17
LCD: A liquid crystal display (LCD) is a flat panel display, electronic visual display or video
display that uses the light modulating properties of liquid crystals (LCs). LCs do not emit light
directly. LCDs are more energy efficient and offer safer disposal. Its low electrical power
consumption enables it to be used in battery-powered electronic equipment.
Page 18
The cables are connected from the port of ARM processor to the PC.
After powering up the system, press RESET button.
Now, open the X-CTU terminal window and TEXTALOUD window in PC.
When a gesture for an alphabet according to the Indian sign language is made, the input
sensors placed on the thumb come in contact with the respective sensor placed on the
Page 19
CHAPTER 5
HARDWARE DETAILS
Page 20
ARM is one of the most licensed and thus widespread processor cores in the world.
Used especially in portable devices due to low power consumption and reasonable
performance.
Several interesting extensions are available.
Includes special instruction set namely thumb instruction set.
There are many types of ARM micro controllers such as ARM6, ARM7, ARM9, ARM10,
ARM11 etc.
The type of micro controller used in this project is ARM7TDMI.
Page 21
5.1.5 ARM7TDMI
Debug-interface
Multiplier (hardware)
ARM Thumb
Dept. of ECE, RYMEC
Page 22
T (Thumb)-extension shrinks the ARM instruction set to 16-bit word length i.e. 35-40%
amount of memory compared is saved when compared to 32-bit instruction set.
Thumb Extension
Thumb-State Registers
Page 23
5.2
LPC2148 Details
LPC2148 combines microcontroller with embedded high speed flash memory ranging
from 32kB to 512kB. A 128-bit wide memory interface and unique accelerator architecture
enable 32-bit code execution at the maximum clock rate. For critical code size applications, the
alternative 16-bit Thumb mode reduces code by more than 30% with minimal performance
penalty.
Due to its tiny size and low power consumption, LPC2148 is ideal for applications where
miniaturization is a key requirement. Serial communications interfaces ranging from a USB 2.0
Full-speed device, multiple UARTs, SPI, SSP to I2C-bus and on-chip SRAM of 8kB up to 40kB,
make these devices very well suited for communication gateways and protocol converters,
providing both large buffer size and high processing power.[7]
Page 24
1ms.
Embedded ICE RT and Embedded Trace interfaces offer real-time debugging with the
SPI and SSP with buffering and variable data length capabilities.
Vectored Interrupt Controller (VIC) with configurable priorities and vector addresses.
Up to 45 of 5 V tolerant fast general purpose I/O pins in a tiny LQFP64 package.
Up to 21 external interrupt pins available.
60 MHz maximum CPU clock available from programmable on-chip PLL with settling
time of 100s.
On-chip integrated oscillator operates with an external crystal from 1MHz to 25MHz.
Power saving modes include idle and Power-down.
Individual enable/disable of peripheral functions as well as peripheral clock scaling for
Page 25
Page 26
Page 27
Page 28
The LPC2148 is a general purpose 32-bit microprocessor, which offers high performance
and very low power consumption. The architecture is based on Reduced Instruction Set
Computer (RISC) principles, and the instruction set and related decode mechanism are much
simpler than those of micro programmed Complex Instruction Set Computers (CISC). This
simplicity results in a high instruction throughput and impressive real-time interrupt response
from a small and cost-effective processor core.
Pipeline techniques are employed so that all parts of the processing and memory systems
can operate continuously. Typically, while one instruction is being executed, its successor is
being decoded, and a third instruction is being fetched from memory.
The LPC2148 processor employs a unique architectural strategy known as Thumb, which
makes it ideally suited to high-volume applications with memory restrictions, or applications
where code density is an issue.[8]
The key idea behind Thumb is that of a super-reduced instruction set. Essentially, the
LPC2148 processor has two instruction sets:
The Thumb sets 16-bit instruction length allows it to approach twice the density of
standard ARM code while retaining most of the ARMs performance advantage over a traditional
16-bit processor using 16-bit registers. This is possible because Thumb code operates on the
same 32-bit register set as ARM code. Thumb code is able to provide up to 65 % of the code size
of ARM, and 160 % of the performance of an equivalent ARM processor connected to a 16-bit
memory system.
The particular flash implementation in the LPC2148 allows for full speed execution also
in ARM mode. It is recommended to program performance critical and short code sections (such
Dept. of ECE, RYMEC
Page 29
Page 30
Page 31
Features
Features
10-bit DAC.
Buffered output.
Power-down mode available.
Selectable speed versus power.
Page 32
Features
on both UARTs.
LPC2148 UART1 equipped with standard modem interface signals. This module also
provides full support for hardware flow control.
UART1 Features
Page 33
Page 34
The below figure 3.14 shows a general purpose alphanumeric 16x2 LCD. A 16x2 LCD means it
can display 16 characters per line and there are 2 such lines. In this LCD each character is
displayed in 5x8 pixel matrix.
Page 35
5.4 RS-232
In telecommunications, RS-232 is a standard for serial binary data signals connecting
between a DTE (Data terminal equipment) and a DCE (Data Circuit-terminating Equipment). It
is commonly used in computer serial ports. In RS-232, data is sent as a time-series of bits. Both
synchronous and asynchronous transmissions are supported by the standard. In addition to the
data circuits, the standard defines a number of control circuits used to manage the connection
between the DTE and DCE. Each data or control circuit only operates in one direction that is,
signaling from a DTE to the attached DCE 23 or the reverse. Since transmit data and receive data
are separate circuits, the interface can operate in a full duplex manner, supporting concurrent data
flow in both directions. The standard does not define character framing within the data stream, or
character encoding.
Page 36
Page 37
5.5 MAX232
Page 38
TIA/EIA-232-F
Battery-Powered Systems
Terminals
Modems
Computers
Page 39
CHAPTER 6
SOFTWARE DETAILS
6.1
assembly.
software
-vision
provides
4,
the
the
new
ease
of writing
the
IDE
from
Software
Keil
code
in either
combines
or
Project
management, Source Code Editing and Program Debugging in one powerful environment. It acts
as a cross-compiler.
Page 40
Page 41
2.
3.
4.
5.
6.
7.
8.
Page 42
2.
3.
4.
5.
6.
Page 43
Page 44
3.
4.
5.
6.
7.
1. Comment out line ACALL DELAY by placing a Semicolon at the beginning. This will allow
you to see the port change immediately.
2. Click on the File Menu and select Save.
Dept. of ECE, RYMEC
Page 45
1.
2.
3.
4.
6.2
Flash Magic
Page 46
Features
Page 47
Main Window
Page 48
Device Database
6.3 X-CTU
Page 49
FIGURE 1
FIGURE 2
When launched, you will see four tabs across the top of the program (see Figure 3). Each
of these tabs has a different function. The four tabs are: PC Settings: Allows a customer to select
the desired COM port and configure that port to fit the radios settings. Range Test: Allows a
customer to perform a range test between two radios. Terminal: Allows access to the computers
COM port with a terminal emulation program. This tab also allows the ability to access the
radios firmware using AT commands (for a complete listing of the radios AT commands, please
see the product manuals available online). Modem Configuration: Allows the ability to program
the radios firmware settings via a graphical user interface. This tab also allows customers the
ability to change firmware versions.
Page 50
The Terminal tab has three basic functions: Terminal emulator Ability to send and receive
predefined data pacts (Assemble packet) Ability to send and receive data in Hex and ASCII
formats (Show/Hide hex)
The main terminal window
The main white portion of this tab is where most of the communications information will
occur while using X-CTU as a terminal emulator. The text in blue is what has been typed in and
directed out to the radios serial port while the red text is the incoming data from the radios
serial port.
Dept. of ECE, RYMEC
Page 51
Page 52
TEXTALOUD software is used to convert text into spoken audio. People who do not
like to read can just download this software and after converting that data to audio they
travelling.
This software consists of advanced pronunciation tools. This can increase our
pronunciation skills without going to any institutes or using any other software.
This software has optional premium voices for a wide variety of accents and languages.
Page 53
CHAPTER 7
RESULTS AND ANALYSIS
Page 54
Page 55
Page 56
Page 57
Page 58
Page 59
Page 60
Page 61
Parameters
Speed
(Operating
Frequency)
Microcontrollers
Memory
RAM
FLASH
Supply
voltage
Area
(Pin Package)
Cost
8051
microcontroller
12MHz
128
bytes
4 KB
2.5-6V
40- pin
80/-
P89V51RD2
20-40MHz
1 KB
64 KB
4.5-5.5V
40-pin
130/-
LPC2148
60MHz
40 KB
512 KB
6V
64-pin
400/-
TMS570LS10116
140MHz
128 KB
1024KB
3.3V
144-pin
850/-
ATxmega64A3U
12-32MHz
4 KB
64 KB
1.6-3.6V
64-pin
230/-
Table Description:
Speed and memory are better in LPC2148 than compared to 8051 which are the main
difficult.
The cost of TMS570LS10116 is twice than that of LPC2148, so LPC2148 is most
suitable for our project.
Page 62
Page 63
CHAPTER 8
ADVANTAGES, DISADVANTAGES
AND APPLICATIONS
8.1 ADVANTAGES
Page 64
8.2 DISADVANTAGES
8.3 APPLICATIONS
Page 65
CHAPTER 9
9.1 CONCLUSION
Sign language is a useful tool to ease the communication between the deaf or mute
community and the normal people. Yet there is a communication barrier between these
communities with normal people. This project aims to lower the communication gap between the
deaf or mute community and the normal world. This project was meant to be a prototype to
Dept. of ECE, RYMEC
Page 66
Virtual reality application e.g., replacing the conventional input devices like joy sticks in
Video games with the data glove.
The Robot control system to regulate machine activity at remote sensitive sites.
Designing of wireless transceiver system for Microcontroller and Sensors Based
Gesture Vocalizer.
Page 67
REFERENCES
[1].Paranjape Ketki Vijay, Naphade Nilakshi Suhas, Chafekar Suparna Chandrashekhar &
Deshpande Ketaki Dhananjay, Recent Developments In Sign Language Recognition: A
Review, Volume-1, Issue-2, 2012, ISSN (Print): 2278-5140.
[2]. Ulrike Zeshan, Madan M.Vasishta, Meher Sethna, Implementation Of Indian Sign
Language In Educational Settings, Vol.16, No.1, 2005.
[3]. The Indian Sign Language,William.P.clark.
Dept. of ECE, RYMEC
Page 68
Page 69