Abstract

The basic idea of this projects is to build a human machine interface which can be used
to control mouse using head-tilt and eye-blink. This mouse-emulating device can be
found to be most useful by physically handicapped people who can no longer control
the computers using their hands. Since the device relies on user’s head and eye
movement, it can be used even by patient who are paralyzed from shoulder downward.
Simple head movement doesn’t require too much energy and neither does eye blinking.
Therefore user won’t get tired from using this device.

In this device we are using 3-axis accelerometer for detecting the movement of the
head and according to this, the movement of the cursor has been done. A photo sensor
detects eye blinking. The Infrared transceiver consists of IR transmitter and a
phototransistor mounted on the same unit. This detects a strong increase in the
reflected signal upon intentional long blink as compared to normal eye blink.

Overview of the project

In the evolution of computer user interfaces, the mouse and the keyboard have
with stood challenges from other input devices such as joystick, light pen, track ball and
many more devices. But still in most of the computer application we are using mouse
and keyboard as standard devises. This is not the same for the people who with severe
disabilities. However as computers become more compact and powerful examples,
PDAs, notebook, traditional designs for the mouse and keyboard may not be suitable for
interfacing with the small computing systems, but all these devices need physical
connection with computer system. We believe that by combining the advent in sensors
and wireless technologies, it is possible to develop a novel computer input system that
could enable multi- functional input tasks and allow the overall shrinkage in size of
the graphical and text interface devices.
 Although a wealth of software exists, severely disabled people cannot benefit
from it because of difficulties of access, which is usually via computer key board or
mouse. A computer control system has been developed which enables this software to
be utilized, in the case described. Computer control system is a computer input device
for physically disabled and paralyzed users. Our experimental results could be
performed using MEMS based motion detection sensors and eye blink sensors.

Introduction
The system uses accelerometer to detect the users head tilts in order to direct
mouse movement on the monitor. An eye blink sensor is used perform click operation of
the mouse from the system to open any desired folder, document, drive etc. An
overview of the project is to provide handles person to use computer with head
movement to move the cursor and click operation through eye blink sensor (IR sensor).

3.5 Hardware Requirements

 Microcontroller - AT89C51RD2BN
 MEMS Accelerometer
 Eye blink sensor
 Wireless device-Zigbee

3.6 Software Requirements

 Embedded C
 Keil-c compiler
 Embedded Java
 Eclipse Compiler
 Flash magic burner software
  Figure 9.5 Left Click

 Figure 9.6 Single Click


 Figure 9.7 Double Click

Figure 9.8 Project hardware model

4.6 Flow Chart

Start

Initialize and configure port

settings

Wait for signals from

communication ports

Signal
available Signal
from available
No acceleromet from eye
er blink sensor No

Yes Yes

Invoke mouse listener and

Invoke mouse listener and
make mouse movements
perform click operation

Conclusion

The overall concept of the project, concludes that this system is very user friendly
and yet more effective to the paralyzed persons to use the computer and interact with
its operations. The system makes simple configurations and is ready to play the role.
MEMS sensor was used to operate effectiveness of pointing and scrolling on wireless
device interfaces. The results indicate that pointing and scrolling can be effectively done
using MEMS sensor. In this project eye blink sensor is also used to operate opening of
a file or document.
 Architecture

 This architecture describes the implementation of head operated mouse that uses tilt
sensors placed on headset to determine head position. it uses 3 axis MEMS
accelerometers to detect head tilt in order to direct mouse movement on the monitor.
Accelerometer sends the information to the microcontroller. Microcontroller then passes
the actual information to encoder. Information encoded is then sent using Transmission to
Zigbee receiver.
 The system also uses eye blink sensor to make click operations in the computer where the
eye blink is detected and sent to the microcontroller and the microcontroller classifies and
sends the information through zigbee transmitter.

Fig1: Transmitter section

 Zigbee receiver will decode the received information. Microcontroller sends to PC

through RS232 cable, it will perform the operation and same operation for selecting any
documents with the help of eye blink. We constructed an interface system that would
allow a similarly paralyzed user to interact with a computer with almost full functional
capability as shown in figure below.
 Fig2: Receiver Section

Scope for Future Work

The scope of the project lies in complete mouse movement/ navigation controls and
click operation through the data received from the accelerometer and eye blink sensor
through wireless zigbee TX and rx to the USB serial/com port.

Though the current project is operable with all the conditions is still unstable being an
prototype. This can be modified to increase the efficiency and accuracy with more user
friendly operations and make system stable.

Bibliography

 A.Alice Linsie, J.Mangaiyarkarasi, “Hand Gesture Recognition Using Mems For

Specially Challenged People”, International Journal of VLSI and Embedded
Systems-IJVES, Vol. 04, Issue 02; pages: 238 -241, March - April 2013.

 S. Zhou, Q. Shan, F. Fei, W. J. Li, C. P. Kwong, C. K. Wu et al, “Gesture

recognition for interactive controllers using MEMS motion sensors,” Procededing.
IEEE International Conference Nano /Micro Engineered and Molecular Systems,
pages: 935–940, 2009