Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
INTRODUCTION
This chapter consist of four part; problem background, objective, scope and
significance of the study.
Objective of this study clarified two objective of the study. Scope of the study describe
the limitation of this study and the contribution of this study is enlighten in part four;
significance of the study.
1.1
Stroke is the third largest cause of death and the most common cause of severe
disability in Malaysia. Statistic from National stroke association of Malaysia show
that every year 40,000 people suffer from stroke. Everybody ranging from children to
adult has the potential to get stroke. The mean age of stroke patients in Malaysia is
between 545 and 626 years (Loo & Gan, 2012).
2
brain tissue dies the function of that brain tissue will be lost. Fainting, unconsciousness
and/or weakness of limbs are main stroke symptoms.
The World Health Organization estimates that in 2001 there were over 20.5
million people suffer from strokes worldwide, 5.5 million of these were fatal. (Dr. A.
Khalek Abd. Rahman, 2012). In Kuala Lumpur Hospital, 1000 stroke cases are seen
per year with 30% - 35%, deaths due to stroke (Nurul Aini HM, Aniza I, 2007).
3
which can help and inspire patients to do exercises related to therapy in the comfort of
their home (Sanjay Saini, Dayang Rohaya Awang Rambli, Suziah Sulaiman, Zakaria,
& Zakaria, 2012).
Cost in this project, referring to the initial cost needed to set up the
rehabilitation system; the computer hardware system.
1.2
ii.
iii.
1.3
ii.
The system can be executed using computer or laptop and mouse as the
graphical user interface.
4
iii.
iv.
1.4
The
CHAPTER 2
LITERATURE REVIEW
6
2.1
What is stroke?
Stroke is one of the deadly disease in Malaysia; one of top five major causes
of death and one of the top ten causes for hospitalization in Malaysia (Loo & Gan,
2012). Every year 40,000 people diagnosed with this deadly disease (National stroke
association of Malaysia, 2015). Hospital Kuala Lumpur record show that 30% to 35%
from 1000 patient treated for stroke will end with death (Nurul Aini HM, Aniza I,
2007). Even though in Malaysia most of the stroke patient age are between 54 to 65
year (Loo & Gan, 2012); everybody have potential to get stroke, including children
and babies.
Stroke occurs when blood flow to the brain is blocked. Blood supply essential
nutrient and oxygen to the brain. Insufficient blood supply will cause brain cell
damages and lead to lose control of human body. Stoke effect varies from one person
to the others depending on the location and degree of brain tissue damage, stroke
survivors are likely to suffer cognitive, visual and motor losses. Stroke is divided into
two type as shown in Figure 2.1:
7
Ischemic strokes account for 87 percent of all strokes. Ischemic stroke happen
when there is a blood clot that blocks blood flow to a part of the brain. Ischemic stroke
occur when:
In some situation the plaque origin is from some other part of the body.
When this plaque breaks, the fragments may travel to the brain and
disrupt the blood flow. This is called embolism.
Haemorrhagic strokes occur when a weakened blood vessel in the brain breaks
and bleeds into surrounding brain tissue. This puts too much pressure on blood cells
in the surrounding tissue, cutting off their blood supply and causing damage. About
13 percent of all strokes are haemorrhagic strokes.
The effects of a stroke depend primarily on the location of the obstruction and
the extent of brain tissue affected. Human brain is divided into two hemisphere; right
brain and left brain. Right brain control the left side of human body and the left brain
is responsible for right side of human body.
As one side of the brain controls the opposite side of the body, a stroke
affecting one side of the brain will result in nerve system problems on the side of the
body it affects. For example, if the stroke occurs in the brain's right side, the left side
of the body and the left side of the face will be affected, which could produce any or
all of the following:
Paralysis or weakness on certain part of the side of the body such as hand, arm
and leg.
Vision problems.
Memory loss.
If the stroke occurs in the left side of the brain, the right side of the body will
be affected, producing some or all of the following:
Speech/language problems.
Memory loss.
Stroke can affect both sides of the body or may leave someone in a locked-in
state. Stroke patient with locked-in state will lost their ability to speak or achieve any
movement below the neck. The effect of stroke varies depending on the severity of
human brain damage.
Family history; Stroke often runs in families. Stroke risk may be higher if a
grandparent, parent, or sibling has suffered a stroke in the past.
Age; stroke is most common in adults over the age of 65. According to the
American Stroke Association (American Stroke Association, n.d.); the chance
of having a stroke doubles for each decade of life after 55.
Gender; women have more strokes than men, and strokes kill more women
than men each year.
9
Stroke risk factors that can be prevented or controlled include:
High blood pressure; high blood pressure is the main risk factor for stroke. It
can damage and weaken arteries throughout the body so that they burst or clog
more easily.
Heart disease; coronary artery disease, the build-up of plaque in the arteries,
can increase your risk of stroke. So can other heart conditions, including heart
valve defects and irregular heartbeat (atrial fibrillation).
Diabetes; people with diabetes are four times as likely to have a stroke as
people without diabetes.
Certain lifestyle habits and conditions can also increase risk of stroke. These
risk factors include:
Smoking.
Poor diet.
Obesity.
Person who survive from stroke known as stroke survivor. Stroke survivor is
classified as disable people. In this study, disability is define as difficulty to perform
something that is a normal part of daily life. Stroke survivors will have difficulty to
perform activities of daily living (ADL) such walking, talking, eating, and taking
care of the daily activity such as using toilet, wearing dress and bathing. Furthermore
they will lost the ability to perform instrumental activities of daily living (IADL),
such as housekeeping, using the telephone, driving, and using computers. Treatment
for stroke complications usually involves a combination of therapy and medication.
10
2.2
Brain injury due to stroke can change the way people move, feel, think, or
speak. The effects are greatest right after the stroke. Over time, most stroke survivor
will make improvements. Rehabilitation helps stroke survivors relearn skills that are
lost when part of the brain is damaged. The stroke rehabilitation objective are to help
stroke survivors live as independently as possible while adjusting to new limitations.
For example, these skills can include coordinating leg movements in order to walk or
carrying out the steps involved in any complex activity. Rehabilitation also teaches
survivors new ways of performing tasks to circumvent or compensate for any residual
disabilities. Individuals may need to learn how to bath and dress using only one hand,
or how to communicate effectively when their ability to use language has been
compromised. Figure 2.2 show three important element in any rehabilitation program;
carefully directed, well-focused, and repetitive practice, same method used to learn a
new skill, such as playing the piano or pitching a baseball.
Repetitive
practice
Wellfocused
Carefully
directed
11
Rehabilitation therapy begins in the acute-care hospital after the persons
overall condition has been stabilized, often within 24 to 48 hours after the stroke. The
first steps involve promoting independent movement because many individuals are
paralyzed or seriously weakened. Patients are prompted to change positions frequently
while lying in bed to engage in passive or active range of motion exercises to
strengthen their stroke-impaired limbs. Depending on several factors such as the
extent of the initial injury; patients may progress from sitting up and being moved
between the bed and a chair to standing, bearing their own weight, and walking, with
or without assistance. Rehabilitation nurses and therapists help patients who are able
to perform progressively more complex and demanding tasks, such as bathing,
dressing, and using a toilet, and they will encourage patients to use their strokeimpaired limbs while engaging in those tasks. Beginning to reacquire the ability to
carry out these basic activities of daily living represents the first stage in a stroke
survivor's return to independence.
Speech therapy.
Psychological counselling.
12
Recovery of the upper limb such as hand and arm has a slower progression and
is usually gained through outpatient and home therapy (van der Lee et al., 1999).
Upper limb stroke survivor recovery process start with regaining their ability to move
their shoulder, arm, wrist and hand.
2.3
Most stroke survivor will suffer weakness or lost ability to upper limb or arm.
Arm movements are produce by moving a group of muscle groups together and this
movement is coordinated by brain. Collaboration between muscles is known as
synergies. Stroke will reduce the coordination between the brain and body, as a
result the muscle synergies will move in abnormal patterns. Normally only one side
of the body will be affected. Stroke can affect stroke patient arm in several way:
Weakness.
Stroke survivors may completely paralyzed or their shoulder, elbow wrist
and/or hand may be weak. This condition will lead to difficulty in reaching,
picking things up or holding onto things.
Coordination problems.
Stroke survivor may have difficulty to plan or coordinate the movements of
their arm; arm doesnt move in the way that they want it to.
Subluxation.
Weakness or low tone may allow the top of stroke survivor arm to drop out of
the shoulder socket slightly. This makes arm movements difficult and can be
painful.
13
Contracture.
Weakness or high tone may make stroke survivor muscles shorter or joints less
flexible. This makes movements difficult and can be painful.
Arm skate, cone stacking and picking marble are equipment which is
frequently use at occupational therapy unit. Stroke survivor has to repeat the same
activity for 15 20 minutes in one session. Normally in one session a therapist is
required to monitor two or three patient at the same time. Study done by a group
researcher from Taiwan reveal that even though these equipment can produce the
expected outcome there are several weakness such as easy to lose focus because of
boredom, no difficulty setting and no movement record (Huang, Lee, Hsieh, & Chen,
2013).
2.4
Home based rehabilitation is special therapy program design to suit the stroke
survivor needs. Rehabilitation process will be carry out at the patient house. In current
practice a special team will be form to monitor this program.
Home based
rehabilitation objective is to improve the ability of the stroke survivor to carry out daily
living activity such as grooming, toileting, and other forms of self-care, household
and other day-to-day tasks, as well as leisure activities.
Home based rehabilitation will reduce the frequency of visit to the clinics, this
approach will help stroke survivor reduce their expenses. Due to the low-cost and
availability of the rehabilitation, the therapy could continue until the individual was
satisfied with their ability to independently perform activities of daily living. The
home-based rehabilitation would include an engaging interaction, such as a game, to
maintain the individual's interest (Reed, Ismet Handzic, & Samuel McAmis, 2014).
14
Movement activity can be recorded using video or log file. These data can be used by
therapist to evaluate the stroke survivor achievement and can be used to plan further
rehabilitation activity.
2.5
15
2.6
Virtual reality was first introduced by Jaron Lanier in 1987. Virtual reality also
known as Synthetic Experience, Virtual Worlds, Artificial Worlds or Artificial Reality.
Different name propose different definition, but all researcher agree that VR is an
interactive and immersive experience in a simulated world (Mazuryk & Gervautz,
1996).
Virtual reality
Virtual reality experience consist of four key element virtual world, immersion,
sensory feedback and interactivity. A virtual environment is a real world environment
simulation created using computer software and is experienced by the user through a
human machine interface. In the real world human use eyes, nose, ears and skin to
detect changes in their environment, same principle applied in virtual world,
information about environmental changes in virtual world is send to the user senses
using human machine interface such as head mounted display (HMD) and data glove.
Virtual reality device create a feeling of being inside and a part of virtual world, this
experience is known as immersion. Sensory feedback refers to the ability of virtual
16
reality system to react to user movement. Interaction is defined as the ability of the
user to move and interact with object in virtual world.
Virtual reality has a wide range of application in various field such as military,
education, entertainment, fashion and engineering. Virtual reality has become an
important tools in medical training and treatment process. Virtual reality allow
medical student to perform virtual surgery and reduce the effect of trial and error
during learning process.
Limited number of rehabilitation centre and high treatment cost has motivated
many researcher to develop game based rehabilitation. Games based rehabilitation
offer a cheaper rehabilitation therapy for stroke survivors. Virtual reality can also be
integrate with robotic technology to perform robotic surgery. This surgery will be
controlled by human surgeon but the surgery is done by robotic arm to reduce error.
2.7
Virtual rehabilitation
Virtual reality provide interactive simulation which the users has the
opportunities to engage in environments that appear and feel similar to real world
objects and events (Sheridan, 1992). VR allows the Users to interact with displayed
images, move and manipulate virtual objects and perform other actions in a way that
attempts to immerse them within the simulated environment thereby engendering a
feeling of presence in the virtual world (Weiss, Kizony, Feintuch, & Katz, 2006).
17
Rate of success in virtual rehabilitation is affected by three fundamental factor
as shown in Figure 2.3; repetition, feedback and motivation (Maureen K. Holden,
2005). Repetition play important role in rehabilitation process. Repeating the same
movement for several time will increase the movement speed. Repetition drawbacks
is unmotivated, when same movement is repeated for a long time, it will cause
boredom. Repetition must accompanied with motivation. The repeated practice must
be linked to incremental success at some task or goal. This can be achieved by setting
different level of difficulty and feedback system.
Feedback
Repitition
Motivation
Succes virtual
rehabilitation
Figure 2.3: Virtual rehabilitation success factor
18
Table 2.1: Previous virtual rehabilitation research
Title
Year Detection Method
Researcher
A Virtual Reality Based 2004
CyberGlove and a Adamovich, Merians,
Exercise System for
Rutgers Master
Boian,Tremaine, Burdea,
Hand Rehabilitation
II-ND haptic
Recce and Poizner
Post-Stroke
glove.
The Rehabilitation
2009
Vision based
Mnica, Bermde, Esther
Gaming System: a
tracking system
and Paul.
Review
A study to evaluate a
2010
Virtual glove
Penny, David, Steven,
low cost virtual reality
Marion, Louise, Andy,
system for home based
Fran, Kate and Andy
rehabilitation of the
upper limb following
stroke
Interactive
2013
Microsoft
Nahid, Mindy, Joyce and
Virtual Reality Game
Kinect
Philippe.
based Rehabilitation
camera
for Stroke Patients
Glove Based Virtual
2014
Data glove
Aswad , Khairunizam,
Reality (VR)
Nazrul, Shahriman, Hazry
Interaction for the
and Zuradzman
Purpose of
Rehabilitation
Game-based virtual
2015
Low cost camera Ngoc Bien Pham
rehabilitation system
for upper extremity
using low-cost camera
19
2.8
Most graphics systems contain a keyboard and a pointing device. The most
common pointing devices are the mouse, joystick and data tablet. Each pointing
device equipped with one or more buttons.
Central
processor
Graphic
processor
CPU
Memory
CPU
Memory
Frame
buffer
20
metal or rubber ball in its underside. Moving the mouse causes the ball to roll, and
sensors inside the mouse detect the movement of the ball and consequently send
signals to the cursor on the screen. Mechanical mouse use a pair of encoders to send
two orthogonal direction information to processor. Central processing unit (CPU) will
convert this information into a convenient coordinate system and use it to produce
graphics or execute specified action define by the computer program.
21
Processor function is to assign values to the pixels in the frame buffer that best
represent the entities based on the specifications of graphical primitives such as lines,
circles, and polygons, generated by application programs. For example, a triangle is
specified by three vertices, but to display a triangle is outline by the three line segments
connecting the vertices, the graphics system must generate a set of pixels that appear
as line segments to the viewer. The actual drawing or filling in of the pixels between
each vertex to make the lines is called rasterization or scan conversion.
In early graphics systems, the frame buffer was part of the standard memory
that could be directly addressed by the CPU. Today, virtually all graphics systems are
characterized by special-purpose graphics processing units (GPUs), custom-tailored
processing unit to carry out specific graphics functions. The GPU can be embedded
either on the mother board of the system or on a graphics card. The frame buffer is
accessed through the graphics processing unit and usually is on the same circuit board
as the GPU.
2.9
22
User sees an
image on the
display
Images change
according to
users input
Physical and logical input device send input to an application program in two
steps; measure process and device trigger. The measure process is how the device
respond based on the user action. The trigger of a device is a physical input on the
device with which the user can signal the computer. For example, the measure of a
keyboard contains a group of character such as hello world!, and the trigger can be
the return or enter key. For a pointing device such as optical mouse, the measure
includes the position, and the associated trigger can be a button on the pointing device.
In an environment with multiple input devices, each device has its own trigger and
each device will run a measure process. Each time that a device is triggered, an event
is generated. The device measure, with the identifier for the device, is placed in an
event queue.
independent of what the application program does with these events. This process is
shown in Figure 2.7
Trigger
process
Trigger
Measure
process
Measure
Event
queue
Await event
Program
23
2.10
Nowadays computer mouse has become a standard device for all personal
computer. Computer mouse was invented by Douglas Engelbart of Stanford Research
Centre in 1963. The mouse was officially called an X-Y Position Indicator for a
Display System (Mueller, 2011). Traditional mouse consist of a small rubber ball
which will rolls when the mouse is move across the table top. Information regarding
this ball movement will be converted into electrical signals and transmitted to the
computer across the cable.
A housing that user hold in their hand and move around on table top.
Buttons (two or more, and often a wheel or toggle switch) for making
selections.
Wheel for vertical scrolling. Some wheels tilt for horizontal scrolling
or can be pressed to act as a button.
Even though ball type mouse as illustrated in Figure 2.8 are considered
obsolete, understanding their working principle will provide the basic understanding
on how mouse can be used as a tracking device. Figure 2.9 show basic construction
of a ball mouse. A ball mouse consist of a rubber ball mounted on two rollers; one for
x-axis movement detection and the other one for detecting up and down movement
changes in y-axis direction. As the mouse move, rubber ball will move the roller which
24
will cause either one or both wheel to rotate. When mouse is move in side by side
direction only x axis wheel will turn. On the other hand when mouse is move in
upward or downward direction y axis wheel will turn. When the mouse is move in an
angle both wheel will move. These rollers are typically connected to small disks with
shutters that alternately block and allow the passage of light produce by the led. Small
optical sensors detect movement of the wheels by watching an internal IR light blink
on and off as the shutter wheel rotates and chops the light. These blinks are
translated into movement along the axes.
25
Technologies in 1999. The first generation optical mouse actually uses a tiny camera
to take thousands of pictures every second. Some of the early mouse used a sensor
that required a special grid-marked pad. Although these mice were accurate, the need
to use them with a pad caused them to fall out of favour. Recently, mouse use optical
technology to detect change in movement and they have no moving parts of their own
(except for the scroll wheel and buttons on top). Todays optical mice need no pad;
they can work on virtually any surface. This is done by upgrading the optical sensor
from the simple type used in older optical mice to a more advanced CCD (charge
coupled device. This essentially is a crude version of a video camera sensor that
detects movement by seeing the surface move under the mouse. An LED or diode
laser provides light for the sensor.
Beside the normal use such as selecting, dragging, hovering, and clicking.
Several research such as listed in Table 2.2 has been done to seek the possibilities to
use mouse as motion sensor. The motivation of this study is mouse provide an accurate
position measurement with a lower cost, compare to industrial sensor.
Year
2002
Application
Optical mouse as a two
axes displacement sensor.
2003
Optical mouse as
for vibratory
vibratory displacement
motion sensing
sensor
Digital readout
Researcher
T.W. Ng
Automated data
manometer using
Sheridan
an
optical mouse
an optical mouse.
Using optical
mouse sensors for
2003
Ng and Ang
2007
W.P.H. Kamphuis
26
sheet position
sheet displacement
measurement
sensors
2D position
2010
measurement with
sensor accuracy to
optical laser
position measurement
mouse sensor
Long range
measurements
2013
Paulo, Higinio,
Julia and Pedro
using a
contactless
low cost optical
sensor
2.11
Mouse resolution is the number of pixels per inch that the optical sensor and
focusing lens see when the mouse move. Mouse resolution is measured using Dot
per Inch (DPI). Franois Morier, Logitech Senior Engineer define mouse resolution
as the translation between hand movement and the distance covered on the screen. It
is just a factor of relation between, I move one inch, how many pixels I have covered
on the screen. This is the resolution (Wes Fenlon, 2015). In theory, if a mouse has
27
1000 DPI, then, if the mouse move one inch (2.54 cm), the mouse cursor will move
1000 pixels. Higher resolution cause the mouse moves faster and requires less effort
to get across the screen. Low resolution make a mouse moves slower and requires
more effort to get across the screen, but offers better precision. Higher resolution
displays may require higher resolution or higher mouse DPI to attain the same amount
of on-screen movement.
There are two way to change a mouse resolution; using Window mouse
properties setting and in game sensitivity setting function. In Windows, mouse settings
are controlled using the mouse properties dialog box as shown in Figure 2.10. The
Window mouse properties setting is actually a multiplier, when the slider is set at 6/11
it will keep a 1:1 ratio; for each mouse count, the cursor will move by 1 pixel. If the
slider is set higher, the pixel will skipping since window will try to move the cursor
faster than sensor's count.
28
pointer precision and the pointer speed slider located at 6/11 (= no scaling) the pointer
will also move one unit to the right. This could be called as "one-to-one" or 100%
speed. Lower pointer speeds is achieved by delaying the pointer movement until the
mouse has sent enough units to the given direction. At 50% speed the mouse has to
send 2 counts to the right before the pointer moves one count.
CHAPTER 3
RESEARCH METHODOLOGY
30
3.1
Research methodology
This project objective is to develop a system with the ability to record stroke
survivor hand arm movement information while they are practicing their hand and arm
rehabilitation to regain their upper limb movement ability. This system is named as
JDS (Jamal Dan Shokor) rehabilitation games. JDS rehabilitation games is inspired
by arm skating exercise. In this exercise stroke survivor is required to move their arm
and hand with the assistance of arm skate as shown in Figure 3.3.
Flow chart in Figure 3.1 explain the process of developing the JDS
rehabilitation games. This process is started by defining the problem. Once the
problem has been identified a flow chart which represent the solution will be produced,
later this flowchart known as pseudocode will be transferred into programming
language such as C++ to develop the solution to the problem.
JDS rehabilitation games is develop in several version. Once the program has
successfully develop, this program will be test and verify. Verification is done by
obtaining feedback either from expert, user or observation. Once the verification has
been done, improvement will be conducted based on expert or users input.
31
Start
Working correctly?
Yes
End
3.2
Problem definition
Stroke survivor will suffer several disability such as memory loss, loss ability
to communicate and paralyzed some part of their body. Stoke effect is different from
one patient to the other, this study will focus on developing a home based rehabilitation
games to help the stroke survivor to regain their upper limb movement activity. Based
on observation made at Hospital Sultan Ismail rehabilitation unit, activity such as cone
stacking (Figure 3.2), picking up small objects such as marbles and transferring it into
to another place and arm skating (Figure 3.3); moving the affected arm on table top
using the affected arm is used to help stroke survivor to regain their hand and arm
movement ability. In order to get the benefit of this exercise, stroke survivor has to
32
repeat this exercise for several time, this will lead to boredom and motivation lost.
Another disadvantage is there is no indicator for showing degree of the rehabilitation.
Research done by several researcher in several part of the world has proven
that computer games can be used as a tool in stroke rehabilitation. Computer
program will allow different set of difficulty to be set, to suit the user requirement.
Computer program can also be used to record the rehabilitation progress. Therapist
can used the recorded data to monitor their rehabilitation activity effectiveness.
These data can be converted into graphical chart and can be display at certain place
which can be seen by the stroke survivor so that they can monitor their own
rehabilitation progress.
3.3
This version serve as the basic foundation of this project. This game is develop
base on object matching games. The objective of this games is to detect the hand
movement location based on the mouse cursor position coordinate. Cursor location
will be shown on the console window as shown in Figure 3.4. Besides moving the
cursor to specific location, user must match the object shape and colour to get the
correct match. Objective of this activity is to improve the user motor and cognitive
33
skill. Figure 3.5 show the snapshot of the program. Before terminating the program,
user need to copy the coordinate location recorded on the console windows and paste
it into a notepad file. Then therapist can used formula shown in Figure 3.6 to calculate
the hand movement distance. Figure 3.7 show the pseudocode of this program.
= (2 1 )2 + (2 1 )2
Where:
1 , 1 =
2 , 2 =
Figure 3.6: Distance formula
34
Start
Display
Congratulation
Yes
Correct match?
No
Display Sorry no
match found
Esc button
press
End
35
User must be motivated to move their hand as fast and as far as they can
while doing this activity.
This point has been used as a guideline to create rehabilitation games version 2.
3.4
36
= + ( cos ((360 )
))
180
= + ( sin ((360 )
))
180
:
=
= , =
= , =
Figure 3.9: Circle coordinate calculation formula
37
Rehabilitation games version 2 is also equip with instruction to guide the user
how to use this program effectively. Hand movement data in this program is recorded
into a log file located outside of the program. This program also has a calibration
option which will allow user to set the hand movement distance required to move from
one end to the other end. Figure 3.12 show the snapshot of the console windows.
38
As shown in Figure 3.12, log file name is given based on the user name specified by
the user, console will also provide information on the log file location. Mouse speed
will determine the amount of hand movement required to move from one end to other
end, smaller number of mouse speed will produce a longer hand movement distance.
Figure 3.13 show the rehabilitation games version 2 pseudocode.
39
Start
Display instruction
End
Figure 3.13: Rehabilitation games version 2 pseudocode
This program still used manual calculation, as this program will be used by
various education background, the distance calculation should be made by the
program.
This program can only use to measure the hand movement distance only,
additional features must be added to create a rehabilitation tools.
40
3.5
User must be inform about their achievement at the end of every session.
A control feature must be included to make sure that user follow the given
instruction and stay focus on their activity.
3.5.1
JDS pong
JDS pong is inspired by from the table tennis games. The aim of this games is
to provide an activity which will help stoke survivor to regain vertical hand and arm
movement ability. This games allow the user to the hand movement distance to move
from one end to the other end based on their hand movement ability. Similar to original
table tennis game, the player will play this games with computer as their opponent.
The window border will act as the wall, each time the ball hit the wall and ball will
change its direction. The objective of this game is to prevent the ball from hitting the
bottom wall. If the ball hit the bottom wall, the computer will get a point and the ball
41
speed will increase, if the player manage to obstruct the ball movement using his bat
he will get points. Point is assign randomly by the computer based the ball location
on the bat. To play this game, user only need to put his hand and move the mouse to
the left or right side of the screen. Axis align bounding box method is used to carry
out collision detection test. Mouse movement will cause the bat to move according to
the hand movement direction. Once the user press S key to stop the game, program
will show the user achievement; either he win or lost. If the user score is higher than
computer score. Figure 3.15 to Figure 3.17 show a screen shot of this game. Figure
3.18 show the pseudocode.
42
43
Start
True
Set cursor speed
True
Increase player
score
False
True
Increase computer score and ball speed
End
3.5.2
44
animation. In this game, ball will bounce from wall to wall. Ball is drawn using
counter repetition control loop. Every time the ball hit the wall, the ball will change
its direction and speed is increase. The games objective is to encourage the player to
move his hand according to ball movement pattern. Player can stop the ball movement
by clicking the left mouse button. The target is to place the cursor on the ball area to
pause the ball movement. When the ball movement is stopped, program will compare
current pixel with specified pixel. Ball movement can be resume by clicking the
mouse button once again. This game will endure until the player press S to stop the
ball movement or press X to exit the game. This game involved two type of
movement: hand and arm movement, and finger movement. Hand and arm movement
is required to move cursor across the screen. Finger movement is needed to press the
mouse button to stop and resume the ball movement. Figure 3.19 show the JDS
bouncing ball screenshot and Figure 3.20 show the pseudocode of JDS pong games.
Radius 1
Radius 2
Radius 3
Figure 3.19: JDS bouncing ball screen shot
45
Start
Select
difficulty
level
False
True
Set cursor speed
Create application
windows
True
Change the
ball movement
direction
Mouse button
pressed (1)
Stop ball
movement
Cursor located
on the ball?
False
Print You
missed, try
again
True
Mouse button
pressed (2)
End
46
3.5.3
JDS connect the dot is develop based on kids dot connecting activity. The
objective of this game is to enhance hand movement in various direction while the user
use the mouse to connect a set of dot to create certain shape. Five shape with different
level of difficulty has been selected for this activity. Figure 3.21 and Figure 3.22 show
the JDS connecting the dot screenshot.
Beside enhancing the user hand movement, while playing this games user need
to adhere certain rules; user cannot quit the game before all the dot is connected, on
the other hand user must comply the maximum number of mouse click to complete
this game. Error message as shown in Figure 3.23 and Figure 3.24 will be display if
the user fail to comply the rules. Message in Figure 3.25 will be display if the user
manage to complete the given task. Figure 3.26 show the pseudocode.
47
48
49
Start
Select hand
movement
ability level
True
Set cursor speed
Select object
shape
False
True
Esc button pressed
Display
window and
draw shape
Draw line
from position
1 to position 2
End
False
50
3.5.4
JDS hand movement speed calculation tool as shown in Figure 3.27 is design
to provide tools to measure hand movement speed. User can use information from this
application to compare the hand movement speed between the affected limbs and the
unaffected limbs, the rehabilitation goal is to train the affected limb so it can move as
fast as the unaffected limb.
Figure 3.27: JDS hand movement speed calculation tools snap shot
51
Start
Print greeting
True
False
True
False
End
52
JDS hand movement speed calculation tool application windows size is set to
700 x 700 pixel. This create a coordinate system ranging from 0 to 700 in x axis and
0 to 700 in y axis. All mouse click location detected by JDS hand movement speed
calculation tool will be recorded in log a file. Besides recording the cursor location,
this program also record the time duration taken to move for initial point to end point.
This data will use by the program to calculate the hand movement speed using the
formula shown in Figure 3.29. Output of the program is shown in Figure 3.30.
, =
( )
()
:
=
Figure 3.29: Hand movement speed calculation formula
53
3.6
Introduction:
Optical mice contain a light emitting diode (LED) and a little camera. As the
mouse move around, the light shines on the surface below the mouse and the camera
takes hundreds of pictures per second. The mouse compares the pictures and
determines the direction which the mouse is moving. The mouse then sends this
movement data to the computer as mouse input, and the computer moves the cursor
across the screen.
The pixel is originated from the word picture element; is the basic unit of
programmable colour on a computer display or in a computer image. The physical
size of a pixel depends on the resolution for the display screen. Display screen
resolution is the number of pixels or individual points of colour contained on a display
monitor. If the display screen display resolution is set to its maximum resolution, the
physical size of a pixel will equal the physical size of the dot pitch or the dot size of
the display. The dot pitch is measured in millimetres (mm) and a smaller number
means a sharper image. In desktop monitors, common dot pitches are .31mm, .28mm,
.27mm, .26mm, and .25mm. Personal computer users will usually use .28mm or finer.
Optical sensor resolution number of pixel that can be fitted into one inch. For
example if the pixel size 0.03 mm or 30 micron, the mouse DPI is 840 DPI. Dots per
inch (DPI) refer to the number of image that a mouse sensor can take for every inch it
is moved. The higher a mouses DPI, the farther the cursor will move on screen when
the mouse is move. A mouse with a higher DPI setting detects and reacts to smaller
movements. Some mouse models include dedicated buttons (DPI on-the-fly buttons)
which can be used to instantly adjust the mouse sensitivity (DPI).
54
Experiment objective:
Objective of this study is to validate the effect of mouse hardware DPI to hand
movement distance to move computer cursor using JDS hand movement speed
calculation tools.
Equipment:
1. Complete set of computer.
2. JDS hand movement speed calculation tools software.
3. Graph paper.
4. Ruler
5. Cellulose tape.
6. Logitech G502 Proteus Core Tuneable Gaming Mouse (Figure 3.31).
Experiment procedure:
1. Launch JDS hand movement speed calculation tools software.
2. Stick a graph paper on flat surface.
3. Set Logitech G502 DPI to 1200 DPI.
4. Follow instruction given in the JDS hand movement calculation tools to
record the hand movement distance required to movement the cursor 50 pixel
from the centre of the screen. Use the graph paper to measure the hand
distance and record the result. Repeat this each measurement for 3 times.
55
5. Repeat step 4 to measure the hand movement distance of 100, 200 and 300
pixel from the centre of the screen.
6. Record the result.
Result of this experiment will be discuss in chapter 4.
3.7
distance
Introduction:
Gaming mouse is a special mouse design to use with computer games. Gaming
mouse typically employ a wide array of controls and buttons and have designs that
differ radically from traditional mice. Gaming mouse is equip with DPI switch known
as on the fly DPI which enables user to adjust the mouse's sensitivity to a faster or
slower pointer speed. In gaming mouse, DPI increment is produce by subdividing
those pixels into smaller increments, this is done using sensor algorithm. Changes in
DPI value will affect the accuracy, but it will produce a much more sensitive system;
reduce the distance to produce a single count.
DPI is defined as the number of pixel that a mouse can count in one inch. For
example, to move 1000 pixel on screen will required the user to move their hand for 1
inch. Using this relationship formula as shown in Figure 3.32 is develop.
2.54
= (
)
:
= .
=
Figure 3.32: Hand movement distance calculation formula
56
Experiment objective:
Objective this study is investigate the effect of mouse sensor DPI to hand movement
distance required to move the cursor from one point to other point. This study will
compare the hand movement distance required to movement cursor from the centre
of the screen to specific location using Logitech M325 mouse and Logitech M502
mouse.
Equipment:
1. Complete set of computer.
2. JDS hand movement speed calculation tools software.
3. Graph paper.
4. Ruler
5. Cellulose tape.
6. Logitech G502 Proteus Core Tuneable Gaming Mouse.
7. Logitech M325 mouse (Figure 3.33).
Experiment procedure:
1. Launch JDS hand movement speed calculation tools software.
2. Stick a graph paper on flat surface.
3. Set Logitech G502 DPI to 1000 DPI.
4. Follow instruction given in the JDS hand movement calculation tools to
record the hand movement distance required to movement the cursor 50 pixel
57
from the centre of the screen. Use the graph paper to measure the hand
distance and record the result. Repeat this each measurement for 3 times.
5. Repeat step 4 to measure the hand movement distance of 100, 200 and 300
pixel from the centre of the screen.
6. Repeat step 4 and 5 using Logitech M325 mouse.
7. Record the result.
Result of this experiment will be discuss in chapter 4.
3.8
Introduction:
Mouse sensitivity determine the speed or how fast the cursor will move across
the computer screen. Higher mouse sensitivity will produce a quick response and
reduce the hand movement distance to move the cursor across the computer screen.
On the other hand, low sensitivity will reduce the cursor movement speed and increase
the hand movement distance to move the cursor across the screen.
58
= (
2.54
)
:
= .
=
=
2.54 = .
Figure 3.35: In games sensitivity setting effect calculation formula
Experiment objective:
Objective of this experiment is to validate the effect of in game sensitivity setting to
hand movement distance to move computer cursor in JDS rehabilitation games. In
59
games sensitivity setting can be adjusted using the hand ability movement option in
JDS rehabilitation games.
Equipment:
1. Complete set of computer.
2. JDS hand movement speed calculation tools software.
3. Graph paper.
4. Ruler
5. Cellulose tape.
6. Logitech M325 mouse
Experiment procedure:
1. Launch JDS hand movement speed calculation tools software.
2. Stick a graph paper on flat surface.
3. Set the hand ability value to 1.
4. Follow instruction given in the JDS hand movement calculation tools to
record the hand movement distance required to movement the cursor 50 pixel
from the centre of the screen. Use the graph paper to measure the hand
distance and record the result. Repeat this each measurement for 3 times.
5. Repeat step 4 to measure the hand movement distance of 100, 200 and 300
pixel from the centre of the screen.
6. Repeat step 4 and 5 with the hand ability setting is change to 2, 3 and 4.
7. Record the result.
Result of this experiment will be discuss in chapter 4.
60
3.9
Figure 3.36: JDS hand movement speed calculation tools calibration option
61
3.10
Every game except JDS Pong is equip with a log file. Log file will record
information such as user name, program start time, program stop time, hand movement
start time, hand movement stop time and cursor location. Cursor location referring to
the distance measured in pixel from screen center to the destination.
Log file content is different based on the games objective. JDS bouncing ball
game log file as shown in Table 3.1 will record the mouse click location made by the
user and determine whether the user manage to hit the ball or not. Table 3.2 show
connect the dot log file content this log file only record the coordinate location and
time duration.
JDS hand movement speed calculation tools log file as shown in Table 3.2 will
record the hand movement coordinate and calculate the hand movement speed. The
JDS log file will record the hand movement coordinate (pixel), hand movement
duration (seconds), hand movement distance (cm) and hand movement speed (cm/sec).
All calculation is done automatically by the program. Data recorded by the log file
can be use by the therapist and stroke survivors to monitor their rehabilitation progress
test1
17/03/2016
Begin time:
Point
1
2
3
4
5
End date :
505
336
344
154
217
17/03/2016
13:28:48
389
451
218
176
145
End time:
Hit target
Hit target
Missed target
Missed target
Hit target
13:29:15
62
Table 3.2: JDS connecting the dot log file content
User name:
test1
Begin date :
Shape:
Point
Begin
17/03/2016 time:
Square
X
1
2
3
4
5
End date :
70
69
628
69
631
17/03/2016
Time taken
to complete:
12:30:00
70
629
630
71
71
End time:
12:30:16
Hours
0 Minutes
16
Seconds
Table 3.3: JDS hand movement speed calculation tools log file
350
130
350
34
349
675
End date : 18/03/2016
Begin time:
13:00:43
Distance Duration
(Cm)
(Second)
348
628
349
14
351
16
Speed
(Cm/Second)
Location
2.2512
2.2512 Zone 5
2.92894
1.46447 Zone 5
2.95927
1.47964 Zone 5
13:01:07
End time:
Chart in Figure 3.37 is produce by plotting the coordinate value from the JDS
bouncing ball games log file. Plotting the coordinate value from JDS connecting the
dot log file will produce hand movement chart as shown in Figure 3.38.
63
Y coordinate
500
400
300
200
100
0
0
100
200
300
400
500
600
X coordinate
Figure 3.38: JDS connecting the dot hand movement pattern chart
64
3.11
Conclusion
Repetition and high motivation is the most important factor in increasing the
rehabilitation activity success. Repetition will cause boredom. In this game different
level of difficulty is used to reduce the boredom effect. This system will also provide
feedback in term of score to increase the user motivation.
In general this project has achieve its objective to produce a system which has
the ability to help stroke survivors to regain their upper limb movement ability, but the
effectiveness of the system can only be measured when the stroke survivor and
rehabilitation unit staff has the desire to use this system as a part of their rehabilitation
activity. Wise man says you can lead a horse to water, but you cannot make it drink.
CHAPTER 4
This chapter will discuss the result and finding from experiment describe in chapter 3.
Experiment result show that mouse hardware DPI and in games sensitivity setting
value in JDS rehabilitation games has direct influenced to hand movement distance to
move cursor from one point to the other point.
4.1
This test is done using Logitech G502 Proteus Core Tuneable Gaming Mouse,
this mouse has the pointer setting option as shown in Figure 4.1 which allow user to
change the mouse DPI setting from 200 DPI to 12 000 DPI. The objective of this
experiment is to validate the effect of different mouse DPI to the hand movement
distance required to move from one point to other point. In this experiment the hand
movement distance to move from the centre of the screen to certain location is
recorded in Table 4.1.
movement distance can be represented as; higher mouse DPI will decrease the hand
distance required to move from one to another point, lower mouse DPI with lead to
higher effort to move cursor from one to another point.
66
Table 4.1: Mouse DPI Vs Hand movement distance
Mouse model:
Mouse DPI
50
100
200
300
1200
16
24
1000
10
20
30
800
12
24
36
600
16
32
48
400
12
24
48
72
200
27
54
108
162
Chart in Figure 4.2 illustrate the relationship between the mouse DPI and hand
movement distance. Using the chart, we can conclude that user has to move his hand
further to move from one point to other point when using a mouse with lower DPI for
example to move 300 pixel on computer screen with 200 DPI mouse the user must
move his hand for 162 mm, on the other hand the user only need to move 28 mm to
move the same distance on screen with 1000 DPI mouse. Relationship between hand
movement distance and cursor movement distance is govern by equation in Figure 4.3.
This study show that mouse hardware DPI value will influence the hand movement
distance to move cursor from one to another point.
67
1200 = 0.08
1000 : = 0.1
800 : = 0.12
600 : = 0.16
400 : = 0.24
200 : = 0.24
Figure 4.3: Relationship between mouse DPI and hand movement distance
4.2
Effect of single DPI mouse and multiple DPI mouse to hand movement
distance
This section will study the effect of single DPI and multi DPI mouse to the
accuracy of hand movement distance calculation using JDS hand movement
calculation tools. Objective of this section to choose a mouse which will provide a
better accuracy during the measurement process using JDS hand movement
calculation tools.
68
In this study the hand distance taken to move from one point to another point
using two type of mouse; single DPI mouse, Logitech M 325 and Logitech M502,
gaming mouse with variable DPI setting is recorded and compared. Measurement
will be carry out using 1000 DPI setting.
Table 4.2 show the hand movement distance required to move the cursor along
to 4 different location from the centre of the screen using location variable DPI mouse.
The relationship the mouse and hand movement distance as shown in Figure 4.4 is
govern by formula in Figure 4.5.
Table 4.2: Hand movement distance using Logitech Proteus Core G502
Mouse model:
Cursor
distance
Hand distance
(Pixel)
actual (mm)
50
5
100
10
200
20
300
30
Figure 4.4: Comparison between actual and theoretical hand movement distance
using Logitech M502 mouse
69
= 0.1
Figure 4.5: Relationship between hand and cursor distance using Logitech Proteus
Core G502
Table 4.3 show the hand movement distance required to move the cursor
along to 4 different location from the centre of the screen using location single DPI
mouse. The relationship the mouse and hand movement distance as shown in Figure
4.6 is govern by formula in Figure 4.7.
Error between theoretical and actual hand movement distance required to move
from one point to the other point using Logitech G502 mouse is 294%, on the other
hand the error between theoretical hand movement and actual hand movement
distance required to move from one point to the other point using Logitech M325
mouse is 2.56%, this result show that between Logitech G502 and Logitech M325,
Logitech M325 will produce a better accuracy to measure the hand movement
distance.
Logitech M325
Hand distance
actual (mm)
1.2
2.5
5.0
7.5
Hand
distance
theory (mm)
1.27
2.54
5.08
7.62
Different
(mm)
-0.07
-0.04
-0.08
-0.12
Error percentage
(%)
-5.51%
-1.57%
-1.57%
-1.57%
-2.56%
70
= 0.025
Figure 4.7: Relationship between hand and cursor distance using Logitech M325
4.3
This section will study the effect of in game mouse sensitivity setting to the
hand movement distance while playing the JDS rehabilitation games. Experiment
result is shown in Table 4.4. Relationship between the in games sensitivity and hand
movement distance required to move from one point to other point in shown in
Figure 4.8; lower in games sensitivity value will force the hand to move further
compared to high in game sensitivity value for the same cursor movement distance.
71
Table 4.4: Effect of in games sensitivity value to hand movement distance
Cursor movement (Pixel)
50
100
200
300
In game sensitivity
Hand movement distance (mm)
0
1
2
5
8
0.1
25
50
100
150
0.2
12.5
25
50
75
0.3
8
16
32
50
0.4
6
12
25
38
Figure 4.8: Effect of hand in games sensitivity setting to hand movement distance