GazePointer: A real time Mouse Pointer Control implementation based on Eye Gaze Tracking

GazePointer: A real time Mouse Pointer Control implementation based on Eye Gaze Tracking
Introduction:
The field of Human-Computer Interaction (HCI) has witnessed a tremendous growth in the past decade. The advent of tablet PCs and cell phones allowing touch-based control has been hailed warmly. The researchers in this field have also explored the potential of 'eye-gaze' as a possible means of interaction. Some commercial solutions have already been launched, but they are as yet expensive and offer limited usability. This project strives to develop a low cost real time system for eye-gaze based human-computer interaction.

Objectives:
Developing an algorithm that will acquire, process and analyze video frames and extract the following: o Face o Head Posture o Eyes Detecting center of Iris (Pupil). Designing an algorithm to detect point of gaze (PoG) from both eyes. Developing a simple calibration method to increase accuracy. Developing a Graphical User Interface (GUI) to show results and conclusions.

Extended Objectives:

GazePointer: A real time Mouse Pointer Control implementation based on Eye Gaze Tracking

Methodology:
Start

GazePointer

Start GazePointer

Acquire Video frames from webcam

Image Preprocessing Facial Features Extraction

Face Detection

Eye Features Extraction Eyes Region Extraction

Centre of Iris finding

Point of Gaze calculation

Screen Co-ordinates

Cursor

Figure (1): System Flow Chart

Classification/tracking & learning algorithms will be implemented.

GazePointer: A real time Mouse Pointer Control implementation based on Eye Gaze Tracking

Deliverables:
A GUI which will have following sections: o Test area (for Mouse Pointer ) o Area showing eyes location o Area showing screen co-ordinates for both eyes and cursor position. o Area showing tabs for controlling pointer speed.

Features:
User registration Distance calculation Face detection Head posture estimation Eyes Detection Pupil/Centre of Iris sensing Discovering Point of Gaze co-ordinates Pointer Control configuration options

Timeline:

Tools:
PC/LAPTOP USB Webcam / Built-in webcam MATLAB/openCV

GazePointer: A real time Mouse Pointer Control implementation based on Eye Gaze Tracking

Applications:
Mouse control Keyboard control Appliances control o E.g. TV, lights etc. Neuroscience o Attention investigation o Brain imaging Study of Human visual attention (Psychology) Aviation/Driving Advertising effectiveness

GazePointer: A real time Mouse Pointer Control implementation based on Eye Gaze Tracking

References:
1. Duchowski, A. T., "A Breadth-First Survey of Eye Tracking Applications", Behavior Research Methods, Instruments, & Computers (BRMIC), 34(4), November 2002, pp.455-470. 2. R.J.K. Jacob and K.S. Karn, Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the Promises (Section Commentary), in The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research, ed. by J. Hyona, R. Radach, and H. Deubel, pp. 573-605, Amsterdam, Elsevier Science (2003).