BLUE EYES TECHNOLOGY

PRESENTED BY
PRIYANKA MEENA
ROLL NO 12469
ECE

INTRODUCTION.
WHAT

CONTENTS

IS BLUE EYES TECHNOLOGY?

WHY BLUE EYES TECHOLOGY?
SYSTEM OVERVIEW
DATA ACQUSITION UNIT
JAZZ MULTISENSOR
CENTRAL SYSTEM UNIT
DATA ANALYSIS MODEL
DATA LOGGER MODEL
VISUALISATION MODEL
TECHNIQUE USED
APPLICATION
CONCLUSION

INTRODUCTION

BLUE EYES TECHNOLOGY started at IBMs Almaden

Research Centre in USA

The BLUE EYES technology aims at creating

computational machines that have perceptual and
sensory ability like those of human beings.

It verifies your identity, feels your presents, and starts

interacting with you .

Human cognition depends primarily on the ability to

perceive, interpret, and integrate audio-visuals and
sensoring information.

Monitors and records operators conscious brain

WHAT IS BLUE EYES ??

BLUE- Bluetooth

EYES eye moment enable to obtain lot of

information

Key feature are :

Visual attention monitoring.

Physiological condition monitoring.

Operators position detection.

Wireless data acquisition.

Real time user defined alarm triggering

SYSTEM OVERVIEW

Blue

eyes system monitors the status of the operators visual

attention through measurement of saccadic activity.
The system checks parameters like heart beat rate and blood
oxygenation against abnormal and triggers user defined alarms.

The major parts in the Blue eye system:

1. Data Acquisition Unit and
2. Central System Unit.

System overview

Data Acquisition
Unit

DATA ACQUISITION UNIT:

1. Data Acquisition Unit is a mobile part of the

Blue
eye system.
2. Its main task is to fetch the physiological
data from the sensor and to send it to the
central system to be processed.
3.Personal ID cards and PIN codes provide
operator's authorization.
4. Atmel 89C52 microcontroller - system core.

Data Acquisition Unit

4. Bluetooth module (based on ROK101008)
6. HD44780 - small LCD display
7. MC145483 13bit codec
8. Jazz Multisensory interface
9. Beeper and LED indicators, 6 AA batteries and
voltage level monitor.
10. 24C16 - I2C EEPROM (on a removable ID
card)

JAZZ
MULTISENSOR

JAZZ
MULTISENSOR

Supplies raw physical data regarding eye

position, level of blood oxygenation .

Eye position measuring direct infrared

oculography

Oxy and deoxyheamoglobin measurement.

Two axial accelerometer

Ambient light sensor

CENTRAL SYSTEM UNI

Maintain bluetooth connections.

Buffer incoming sensor data.

Perform on line data analysis .

Record the conclusion for further

exploration.

Provide visualisation interface.

PCM codec for voice data transmission .

Module is interfaced to a PC using a

Central System Unit

There are four main CSU modules.

1. Connection Manager,
2. Data
Analysis,
3. Data Logger
4. Visualization.

CONNECTION MANAGER
manages wireless communication between DAU and central system.

Connection manager handles:

Communication with CSU hardware

Searching for new devices in covered range

Establishing Bluetooth connections

Connection authentication

Incoming data buffering

Sending alerts

DATA ANALYSIS
MODULE

Analysis of raw sensor data.

Supervises working operators.

Large number of smaller analysers extracting information .

The most important analyser are :

Saccade detector monitors eye movements in order to determine

the level of operators visual attention

Pulse rate analyser-uses blood oxygenation signal to compute

operators pulse rate.

Custom analyser-recognize other behaviours than those which are

built in the system.

DATA LOGGER
MODULE

The raw or processed physiological data,

alerts and operators voice are stored.

A voice data acquisition module delivers the

voice data

VISUALISATION
MODULE

Provide a user interface for the supervisors.

Enables to watch each of the working operators

physiological condition.

Incoming alarm messages are instantly signalled.

Can be set in an offline mode, where all data is fetched from

database.

Reconstruct course of selected operators duty.

TECHNOLOGIES
USED

Emotion mouse

Manual and gaze input cascaded (MAGIC).

Artificial intelligent speech recognition.

Simple user interest tracker(SUITOR).

EMOTION MOUSE

Non intensive method for gaining user

information through touch .

Measure heart rate ,temperature ,galvanic skin

response and minute bodily movements.

Matches with six emotional states :happiness,

surprise, anger, fear ,sadness, and disgust.

Includes different sensors including pressure

sensor heart beat sensor ,temperature sensor .

EMOTION MOUSE

MANUAL AND GAZE INPUT

CASCADING (MAGIC)

Pointing appears to user

to be a manual task

Used for fine

manipulation and
selection.

Webcam is used to
determine glints and
pupils of user.

wrap curser to every new

object cursor looks at.

This combines Manual Pointing and Eye Gaze pointing

Manual pointing appears to the user to be a manual
task, used for fine manipulation and selection.
Eye Gaze warps the cursor to the eye gaze area,
which encompasses the target.
There are 2 approaches for MAGIC:
1.

Liberal Pointing

2.

Conservative pointing

SPEECH
RECOGNITION
1. User speaks to computer through a
microphone .
2. Switched capacitor digital filter are used.
3. ADC samples filter outputs.
4. Each sample represents different amplitude of
signal .
5. Converted to binary number proportional to
amplitude of sample.
6. Binary representation of words become
standards/templates and stored in memory .
7. Input words are scanned and matched .

SIMPLE USER INTEREST

TRACKER

Fetches more information at desktop .

Notice where users eyes focus on the

screen .

Precise in determining users topic of

interest .

Deliver relevant information to a

handheld device.

Eg if reading headline ,pops up story

in browser window.

LIMITATION OF BLUE EYES

TECHNOLOGY
1.

Target not selected if not looked at for a set

threshold.

2.

Target selected if stared at without user

intention

APPLICATIONS
IN

POD CAR

The first blue eye

enabled mass production
device was POD the car
manufactured by TOYOTA.

It could keep driver alert and

active.

It could tell the driver to go

slow if he is driving too fast .

Also it could hear the driver

some sort of interesting music

Another application would be in the automobile industry. By

simply touching a computer input device such as a mouse, the
computer system is designed to be able to determine a
person's emotional state. for cars, it could be useful to help
with critical decisions like:

"I know you want to get into the fast lane, but I'm
afraid I can't do that.You are too upset right now" and therefore
assist in driving safely.

major application of speech processing is in military

operations. Voice control of weapons is an example

In retailing record and interpret customer movements.

Power station .

Flight control centres .

Operating theatres

eg - A blue eyes enabled TV set would become

active when we look in its directions. Voice commands
could then tune your favourite channel and adjust the
volume.

CONCLUSION

In future it is possible to create a computer which can interact

with us as we interact each other with the use of blue eye
technology. It seems to be a fiction, but it will be the life lead by
BLUE EYES in the very near future. Ordinary household
devices -- such as televisions, refrigerators, and ovens -- may be
able to do their jobs when we look at them and speak to them.