BLUE EYES – The Blank

Intelligence
“When human rest...Computers will arise”
Adam will deco

Authors: Krishna Teja G S (3rd yr CSE)

Email: shaadomanthra@yahoo.com
Mobile: 9293183153
Topic: BLUE EYES – The Blank Intelligence
Collage: Swami Vivekananda Institute of Technology (SVIT)

understand your emotions at the touch of the

mouse. It verifies your identity, feels your
presents, and starts interacting with you .You
ask the computer to dial to your friend at his
ABSTRACT: office. It realizes the urgency of the situation
through the mouse, dials your friend at his
Animal survival depends on highly developed office, and establishes a connection.
sensory abilities. Likewise, human cognition
depends on highly developed abilities to Human cognition depends primarily on the
perceive, integrate, and interpret visual, ability to perceive, interpret, and integrate
auditory, and touch information. Without a audio-visuals and sensoring information.
doubt, computers would be much more Adding extraordinary perceptual abilities to
computers would enable computers to work
powerful if they had even a small fraction of
together with human beings as intimate
the perceptual ability of animals or humans. partners. Researchers are attempting to add
Adding such perceptual abilities to computers more capabilities to computers that will allow
would enable computers and humans to work them to interact like humans, recognize human
together more as partners. Toward this end, presents, talk, listen, or even guess their
the BlueEyes project aims at creating feelings.
computational devices with the sort of The BLUE EYES technology aims at creating
computational machines that have perceptual
perceptual abilities that people take for
and sensory ability like those of human beings.
granted. It uses non-obtrusive sensing method,
employing most modern video cameras and
microphones to identifies the users actions
through the use of imparted sensory abilities .
Imagine yourself in a world where humans The machine can understand what a user wants,
interact with computers. You are sitting in front where he is looking at, and even realize his
of your personal computer that can listen, talk, physical or emotional states.
or even scream aloud. It has the ability to
gather information about you and interact with The basic idea behind this technology is to give
you through special techniques like facial the computer the human power. We all have
recognition, speech recognition, etc. It can even some perceptual abilities. That is we can
BLUE EYES – The Blank Intelligence

understand each others feelings. For example the six emotional states fit within a four
we can understand ones emotional state by dimensional model. For the second analysis, a
analyzing his facial expression. If we add these discriminant function analysis was used to
perceptual abilities of human to computers determine the mathematic functions that would
would enable computers to work together with distinguish the six emotional states.
human beings as intimate partners. The "BLUE
EYES" technology aims at creating
computational machines that have perceptual
and sensory ability like those of human beings.

Theory
Based on Paul Ekman's facial expression work,
we see a correlation between a person's
emotional state and a person's physiological
measurements. Selected works from Ekman
and others on measuring facial behaviors
describe Ekman's Facial Action Coding System
This analysis suggested that all four
(Ekman and Rosenberg, 1997). One of his
physiological variables made significant,
experiments involved participants attached to
nonredundant contributions to the functions
devices to record certain measurements
that distinguish the six states. Moreover, these
including pulse, galvanic skin response (GSR),
analyses indicate that these four physiological
temperature, somatic movement and blood
measures are sufficient to determine reliably a
pressure. He then recorded the measurements
person's specific emotional state. Because of
as the participants were instructed to mimic
our need to incorporate these measurements
facial expressions which corresponded to the
into a small, non-intrusive form, we will
six basic emotions. He defined the six basic
explore taking these measurements from the
emotions as anger, fear, sadness, disgust, joy
hand. The amount of conductivity of the skin is
and surprise. From this work, Dryer (1993)
best taken from the fingers. However, the other
determined how physiological measures could
measures may not be as obvious or robust. We
be used to distinguish various emotional states.
hypothesize that changes in the temperature of
the finger are reliable for prediction of emotion.
Six participants were trained to exhibit the
We also hypothesize the GSA can be measured
facial expressions of the six basic emotions.
by change in movement in the computer
While each participant exhibited these
mouse.
expressions, the physiological changes
associated with affect were assessed. The
IBM Blue Eyes project gets to know users
measures taken were GSR, heart rate, skin
better
temperature and general somatic activity
By Gerry A. Plaza Inquirer News Service
(GSA). These data were then subject to two
analyses. For the first analysis, a
SAN JOSE, California--Ever think your
multidimensional scaling (MDS) procedure
computer might one day pester you with
was used to determine the dimensionality of the
messages of love or take up arms in a fit of rage
data. This analysis suggested that the
over your insensitivity?
physiological similarities and dissimilarities of
BLUE EYES – The Blank Intelligence

A scene right out of an ’80s flick, "Electric
Dreams," you infer. Well, it’s not science
fiction, this is starting to become a reality.
If researchers at IBM’s Almaden Research
Center here are to be believed, we could then
soon see computers that actually know you hate
them, or in turn appreciate them for a job well
done.
subject’s emotions are evident with a grip on
the pointing device.
These cues are analyzed to determine the user’s
physical, emotional, or informational state,
which can be used to increase productivity.
This is done by performing expected actions or
by providing expected information.

Their initiative to make this happen: the Blue

Your gaze
Eyes research project currently being
A prototype shown to the Inquirer by Blue
implemented by the center’s user systems
Eyes researchers at Almaden reveals a nifty
ergonomic research group (User). Blue Eyes
computer interface controlled by, well, a simple
seeks attentive computation by integrating
gaze. By tracking where the person is looking,
perceptual abilities to computers wherein non-
the computer can make consequent operations
obtrusive sensing technology, such as video
it knows the user wants done.
cameras and microphones, are used to identify
and observe your actions.

As you walk by the computer screen, for

example, the camera would immediately
"sense" your presence and automatically turn
on room lights, the television, or radio while
popping up your favorite Internet website on
the display.

Part of this project is not only teaching

computers how to sense or perceive user action.
They are also being programmed to know how
users feel--depressed, ecstatic, bored, amused,
or anxious--and make a corresponding
response. Computers can, on their own, play a
funny Flash animation feature to entertain its
"master" if it notices a sad look on his or her
face.
Voice or sound capabilities can also be
integrated, with the computer "talking" to his
user about the task at hand or simply
acknowledging a command with a respectful,
"yes, sir."
In these cases, the computer extracts key
information, such as where the user is looking,
what he or she is saying or gesturing or how the
Called the "simple user Internet tracker" or
Suitor, the computer tracks eye movement in
the display while on the background takes note
of applications the user normally utilizes and
the websites he or she constantly visits. By
having this information, the computer then
"serves" its user without any manual operation.
A user may hit www.inquirer.net and gaze at an
interesting headline. The computer then notices
this. It would pop up the headline’s full story in
an instant without any mouseclicks. Another
example is visiting a corporate site such as
www.ibm.com. When the user sets his sights
on "corporate information," a stock ticker
suddenly appears showing IBM’s current share
BLUE EYES – The Blank Intelligence
price. This ticker also presents "related news
stories" pertaining to IBM’s business.
Pong and Magic
Almaden researchers also presented a robot
called "Pong" that observes retinal activity and
recognizes user presence and respond
accordingly with, say, a human-like smile or
computer-based action like initializing a
desktop PC.
This "attentive" robot created by the User
group dramatizes computers’ emerging
awareness by sensing people’s presence and
reacting to their comings and goings.
"Pong" utilizes a small video camera to provide emotional states: happiness, surprise, anger,
attention to its user. This camera is part of
another prototype named Magic pointing,
which allows the eyes to affect the movement
of the cursor. This functionality can only allow
the cursor to arrive at the point where the user
gazes by having him or her touch the pointing
device first. If the cursor were to move where
the eyes go, the operation would be
unproductive and impractical, the researchers
say, because this leaves the user exhausted and
confused.
Emotion mouse
Not only is User developing prototypes to
recognize eye movement, but it is also looking
at an intelligent pointing device that directly
captures relevant data on the user’s emotional
patterns. The computer therefore can either
slow down, when he determines the user is
anxious or tired, or speed up, when he
identifies that the user is in a hurry.
The pointing device is called the emotion
mouse, another prototype being developed at
Almaden that can track a user’s mood or
emotional state and make the computer respond
accordingly.
The device can measure heart rate, temperature,
galvanic skin response and minute bodily
movements and matches them with six
fear, sadness and disgust.
BLUE EYES – The Blank Intelligence

Conclusion:
In the future, ordinary household devices --
such as televisions, refrigerators, and ovens
-- may be able to do their jobs when we look
at them and speak to them.

Data collected from:

www.almaden.ibm.com/cs/blueeyes.
The mouse includes a set of sensors, including
infrared detectors and temperature-sensitive
chips. These components, User researchers
stress, will also be crafted into other commonly
used items such as the office chair, the steering
wheel, the keyboard and the phone handle.
Integrating the system into the steering wheel,
for instance, could allow an alert to be sounded
when a driver becomes drowsy.

These prototypes, among others in its Blue

Eyes project, provide a sneak peak into the
future of computing. As the human-computer
interaction continues to be enhanced
--especially with a targeted commercial roll-out
in at least five years--another major stride in
facing a new frontier in computer technology
has been achieved.