MIND READING COMPUTERS

BY

AMAN RAJ (1221510004)

Submitted to the Department of COMPUTER SCIENCE

In partial fulfillment of the requirements
For the degree of
Bachelor of Technology
In
COMPUTER SCIENCE

SHREE GANPATI INSTITUTE OF

TECHNOLOGY
U.P. Technical University
2015
1
 DECLARATION

I hereby declare that this submission is my own work and that, to the best of my knowledge and belief,
it contains no material previously published or written by another person nor material which to a
substantial extent has been accepted for the award of any other degree or diploma of the university or
other institute of higher learning, except where due acknowledgment has been made in the text.

SIGNATURE

AMAN RAJ (1221510004)

2
 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

CERTIFICATE

This is certified that the project report entitled Mind Reading computers is a bonafide work carrie d
out by AMAN RAJ (1221510004) in the partial fulfillment for the award of Degree of Bachelor of
Technology in department of Computer Science And Engineering of Uttar Pradesh Technica l
University during the year 2014-2015, is a record of the candidate own work carried out by him
under my/our supervision. The matter embodied in this thesis is original and has not been
submitted for the award of any other degree.

Date: Supervisor

Prof. Pradeep Tripathi

3
 ACKNOWLEDGEMENT

It gives us a great sense of pleasure to present the report of the B. Tech Project undertaken during B.
Tech. Pre-Final Year. We owe special debt of gratitude to Professor Prof. AVINASH SHAMA, Project
Coordinator, Department of Computer Science & Engineering, SGIT, GHAZIABAD for his constant
support and guidance throughout the course of our work. His sincerity, thoroughness and perseverance
have been a constant source of inspiration for us. It is only his cognizant efforts that our endeavors have
seen light of the day.
We also take the opportunity to acknowledge the contribution of Prof. VIPIN. DEVAL, Head,
Department of Computer Science & Engineering, SGIT, GHAZIABAD for his full support and assistance
during the development of the project.
We also do not like to miss the opportunity to acknowledge the contribution of all faculty members of
the department for their kind assistance and cooperation during the development of our project. Last but
not the least, we acknowledge our friends for their contribution in the completion of the project.

Date:

AMAN RAJ (1121510004)

4
 ABSTRACT

People express their mental states, including emotions, thoughts and desires, all the time through facial
expressions, vocal nuances and gestures. Mind reading machine is co-ordination of human psychology
and computer techniques. Some equipment are used to gather data & then analyzed. To use those data
for further prediction of mind is known as theory of mind reading. Existing human-computer interfaces
are mind-blind, they are unaware to the user’s mental states and intentions.

Drawing inspiration from psychology, computer vision and machine learning, the team in the Computer
Laboratory at the University of Cambridge has developed mind-reading machines - computers that
implement a computational model of mind-reading to infer mental states of people from their facial
signals. The goal is to enhance human-computer interaction through empathic responses, to improve the
productivity of the user and to enable applications to initiate interactions with and on behalf of the user,
without waiting for explicit input from that user. There are difficult challenges:

Using a digital video camera, the mind-reading computer system analyzes a person's facial expressions
in real time and infers that person's underlying mental state, such as whether he or she is agreeing or
disagreeing, interested or bored, thinking or confused.

5
 TABLE OF CONTENTS Page.no.

TITLE PAGE……………………………………………………………………………… i
DECLARATION................................................................................................................ ii
CERTIFICATE.................................................................................................................. iii
ACKNOWLEDGEMENTS............................................................................................... iv
ABSTRACT....................................................................................................................... v
LIST OF FIGURES........................................................................................................... viii

CHAPTER 1 PREAMBLE………………………………………………………………… 7
1.1 Introduction 8
1.1.1 What is Mind Reading? 9
1.2 Scope of Mind Reading 10
1.2.1 Future of Mind Reading Computers 11

CHAPTER 2 TECHNOLOGY AND REQUIREMENT .................................. 12

2.1 TECHNOLOGY USED 13
2.1. FUTURISTIC HEAD BAND 13
2.1.2. NUROSCIENCE 14
CHAPTER 3 WORKING OF MIND READING COMPUTERS……………..................… 23
3.1 Process of the Reading mind using mind reading computers 24
3.2 REQUIREMENT ANALYSIS 25
3.2.1 SYSTEM ANALYSIS OVERVIEW 25
3.2.2 FEASIBILITY STUDY 26

CHAPTER 4 – Mind Reading Computers around the world……………........................... 36

4.1 APPLICATION & USES 37
4.2 ADVANTAGES & DISADVANATGES 37
CONCLUSION……………………………………………………………………………….... 62
REFFRENCES……………………………………………………………………………….... 63

6
CHAPTER-1
PREAMBLE

7
1. INTRODUCTION
People express their mental states, including emotions, thoughts and desires, all the time through facial
expressions, vocal nuances and gestures. Mind reading machine is co-ordination of human psychology
and computer techniques. Some equipment are used to gather data & then analyzed. To use those data
for further prediction of mind is known as theory of mind reading. Existing human-computer interfaces
are mind-blind, they are unaware to the user’s mental states and intentions.

1.1 WHAT IS MIND READING?

Drawing inspiration from psychology, computer vision and machine learning, the team in the Computer
Laboratory at the University of Cambridge has developed mind-reading machines - computers that
implement a computational model of mind-reading to infer mental states of people from their facial
signals. The goal is to enhance human-computer interaction through empathic responses, to improve the
productivity of the user and to enable applications to initiate interactions with and on behalf of the user,
without waiting for explicit input from that user. There are difficult challenges:

Using a digital video camera, the mind-reading computer system analyzes a person's facial expressions
in real time and infers that person's underlying mental state, such as whether he or she is agreeing or
disagreeing, interested or bored, thinking or confused.

Prior knowledge of how particular mental states are expressed in the face is combined with analysis of
facial expressions and head gestures occurring in real time. The model represents these at differe nt
granularities, starting with face and head movements and building those in time and in space to form a
clearer model of what mental state is being represented. Software from Nevenvision identifies 24 feature
points on the face and tracks them in real time. Movement, shape and color are then analyzed to identif y
gestures like a smile or eyebrows being raised. Combinations of these occurring over time indicate mental
states. For example, a combination of a head nod, with a smile and eyebrows raised might mean interest.
The relationship between observable head and facial displays and the corresponding hidden mental states
over time is modeled using Dynamic Bayesian Networks.

1.2 Scope of Mind Reading

According to IBM, we might soon be lighting our house with human generated power or using
computers that can literally read our minds…. Those are just two of IBMs 5 in 5 predictions for
how technology will change the world within the next 5 years. Below, we take a whistle-stop tour
through their list and the implications for financial technology.

8
1.2.1 Future of mind reading computers
IBM uses the example of walking up to an ATM that lets you withdraw cash by simply saying your
name. That might seem a way off, but getting to grips with contactless payments and letting digita l
signatures take the place of compliance nightmares are just around the corner.

MIND READING WILL BECOME A REALITY

IBM is apparently already researching just how to hook up your brain to your mobile device. It may
sound like something from Doctor Who but mind reading computers that respond not only to voices but
the thoughts in your head could become a reality.

PASSWORDS WILL BECOME A THING OF THE PAST

Biometric identification is set to put an end to the pain of remembering countless different passwords
and log-ons. Instead, you will be able to log on securely by simply speaking or looking at an eye
sensor.

IBM uses the example of walking up to an ATM that lets you withdraw cash by simply saying your
name. That might seem a way off, but getting to grips with contactless payments and letting digita l
signatures take the place of compliance nightmares are just around the corner.

THE DIGITAL DIVIDE WILL END

The information gap is one of the biggest divides that separates the haves from the have-nots of modern
society. Within 5 years, IBM predicts the gap will have ceased to exist.

Whilst the developing world benefits from access to better medical, technological and social informa tio n
and uses it in life changing ways, financial providers will have to get better and better at sharing valuable
information with the world.

JUNK MAIL WILL BECOME PRIORITY MAIL

Unsolicited e-mails will become a thing of the past with our computers knowing what we want even
before we do. The idea of a smartphone picking your investment portfolio might be a little fanciful but
a move towards timely, highly relevant, highly personal messages is hugely attractive.

For financial institutions, the biggest issue will be ensuring that they are at the front rather than the back
of the queue of people implementing such technology. For years, banks have struggled to use and manage
customer data effectively. As technology improves at breakneck speed, customer patience is about to
wear out

9
 CHAPTER-2

TECHNOLOGY AND REQUIREMENTS

10
2.1 TECHNOLOGY USED
The mind reading actually involves measuring the volume and oxygen level of the blood around the
subject's brain, using technology called functional near-infrared spectroscopy (fNIRS).

The user wears a sort of futuristic headband that sends light in that spectrum into the tissues of the head
where it is absorbed by active, blood-filled tissues. The headband then measures how much light was not
absorbed, letting the computer gauge the metabolic demands that the brain is making.

2.1.1 FUTURISTIC HEAD BAND

The mind reading actually involves measuring the volume and oxygen level of the blood around the
subject’s brain using technology called functional near-infrared spectroscopy (fNIRS).

The user wears a futuristic head band that sends light in that spectrum into the tissues of the head where
it is absorbed by active, blood filled tissues.

FIG: FUTURISTIC HEAD BAND

The headband then measures how much light was not absorbed, letting the computer gauge the metabolic
demands that the brain is making. The results are often compared to an MRI, but can be gathered with
lightweight, non-invasive equipment.

11
2.1.2 NUROSCIENCE

Neuroscience is the scientific study of the nervous system. Traditionally, neuroscience has been seen as
a branch of biology. However, it is currently an interdisciplinary science that collaborates with other
fields such as chemistry, cognitive science, computer
science, engineering, linguistics, mathematics, medicine (including neurology), genetics, and allied
disciplines including philosophy, physics, and psychology. It also exerts influence on other fields, such
as neuroeducation,[2]neuroethics, and neurolaw. The term neurobiology is usually used interchangeab ly
with the term neuroscience, although the former refers specifically to the biology of the nervous system,
whereas the latter refers to the entire science of the nervous system.
The scope of neuroscience has broadened to include different approaches used to study
the molecular, cellular,developmental, structural, functional, evolutionary, computatio na l,
and medical aspects of the nervous system. The techniques used by neuroscientists have also expanded
enormously, from molecular and cellular studies of individual nerve cells toimaging of sensory and motor
tasks in the brain. Recent theoretical advances in neuroscience have also been aided by the study of neural
networks.

12
 CHAPTER-3

WORKING OF MIND READING

COMPUTERS

13
3.1 PROCESS OF THE READING MIND USING MIND READING COMPUTERS

The results are often compared to an MRI (Magnetic Resonance Imaging), but can be gathered with
lightweight. Wearing the fNIRS (functional near-infrared spectroscopy) sensor, experimental subjects
were asked to count the number of squares on a rotating onscreen cube and to perform other tasks.
Preliminary results show that using buttoned sensors. Biological signals arise when reading or speaking
to oneself with or without actual lip or facial movement.

DISPLAYING IMAGE FROM BRAIN

MONITORING A CAR DRIVER . . .

14
Mind reading in Web Search

 For the first test of sensors, scientists trained the program to recognize six
words-including “go", "left” and “right” numbers, etc.

 Then researchers put the letters of the alphabet into a matrix with each
column and row labeled with a single digit number.

 These were used to silently spell “NASA” into a web search engine using
program.

 “This proved we could browse the web without touching a

Keyboard”.

3.2 REQUIREMENT ANALYSIS

3.2.1 SYSTEM ANALYSIS OVERVIEW

Problem recognition means detailed study of the current system being used by the user. A detailed study
of system being currently used must be carried out of sessions with the Individual.
A complete understanding of Mind Reading computers is essential to the success the performance. The
problem evaluation and solution synthesis is the next major area of effort for analysis. It enables the
system, engine to redefine the software allocation and build model of process followed Identification of
need Preliminary investigation.

3.2.2 FEASIBILITY STUDY

All the projects are feasible given the unlimited resources and infinite time. Unfortunately, the
development of a computer-based system or product is more likely to be plagued by the scarcity of
resources and difficult delivery dates. It is both necessary and prudent to evaluate the feasibility of a
project at the earliest possible time. Months or years of effort, thousands or millions of rupees, and
untold professional embarrassment can be averted if an ill-conceived system is recognized early in the
definition phase.
Feasibility and risk analysis are related to each other. If project risk is great, the feasibility of producing
quality software is reduced.
However, we confine our attention to:
 Technical Feasibility.
 Economical Feasibility.
 Operational feasibility.

15
 CHAPTER-4

MIND READING COMPUTERS

AROUND THE WORLD

16
4.1 APPLICATIONS & USES OF MIND READING COMPUTERS

1) Mind-reading computers could 'save your life‘

2) Emergency
3) Control robots by brain power
4) Mind-Reading Technology Speeds Ahead
5) The mind-reading computer that could communicate with coma patients

Mind-reading computers could 'save your life‘

Devices allowing people to write letters or play pinball using just the power of their brains have become
a major draw at the world's biggest high-tech fair.
Scientists are researching ways to monitor motorists' brain waves to improve reaction times in a crash.

Emergency
In an emergency stop situation, the brain activity kicks in on average around 200 milliseconds before
even an alert driver can hit the brake.
There is no question of braking automatically for a driver - "we would never take away that kind of
control"
Using this brain-wave monitoring technology, a car can also tell whether the driver is drowsy or not,
potentially warning him or her to take a break.

Control robots by brain power

Another device allows users to control robots by brain power.

The small box has lights flashing at different frequencies at the
four points of the compass.
The user concentrates on the corresponding light, depending on
whether he wants the robot to move up, down, left or right and
the brainwaves generated by viewing that frequency are
monitored and the robot is controlled.

17
Mind-Reading Technology Speeds Ahead

By scanning blogs of brain activity, scientists may be able to decode people's thoughts, dreams and
intentions By Kerri Smith and Nature magazine .Makes Web browsing easy Giving Commands will be
easy for the users who use the internet , it will also provide the simplicity to the users, those who are not
so much educated they can also use the website as they are good enough to speak rather than to write so
those type of people can also use these computers.

The mind-reading computer that could communicate with coma patients

Canadian researchers have developing a mind-reading computer that could help communicate with
people in a coma.
The University of Western Ontario researchers used neuroimaging to read human thoughts via brain
activity when they are conveying specific ‘yes’ or ‘no’ answers.
The team say their research could lead to dramatic new ways of attempting to communicate with patients
in a vegetative state.

Fig: Communication of the mind reading computer with people

18
4.2 ADVANTAGES & DISADVANTAGES OF MIND READING
COMPUTERS

ADVANTAGERS & USES

 Can read minds
 Help paralytic patients
 Help Handicapped people
 Help Comma patients
 Help people who cant speak
 Can be used for military purposes & sting operations
 Can be combined with consoles & used for mind gaming, robotics & stuff.
 Eliminate the capability to lie.

DISADVANTAGERS & PROBLEMS

 It is not always correct while predicting the views

 Can extract, through an individual, an important, secure &
 confidential information of individual, state or even a country
 If developed or used by sinners, can be highly dangerous
 Eavesdropping
 No way to neutralize this technology.

19
CONCLUSION

Tufts university researchers have begun a 3 year research project which, if successful, will allow
computers to respond to the brain activity of the computer’s users.
Users wear a futuristic looking headbands to shine light on their foreheads and then performs a series of
increasingly difficult tasks while the device reads what parts of the brain are absorbing the light. That
info is then transferred to the computer and from there the computer can adjust its interface and functio ns
to each individual.

Drawing inspiration from psychology, computer vision and machine learning, the team in the Computer
Laboratory at the University of Cambridge has developed mind-reading machines - computers that
implement a computational model of mind-reading to infer mental states of people from their facial
signals. The goal is to enhance human-computer interaction through empathic responses, to improve the
productivity of the user and to enable applications to initiate interactions with and on behalf of the user,
without waiting for explicit input from that user. There are difficult challenges:

Using a digital video camera, the mind-reading computer system analyzes a person's facial expressions
in real time and infers that person's underlying mental state, such as whether he or she is agreeing or
disagreeing, interested or bored, thinking or confused.

Prior knowledge of how particular mental states are expressed in the face is combined with analysis of
facial expressions and head gestures occurring in real time. The model represents these at differe nt
granularities, starting with face and head movements and building those in time and in space to form a
clearer model of what mental state is being represented. Software from Nevenvision identifies 24 feature
points on the face and tracks them in real time. Movement, shape and color are then analyzed to identify
gestures like a smile or eyebrows being raised. Combinations of these occurring over time indicate mental
states. For example, a combination of a head nod, with a smile and eyebrows raised might mean interest.
The relationship between observable head and facial displays and the corresponding hidden mental states
over time is modeled using Dynamic Bayesian Networks.

20
REFERENCES

 www.eurescom.de/message/default_Dec2004.asp
 blog.marcelotoledo.org/2007/10
 www.newscientist.com/article/dn4795-nasa-develops-mindreading-system
 http://blogs.vnunet.com/app/trackback/95409
 Face station tracking, 2002.
 S. Baron-Cohen. How to build a baby that can read minds: Cognitive
mechanisms in mindreading. Current Psychology of Cognition, 13(5):513–552,
1994.
 S. Baron-Cohen and T. H. E. Tead. Mind reading: The interactive guide to
emotion, 2003.

21