Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
INTRODUCTION TO
MACHINE LEARNING
Outline
General
Concepts
Decision Trees
Neural Networks I
Neural Networks II
Evolutionary Computation I
Evolutionary Computation II
Case Study I
Case Study II
What is Learning?
Process
of
gaining
knowledge or
skill by studying,
practicing, being
taught, or
experiencing
something.
What is Learning?
What is Learning?
Is
learning equal
to imitating?
What is Knowledge?
Stored
information or
models used to
interpret, predict
and appropriate
respond to the
outside world
What is Knowledge?
to meet
(novel)
situations
successfully by
proper behavior
adjustments
Artificial Intelligence
The
science of
making
computers do
things that
require
intelligence
when done by
humans.
Alan Turing (1912-1954)
concerned with
the design and
implementation
of computer
systems that can
learn
autonomously
Function Approximation
An
important problem
in Machine Learning
is inferring a
functional
relationship between
a set of attribute
variables and
associated response
variables
Attribute Variables
Functional
Relationship
Response Variables
Function Approximation
a,b
Functional
Relationship
a*b
Function Approximation
We
Measurements
Model
Failure diagnosis
Pattern Recognition/Classification
Humans
are good at
pattern recognition!
Pattern Recognition/Classification
Face,
Pattern Recognition/Classification
We
are able to
recognize patterns,
even after significant
changes
Pattern Recognition/Classification
It
can be
defined as the
process
whereby a
received
pattern/signal
is assigned to
a prescribed
number of
classes
(categories)
Pattern Recognition/Classification
During
the
training the
learning
system is
presented a set
of input
patterns and
their categories
Pattern Recognition/Classification
Then
a new
pattern is
presented, not
seen before,
and the system
is expected to
identify its
class
Pattern Recognition/Classification
A
pattern is
represented by
a set of m
observables.
Feature
extraction is
described by a
transformation
into a qdimensional
space (q < m)
Pattern Recognition/Classification
Classification
is
a
transformation
that maps the
feature space
into one of the
classes in a rdimensional
space
Pattern Recognition/Classification
A
twodimensional
feature space:
point
represents an
individual who
is 6ft tall and
weighs 200lb
Pattern Recognition/Classification
Graphically, in
this example
we have
patterns in the
Feature Space
(points in R2)
belonging to
two categories
or classes
Feature Space
Learning Process
Supervised
Learning: A teacher
has the knowledge,
represented by a
set of input-output
examples
Learning Process
Unupervised
Learning: No
teacher to oversee
the learning
process.
We
1
Training Sample
= +
where
is a random expectational error
that represents our ignorance about the
dependance of D and X
given any
realization is zero
have the following properties:
= 0 we
[ ] =
The
[ ] = 0