Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
n
x
x
x
2
1
Feature vector
- A vector of observations
(measurements).
- is a point in feature space .
Hidden state
- Cannot be directly measured.
- Patterns with equal hidden state belong to the same
class.
X e x
x X
Y e y
Task
- To design a classifer (decision rule)
which decides about a hidden state based on an onbservation.
Y X : q
Pattern
Neural Networks 26 H. H. Kha
Components of PR system
Sensors and
preprocessin
g
Feature
extraction
Classifier
Class
assignment
Sensors and preprocessing.
A feature extraction aims to create discriminative features good for
classification.
A classifier.
A teacher provides information about hidden state -- supervised learning.
A learning algorithm sets PR from training examples.
Learning algorithm
Teacher
Patter
n
Neural Networks 27 H. H. Kha
Character recognition
Recognition of both printed and handwritten characters
is a typical domain where neural networks have been
successfully applied.
Optical character recognition systems were among the
first commercial applications of neural networks.
For simplicity, we can limit our task to the recognition
of digits from 0 to 9. Each digit is represented by a 5x9
bit map.
In commercial applications, where a better resolution is
required, at least 16 x16 bit maps are used.
Neural Networks 28 H. H. Kha
Bit maps for digit recognition
Neural Networks 29 H. H. Kha
7 8 9 10
12 13 14 15
17 18 19 20
26 27 28 29
31 32 33 34
36 37 38 39
6
2 3 4 5 1
16
11
22 23 24 25 21
42 43 44 45 41
35
40
30
Architecture of a neural network
The number of neurons in the input layer is decided by the
number of pixels in the bit map. The bit map in our
example consists of 45 pixels, and thus we need 45 input
neurons.
The output layer has 10 neurons one neuron for each
digit to be recognised.
Complex patterns cannot be detected by a small number of
hidden neurons; however too many of them can
dramatically increase the computational burden.
Another problem is overfitting. The greater the number of
hidden neurons, the greater the ability of the network to
recognise existing patterns. However, if the number of
hidden neurons is too big, the network might simply
memorise all training examples.
Neural Networks 30 H. H. Kha
Architecture of a neural network
Neural Networks 31 H. H. Kha
0
1
1
1
0
1
1
1
1
1
41
42
43
44
45
1
2
3
4
5
1
2
3
4
5
0
1
2
3
4
5
6
7
8
9
10
0
0
0
0
0
0
0
1
0