Major project

on

Convolutional Neural Networks for

Image Processing
Convolution
Convolutional neural networks are deep artificial
neural networks that are used primarily to classify
images, cluster them by similarity (photo search),
and perform object recognition within scenes. By
use of CNNs it can identify faces, individuals, any
signs, tumors and many other aspects of visual
data.
Importance of CNN
Convolutional Neural Networks are complex feed forward
neural networks. CNNs are used for image classification and
recognition because of its high accuracy.
It was proposed by computer scientist Yann LeCun in the late
90s, when he was inspired from the human visual perception of
recognizing things.
The CNN follows a hierarchical model which works on building
a network, like a funnel, and finally gives out a fully-connected
layer where all the neurons are connected to each other and
the output is processed.
Types of layers
• Convolutional layers
▫ Feature Map or filter
▫ Shared weights
• Subsampling or Max pooling
• Full connected layer (classification)
Convolutional layer
1. First step is to extract features from an input
image.
2. In second step, Convolution preserves the
relationship between pixels by learning image
features using small squares of input data.
3. Third step is a mathematical operation that
takes two inputs such as image matrix and a filter
or say kernal.
Max pooling layer
• Takes smaller blocks from convolutional layer
• Subsamples to produce single output from that
block
• Several ways- average or maximum or learned
linear combination of neurons
• Max pooling layers take maximum out of that
block
Full-connected layer

• High level reasoning in NN

• Takes all neurons from previous layer and
connects it to every single neuron it has
• These are not spatially located (visualize as one-
dimensional)
• Therefore, no convolutional layers after fully
connected layer
Convolutional neural network

• Network structure designed extracts relevant

features, restricting neural weights of one layer
to a local perceptive field in previous layer. Thus,
feature map obtained in second layer
• The degree of shift and distortion variance is
achieved by reducing the spatial resolution of the
feature map
Project code
Training
• Back propagation
• In feature map, all neurons share the same
weight and bias, the number of parameters is
smaller than in fully connected multilayer
perceptron, leading to a reduction in gap
• Subsampling/pooling layers have one trainable
weight and one trainable bias, so number of free
parameters is even lower when compared
• Because of low number of free parameters,
training of CNN requires far less computational
effort than training multilayer perceptron
Applying CNN to real-world problems

• Image processing system on mobile robot

• Task – detect and characterize cracks and
damage in sewer pipe walls.
• CNNs are used for image classification and
recognition because of its high accuracy.
• Task of CNN-
▫ filter raw data
▫ Identify spatial location of cracks
▫ Enable characterization of length, width of
damage
Thank you