Content Based Image Retrieval with Improved

Relevance Feedback
-First Review-

Shabeeb Ali O
No.15
Semester III
M.Tech Signal Processing

Guided By
Dr.Shajee Mohan B.S.

August 9, 2018

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Outline

I Overview
I Schematic Block Diagram
I Methodology
I Analysis
I Schedule
I References

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Overview

Content Based Image Retrieval is hot a research topic among

image retrieval systems. The basic idea is we give a query image to
a system which retrieves similar images based on the content of
the query image that is read by the system. This project aims at
extracting content of an image in an efficient and meaningful way
that can be used by image processing tools, design a system for
the retrieval process and use relevance feedback method for
improving content extraction process.

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Schematic Block Diagram

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Methodology

I Dataset:
We are using ’Caltech 101’[1] Database. Initially the project
experiments on selected 10 classes in the dataset.
I Feature Extraction:
Features of both query image and images in database which
represents their content are needed. In the initial approach we
are extracting the Scale invariant Feature Transform (SIFT)[2]
of the images and store them in files in a structured way.

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Methodology (Contd..)

I SIFT: Its an image transform introduced by David G. Lowe in

his paper Distinctive Image Features from Scale-Invariant
Keypoints which presents method of extracting distinctive
invariant features from images that can be used to perform
reliable matching between different views of an object or
scene. The features are invariant to image scale and rotation,
and are shown to provide robust matching across a substantial
range of affine distortion, change in 3D viewpoint, addition of
noise, and change in illumination.

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Methodology (Contd..)

I SIFT outputs keypoints and 128 descriptors for each

key-point. Each key-point is defined by 2 values (x-coordinate
and y-coordinate), we call them key-centers.
I Detect key-points and compute descriptors for every images in
the database.

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Methodology (Contd..)

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Methodology (Contd..)

I The number of key-points varies between distinct images.

I In order to reduce keypoints and to make number of
key-points uniform across the database a Fisher scoring
algorithm[3] will be used.

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Analysis

I Using the SIFT features, an image retrieval process will be

performed with basic distance similarity measures (like
Euclidean distance).
I From the results obtained a performance analysis will be
carried out with following parameters:
I Precision
I Recall
I F measure
I Mean of Opinion Score

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
Schedule

I Compute SIFT for all images and refinement using Fisher

score. - August 20.
I Performing basic Image retrieval with SIFT - August 30.
I Analysis on feature selection - September 20.
I Query Image Classification - September 30.
I Application of Relevance Feedback - November 31.
I Analysis on Relevance Feedback - December - 20.
I Preparation of draft report - December 31.

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-
References

[1] Holub and Gerg, ”Caltech 101”, URL http://www.vision.

caltech.edu/image_datasets/caltech101/.
[2] David G. Lowe, ”Distinctive Image Features from
Scale-Invariant Keypoints”, International Journal of Computer
Vision, Vol. 60, No. 2, pp. 91-110.
[3] Quanquan Gu, Zhenhui Li and Jiawei Han, ”Generalized Fisher
score for feature selection”, Proceedings of the
Twenty-Seventh Conference on Uncertainty in Artificial
Intelligence, pp. 266-273, 2011.

Shabeeb Ali O No.15 Semester III M.Tech Signal Processing Guided By Dr.Shajee Mohan B.S.
Content Based Image Retrieval with Improved Relevance Feedback -First Review-