INTERNATIONAL JOURNAL OF RESEARCH IN TECHNOLOGY (IJRT)
2394-9007
Vol. V, No. I, February 2018
Effective Object Detection by Modifying choice of
basic Parameters of Object Detection
Shristi Shreyasi, S.S. Subashka Ramesh
Abstract— General purpose object detection should be fast,
accurate, and able to recognize a wide variety of objects. Since
the introduction of neural networks, detection frameworks have
become increasingly fast and accurate. However, most detection
methods are still constrained to a small set of objects. Use of
traditional approach which is repurposing classifier or localizer
to perform detection applies the model to an image at multiple
location and scales. This paper discusses the parameters which
will enhance the effectiveness of object detection approaches in
application areas of object detection. The viewpoint for object
detection that this paper proposes is parameters like an efficient
dataset, a better feature extractor, localization of bounding boxes
and dimension adaptability. These features play an important
role in behavior of any object detection model in terms of
performance, accuracy, and classification process & outcome and
time factor.
Keywords: Object Detection, Neural Net, Image Recognition,
Image Classification.
I. INTRODUCTION
Object detection comes under the field of Computer Vision. It
is the process of finding instances of real-world objects such
as faces, bicycles, and buildings in images or videos. Object
detection algorithms typically use extracted features and
learning algorithms to recognize instances of an object
category. It all starts from Classification. Classification is the
probably the most well known problem in computer vision. It
consists of classifying an image into one of many different
categories. In recent years classification models have
surpassed human performance and it has been considered
practically solved. Similar to classification, Localization finds
the location of a single object inside the image. Localization
can be used for lots of useful real-life problems. For example,
smart cropping (knowing where to crop images based on
where the object is located), or even regular object extraction
for further processing using different techniques. It can be
combined with classification for not only locating the object
but categorizing it into one of many possible categories.
Manuscript received on February, 2018.
Shristi Shreyasi, Research Scholar, Department of Computer Science &
Engineering, SRM Institute of Science & Technology, Ramapuram, Chennai,
Tamil Nadu, India.
Prof. S.S Subashka Ramesh, Asst. Professor, Department of Computer
Science & Engineering, SRM Institute of Science & Technology,
Ramapuram, Chennai, Tamil Nadu, India.
Impact Factor: 4.012
Published under
Asian Research & Training Publication
ISO 9001:2015 Certified
ISSN No.
www.ijrtonline.org
Going one step further from here, we would want to not
only find objects inside an image, but find a pixel by pixel
mask of each of the detected objects. This problem is referred
as Instance or Object segmentation. Iterating over the problem
of localization plus classification ends up with the need for
detecting and classifying multiple objects at the same time.
Object detection is the problem of finding and classifying a
variable number of objects on an image. The process of object
detection is done via methods like Viola-Jones Detection,
Feature-based Detection, SVM Classifier with HOG features
and Deep learning Object Detection. Today, the fields of Deep
Learning - Artificial Neural networks are being used
ingeniously in Object Detection in real-time such as self
driving cars, assisted living applications, visual search engines
and aerial image analysis etc. In this paper, the aim is to
develop a faster deep neural network for real-time video object
detection by exploring the ideas of knowledge-guided training
and predicted regions of interest. Specifically, a new
framework is proposed for training neural networks on
classification as well as detection datasets, and different
approach of k-means clustering toward dimension box
clustering, localization in prediction of region proposals and
various resolution objects towards making object detection
much more effective, faster and accurate.
II. RELATED WORK
Object Detection was done classically with Viola-Jones
framework but recent use of deep learning and artificial neural
network in detecting and classifying the images have
surpassed the humans as well in Image Net Challenge. In
detection the most used form of neural network is R-CNN.
Today, R-CNN have been effectively been mastered by Fast
R-CNN which has even surpassed Faster R-CNN. And in
recent times, Mask R-CNN has been taking over the detection
field in pixel level segmentation.
Earlier, R-CNN and its successor have used datasets of
only detection for training their model to perform object
detection. The detection datasets are much limited in size due
to unavailability of large, accurately labeled dataset whereas
the classification dataset have millions of images labeled in
various categories for training models. This becomes barrier in
developing an efficient model for object detection in real time
videos. Another, main cause for complex and time taking
outcomes is the poorly predicted bounding boxes in the frame
55
INTERNATIONAL JOURNAL OF RESEARCH IN TECHNOLOGY (IJRT)
Vol. V, No. I, February 2018
or image provided. Due to this, the model becomes instable
and keeps analyzing the wrong region for a reasonable amount
of time. One related problem with this occurs which is
adjustment of anchor or dimension boxes around the object in
the video feed. Sometimes, due to different sizes of a category
of an object, the model confuses over its validity in terms of
whether it is should be a proposed region and if it is then what
class should it belong to! Also, the feature extractor for the
model plays an important role in accuracy of the model. These
above minor vulnerabilities of object detection play an
important role in design and outcome complexity, analysis and
final outcome.
III. OVERVIEW OF THE PROPOSED METHOD
The proposed method curbs the vulnerability of the previous
object detecting models like dataset decision, resolution of
input image/frame, a better feature extractor and localizing the
predicted bounding boxes accurately. This changes their
approach towards solving a detection of a real time video feed
which will prove resourceful in real life applications of object
detection.
IV. FEATURES OF THE PROPOSED WORKS
A. An Efficient Dataset:
The proposed mechanism for taking an efficient dataset as
input for training the model is to jointly use both classification
and detection data. Based on superimposing 2D images of
textured object models into images of real environments at
variety of locations and scales gave a better outcome of 98.2%
recognition rate with VGG network with BigBird dataset. [1]
Combining 20,000+ RGB-D images and 50,000+ 2D
bounding boxes of object instances densely captured in 9
unique scenes to create a dataset resulted in a faster, accurate
and better approach towards active vision [2]. So, in same way
labeled images should be used for detection to learn detection-
specific information like bounding box coordinate prediction
and objectness as well as how to classify common objects.
Images with only class labels should be used to expand the
number of categories it can detect. For training, images should
be mixed from both detection and classification datasets. This
approach presents a few challenges. Detection datasets have
only common objects and general labels, like “person” or
“bicycle”. Classification datasets have a much wider and
deeper range of labels. ImageNet has more than a hundred
breeds of dog, including “Norfolk terrier”, “Yorkshire terrier”,
and “Bedlington terrier”. To train on both datasets a coherent
way is needed to merge these labels. Most valid approach to
classify is to use a softmax layer across all the possible
categories to compute the final probability distribution. Using
a softmax layer assumes that the classes are mutually
exclusive. This presents problems for combining datasets, for
example if we want to combine ImageNet and COCO datasets
using this model because the classes “Norfolk terrier” and
“dog” are not mutually exclusive. We could instead use a
multi-label model to combine the datasets which does not
assume mutual exclusion. This approach ignores all the
Impact Factor: 4.012
Published under
Asian Research & Training Publication
ISO 9001:2015 Certified
ISSN No. 2394-9007
www.ijrtonline.org
structure we do know about the data, for example that all of
the COCO classes are mutually exclusive. So, such a well
labeled dataset is the first step toward making the model
understands what is desired from it. For example “Norfolk
terrier” and “Yorkshire terrier” are both hyponyms of “terrier”
which is a type of “hunting dog”, which is a type of “dog”,
which is a “canine”, etc. This is type of detailed classification
which is should be taken as the best approach towards
handling models via datasets in object detection. Most
approaches to classification assume a flat structure to the
labels however for combining datasets; tree or a graph
structure is exactly what we need. Storing the hierarchies in
nodes of tree is much better approach than using sequentially
labeled flat datasets [3]. Decision Tree and Graphs are
versatile in nature and can be modified any way to suit the
certain level of classification that is demanded in the model's
outcome.
B. Localization of Bounding Boxes:
Faster R-CNN predicts bounding boxes using hand-picked
priors [4]. For each sliding-window location, it
generates multiple possible regions based on k fixed-
ratio anchor boxes (default bounding boxes). Each region
proposal consists of a) an “objectness” score for that region
and b) 4 coordinates representing the bounding box of the
region. Using a combined classification-bounding box
prediction framework where directly objects are predicted in
each cell as well as the corrections on anchor boxes. Using
only convolution layers the region proposal network (RPN) in
Faster R-CNN predicts offsets and confidences for anchor
boxes. Since, the prediction layer is convolution; the RPN
predicts these offsets at every location in a feature map.
Predicting offsets instead of coordinates simplifies the
problem and makes it easier for the network to learn. But use
of anchor boxes to predict bounding boxes is much efficient
method to get a good IOU value. This is done so that for an
odd number of locations in the feature map, there is a single
centre cell. Objects, especially large objects, tend to occupy
the centre of the image so it’s good to have a single location
right at the centre to predict these objects instead of four
locations that are all nearby. When we move to anchor boxes
we also decouple the class prediction mechanism from the
spatial location and instead predict class and objectness for
every anchor box. The objectness prediction still predicts the
IOU of the ground truth and the proposed box and the class
predictions predict the conditional probability of that class
given that there is an object. Using anchor boxes, a small
decrease in accuracy may take place. Even though the mAP
(mean average prediction) decreases, but there will be a
considerable increase in recall. Increase in value of recall
leads to believe that number of object recognized which
should have been returned is low in number as compared to
the true recognized objects by the model.
56
INTERNATIONAL JOURNAL OF RESEARCH IN TECHNOLOGY (IJRT)
Vol. V, No. I, February 2018
C. Dimension Adaptability by Model:
A multi scale approach in object detection plays an important
role in giving an accurate output.[5] Real -time video or
images have same class object in different scales for detection
and classification. So, detection and classification to be
performed on the frame should be elastic in nature. Training
the models on multi-scale is not enough; the model should be
learning to classify the class of object in all resolutions of an
image. This can be done by changing the network after every
few iteration. After a certain interval of time a new dimension
of input image size will be taken by the network. We resize
the network to that dimension and continue training. This
regime forces the network to learn to predict well across a
variety of input dimensions. This means the same network can
predict detections at different resolutions. This approach will
stop limiting the model to detect a class for a particular input
image size, thus making it much more versatile in taking input
and an accurate output.
D. A Better Feature Extractor Framework:
Most detection frameworks rely on VGG-16 as the base feature
extractor [6]. VGG-16 is a powerful, accurate classification
network but it is needlessly complex. The convolution layers of
VGG-16 require 30.69 billion floating point operations for a
single pass over a single image. Other framework uses network
based on the Google net architecture [7]. This network is faster
than VGG-16, only using 8.52 billion operations for a forward
pass. However, its accuracy is slightly worse than VGG-16. A
classification model should be such that features that are
extracted from the image can be used later in pooling. Building
off a prior work on network design as well as common
knowledge in the field enhances the feature extraction abilities
of the extractor. Similar to the VGG models, using mostly 3X3
filters and double the number of channels after every pooling
step [6] enriches the capacity of the feature extractor.
Extraction of correct features which can be used in pooling
later plays a very important role in object detection. Selection
of apt features by the feature extractor will generate more
accurate results. As per face detection with effective feature
extraction like HOG and LBP features outperformed Haar-like
features and also yielded better generalization in noisy data [8].
So, choosing a feature extractor which works towards
enhancing the performance of model should be one of the goals
for object detection. The intense computation required in object
detection will be reduced a lot if our choice of feature extractor
is apt.
Impact Factor: 4.012
Published under
Asian Research & Training Publication
ISO 9001:2015 Certified
ISSN No. 2394-9007
www.ijrtonline.org
V. CONCLUSION
In conclusion, the features of object detection discussed in this
paper, play a very important role in performance of detection
mechanisms. An efficient dataset, localization of bounding
boxes, dimension adaptability and a better feature extractor
framework are characteristics of object detection model
designing which must be carefully done. The potential of
performance held by above features are huge in object
detection.
REFERENCES
[1] Georgios Georgakis∗, Arsalan Mousavian∗, Alexander C. Berg†
, Jana Koseck ˇ a´ ∗- Synthesizing Training Data for Object
Detection in Indoor Scenes in arXiv:1702.07836v2 [cs.CV] 8
Sep 2017.
[2] Phil Ammirato1, Patrick Poirson1, Eunbyung Park1, Jana
Koseck ˇ a´2, Alexander C. Berg1 - A Dataset for Developing
and Benchmarking Active Vision in 2017 IEEE International
Conference on Robotics and Automation (ICRA) Singapore,
May 29 - June 3, 2017
[3] Singh Vijendra, Hemjyotsana Parashar and Nisha Vasudeva, "A
New Method of Classification of Datasets for Data Mining" in
2011 3rd International Conference on Machine Learning and
Computing (ICMLC 2011)
[4] S. Ren, K. He, R. Girshick, and J. Sun. "Faster R-cnn: Towards
real- time object detection with region proposal networks". in
arXiv preprint arXiv:1506.01497, 2015
[5] Qingshan Liu, Senior Member, IEEE, Renlong Hang, Huihui
Song, Zhi Li Learning Multi-Scale Deep Features for High-
Resolution Satellite Image Classification" in
arXiv:1611.03591v1 [cs.CV] 11 Nov 2016
[6] K. Simonyan and A. Zisserman. Very deep convolution for
large-scale image recognition. arXiv preprint arXiv:1409.1556,
2014.
[7] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov,
D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper
with convolutions. CoRR,abs/1409.4842,2014
[8] Sakrapee Paisitkriangkrai, Chunhua Shen, Jian Zhang- Face
Detection with Effective Feature Extraction in arXiv: 1009.
5758v1 [cs.CV] 29 Sep 2010.
57