Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
CHAPTER-1 INTRODUCTION
1.1Background:-
Automatic RTO Symbol detection system:-
Road safety is the major issue faced by the number of vehicle owners across the world. In
recent years, a lot of research work has been carried out in detection of traffic signs
automatically. Traffic sign provide essential information for warning, guiding people to make
their movements easier, Safer and more convenient. Traffic signs are detected by the feature
extraction, having ability of detection and identification of traffic signs. The proposed project
deals with the automatic recognition of traffic signs using MATLAB and Image Processing
techniques. The proposed concept deals with concept of recognition of traffic signs and then
displaying them on a LCD screen. The system is to detect traffic signs correctly so that
drivers can be alerted and react properly to the encountered traffic situations. We have used
feature based method for traffic sign detection. In this method the image of the traffic sign
was cropped and matched with the original image, identifying the key points in both the
images, and match between those points to find similarity.
Keywords: Mat lab, LCD, Feature Extraction, Pattern matching, Traffic sign etc.
Automatic traffic sign recognition has long been an interesting research area in image
processing, one specific area with practical importance is automatic traffic sign recognition.
A robust traffic sign detection algorithm is an essential part of applications like automatic
vehicle control, navigation, etc. Many researchers have been done on this topic and have
shown promising. Traffic Sign detection System is a computer vision application and it
supports drivers to follow the restrictions and obey the regulations via utilization of image
processing techniques. The system recognizes the traffic signs and warns the driver about the
sign. Traffic Signs having standard in shapes and colors that are defined by the governments
and they remain unchanged within the country. Drivers easily recognize them because colors
and shapes of the signs are very different from the natural environment. The dominant color
in urban environments is green whereas the used colors are blue and red in the traffic signs.
The shapes of the signs are triangle, circle or rectangle, which are difficult to see in the
nature. According to modern requirements intended for vehicle safety there must be noted
that effective driving can often be more dependent on computer systems that vehicles include
rather than the actual driver . Nowadays, one of the most crucial concerns of the automobile
manufacturers is to boost safety. As the volume of vehicles increases the actual probability of
site visitor’s accident also boosts. There are many reasons to occur traffic accident. The over-
speed is one of the main issues. To stop the accident, there are different prohibitory
indications are displayed with the side of the street. These are designed to show rule or warn
in order to avoid accidents. Unfortunately, sometimes on account of lack of concentration or
lack of knowledge about the actual prohibitory signs the driver doesn’t obey the basics and
drive the vehicles according to their own want, leaving these signs or fulfills his want the
driver put himself in to a very danger situation and turn a participant in accident. If there is
really a system which can enforce to follow these prohibitory indications may avoid these
sorts of accidents. In the last few decades automobile industry computer vision has also
improved fast at the same time, as a reaction to this some systems developed on obstacle
detection and path detection as be a support to driver. However, traffic sign detection is really
a wide research place which still must be worked on.
Driving is entirely based on visual information processing with this process; traffic signs
play an important role on determining the road conditions and scenarios. It provides the
driver every piece of information necessary for a safe drive. Signs guide clear the driver
doing inappropriate actions for instance driving above speed limit, going with wrong
direction, passing by way of a passing forbidden zone etc. Further, traffic signs are ideal for
direction finding and also guidance. Although targeted traffic signals usually are noticeable
and have absolutely a number of clear features, a number of situations may well avoid driver
perceiving them. For instance, in the evening or maybe throughout poor lighting situation
people usually are more unlikely to see the actual targeted traffic signals. Several distracting
functions upon road may well cause a bypass involving signals. Additionally, from time to
time simply the actual driver her/himself is not able to spot the signals due to not enough
focus. In this fashion, some sort of driver aiding programs will definitely boost basic safety in
such situation which will help prevent a number of accidents to occur. The main advantage of
traffic signs detection is to reduce the risk imposed on the driver of the vehicle while driving,
as well as increasing the information content. This method is expected to be implemented in
vehicles as an integrated system. The user of this system will be the driver who will have to
get visual warning when the traffic sign is on the path of the vehicle. Traffic sign detection
allows us to reduce the amount of time necessary for appreciating the situation of movement
and actions of the driver for any manipulation. Traffic sign detection is a wide research area
which still needs to be worked on.
1.2Motivation
The sign which is placed at the side of roads to impart information to road users is
known as road signs or traffic signs. There are four types of traffic signs that are
shown in the traffic code: a) warning; b) prohibition; c) obligation; and d)
informative. Depending on the form and the color, the warning signs are equilateral
triangles with one vertex upwards. They have a white background and are surrounded
by a red border. Prohibition signs are circles with a white or blue background and a
red border. Both warning signs and prohibition signs have a yellow background if
they are located in an area where there are public works. To indicate obligation, the
signs are circles with a blue background. Informative signs have the same color.
Finally, there are two exceptions: a) the yield sign, an inverted triangle; and the stop
sign, a hexagon. To detect the position of the sign in the image, we must know the
two properties i.e., color and shape. The applications and the difficulty of road sign
detection make road sign detection an interesting problem. In terms of applications,
road sign detection is quite important for the road sign recognition problem, since it is
the most important step for a road sign recognition system. So far, the researchers
have mainly focused on the road sign recognition problem, in which the task of
finding road sign in an arbitrary background is usually avoided by either manual
segmentation of the input image, or by capturing faces against a known uniform
background. In the last decade, road sign detection has attracted great attention, as
road sign recognition system requires automatic road sign detection as a first step,
especially for images with cluttered background. Road sign detection also has
potential applications in human computer interface and surveillance systems. Road
sign detection is difficult due to three main reasons. First, there is a large component
of non-rigidity and textural differences among road sign. Second, road sign detection
is also made difficult because of additional features, such as dust, which can either be
present or totally absent from a road sign. All these additional features increase the
variability of the road sign patterns that a road sign detection system should handle.
Third, the presence of unpredictable imaging conditions in an unconstrained
environment increases the difficulty of the task. A change in light source distribution
can cause a significant change in the appearance of the road sign image. All these
things should be taken into consideration when designing a road sign detection
system.
1.4 Objective:-
The complete project is divided into three sections that are software design, PCB
making, & programming. In the first section we design our complete circuit diagram in
proteus software and make component list. In second section we design PCB layout on ARIS
and make PCB in our college innovation center.
In third section according to the functional specifications for requirement of electronic
data acquisition of Krystal to make impact testing machines we complete our programming.
Operation Classification
Input Data:
Processing:
Detect the color value present in the image reduce the noise from image according the color
value generate result. A particular value assigned for particular RTO symbol according to it a
signal sent towards Arduino board, it will generate final result and displayed it on LCD
display
Output Data:
Output result is value. According the final value the signal sends toward circuit. Identified
symbol name displayed on LCD display.
In this project to detect the traffic sign, HIS color model followed by circle detection is used.
The regions detected by color detection cannot be determined to the exact sign region. In this
method the edge of interested regions is traced to get their contours after morphologic
operations. Then to find the target region, Hough circle transform is applied. The object have
been detected and extracted after the previous two steps. We next recognize the symbol in the
destination area. The image is preprocessed to remove noise. To obtain a clear silhouette
boundary of the traffic indication symbol Edge detection and segmentation are used
specifically to the image. Shape context is based on the contour of the object.
This project points to deal with real-time traffic sign recognition, i.e. localizing what type of
traffic sign appears in which area of an input image at a fast processing time. To achieve this
objective, a two-module framework (detection module and classification module) is
proposed. In detection module, the input color image is transformed to probability maps by
using color probability model. Then the road sign proposals are extracted by finding
maximally stable external regions on these maps.
Fig 3.1
Fig 3.2
Fig 3.3
As we see the captured image is processed in MATLAB software. The noise from captured
image is removed and then its color value measured.
MATLAB OUTPUT:-
FIG 3.4
Fig 3.2.1
Power supply
A regulated power supply is an embedded circuit; it converts unregulated AC into a
constant DC. With the help of a rectifier it converts AC supply into DC. Its function is to
supply a stable voltage (or less often current), to a circuit or device that must be operated
within certain power supply limits.
The output from the regulated power supply may be alternating or unidirectional, but is
nearly always DC.
Webcam
Webcam used in this system for capturing the image. Webcam used is Logitech webcam pro
9000. It has 2 MP CMOS Zeiss lens.
Fig 3.2.2
A webcam is a video camera that feeds or streams its image in real time to or through
a computer to a computer network. When "captured" by the computer, the video stream may
be saved, viewed or sent on to other networks via systems such as the internet, and emailed as
an attachment. When sent to a remote location, the video stream may be saved, viewed or on
sent there. Unlike an IP camera (which connects using Ethernet or Wi-Fi), a webcam is
generally connected by a USB cable, or similar cable, or built into computer hardware, such
as laptops.
The term "webcam" (a clipped compound) may also be used in its original sense of a video
camera connected to the Web continuously for an indefinite time, rather than for a particular
session, generally supplying a view for anyone who visits its web page over the Internet.
Some of them, for example, those used as online traffic cameras, are expensive,
rugged professional video cameras.
Arduino.
Fig 3.2.3
MATLAB
LCD
LCD (Liquid Crystal Display) screen is an electronic display module and find a wide range of
applications. A 16x2 LCD means it can display 16 characters per line and there are 2 such
lines. In this LCD each character is displayed in 5x7 pixel matrix. This LCD has two
registers, namely, Command and Data. The command register stores the command
instructions given to the LCD. A command is an instruction given to LCD to do a predefined
task like initializing it, clearing its screen, setting the cursor position, controlling display etc.
The data register stores the data to be displayed on the LCD. The data is the ASCII value of
the character to be displayed on the LCD. Click to learn more about internal structure of a
LCD.
Table 3.1 LCD Commands
Fig3.2.4
Power supply
Fig3.2.5
PCB layout
Fig3.2.6
Fig 3.2.7
Table 3.2
Flowchart
Image Acquisition
Pre Processing
Feature Detection
Feature Extraction
Feature Matching
Display String
To conduct the project with minimum errors it is very much necessary to carry out
project in different steps. The Brief methodology to carry out the project is given
below.
Image Capturing: The first step is to capture the image using MATLAB for
preprocessing and processing operations.
Preprocessing: In this phase image processing techniques are used to used to enhance
the properties of the captured image for further operations
Feature point detection: In this image processing algorithms are used to detect the
features. The features can be anything such a edge color etc.
Feature Extraction: In this phase feature extraction descriptors are used at each key
point.
Feature Matching: In this phase the Extracted features are matched with the existing
ones to recognize the sign.
Control Signal: Once the sign is detected it is converted to text and a proper display
string is generated to be sent and displayed using arduino
The Arduino Control: The control signal is then sent over to Arduino using MATLAB
Arduino Package and displayed onto the LCD interfaced with arduino
Power Supply
5V
230V AC Rectifier Filter Voltage
DC
Transformer (Bridge) Capacitor Regulator
Circuit Diagram
Fig 3.4.2
Working: -
The power supply gives +5v and +12v supply to the circuit. The power supply
consists of four stages namely transformer, rectifier, filter, and regulator. Transformer is a
step-down transformer taking input of 230v AC and giving output of 15v at the secondary.
This 15v AC is rectified by bridge rectifier consisting of four diodes, which converts the AC
wave into fully rectified wave. The next stage is the filter stage consisting of capacitor, which
converts the fully rectified wave into the DC wave with some ripple. Last stage is the
regulator stage. Regulator removes the entire ripple and gives pure DC. The LED is
connected to indicate that power supply is ON.
The 230 AC mains supply is given to the transformer primary to get the required
voltage at the secondary. Then it is applied to the bridge rectifier, which converts the
sinusoidal input into full wave rectified output. The output of the rectifier contains some
ripple voltage. To remove this voltage filter circuit is used. A ripple voltage is nothing but a
small value of AC over DC signal. Then a pure DC is given to the regulator. The function of
the regulator is to give the constant or stable output DC in spite of changes in the load
current.
The reasons for choosing IC regulator is that they are versatile in operation and
relatively inexpensive with features like programmable output, current/voltage boosting,
internal short circuit current limiting, thermal shutdown. The 78XX are popularly known for
regulation has been used. The 78XX series is a 3-terminal positive voltage regulator and
79XX series is a 3-terminal negative voltage regulator. As name suggests it transforms the
voltage level from one level to another. Transformer used is the step down transformer to step
230 V to +9 V. It provides isolation too from the mains.
Arduino (ATmega328)
Fig 3.4.3
Overview The Arduino Uno is a microcontroller board based on the ATmega328 (datasheet). It has 14
digital input/output pins (of which 6 can be used as PWM outputs), 6 analog inputs, a 16 MHz
ceramic resonator, a USB connection, a power jack, an ICSP header, and a reset button. It contains
everything needed to support the microcontroller; simply connect it to a computer with a USB cable
or power it with a AC-to-DC adapter or battery to get started. The Uno differs from all preceding
boards in that it does not use the FTDI USB-to-serial driver chip. Instead, it features the Atmega16U2
(Atmega8U2 up to version R2) programmed as a USB-to-serial converter. Revision 2 of the Uno
board has a resistor pulling the 8U2 HWB line to ground, making it easier to put into DFU mode.
Revision 3 of the board has the following new features: 1.0 pin out: added SDA and SCL pins that
are near to the AREF pin and two other new pins placed near to the RESET pin, the IOREF that allow
the shields to adapt to the voltage provided from the board. In future, shields will be compatible both
with the board that use the AVR, which operate with 5V and with the Arduino Due that operate with
3.3V. The second one is a not connected pin that is reserved for future purposes. Stronger RESET
circuit. At mega 16U2 replace the 8U2. "Uno" means one in Italian and is named to mark the
upcoming release of Arduino 1.0. The Uno and version 1.0 will be the reference versions of Arduino,
moving forward.
Specification
Microcontroller ATmega328
Operating Voltage 5V
Input Voltage (recommended) 7-12V
Input Voltage (limits) 6-20V
Digital I/O Pins 14 (of which 6 provide PWM output)
Analog Input Pins 6 DC
Current per I/O Pin 40 mA DC Current for 3.3V Pin 50 mA
Flash Memory 32 KB (ATmega328) of which 0.5 KB used by boot loader
SRAM 2 KB (ATmega328)
EEPROM 1 KB (ATmega328)
Clock Speed 16 MHz
Power
The Arduino Uno can be powered via the USB connection or with an external power supply.
The power source is selected automatically. External (non-USB) power can come either from
an AC-to-DC adapter (wall-wart) or battery. The adapter can be connected by plugging a
2.1mm center-positive plug into the board's power jack. Leads from a battery can be inserted
in the Gnd and Vin pin headers of the POWER connector. The board can operate on an
external supply of 6 to 20 volts. If supplied with less than 7V, however, the 5V pin may
supply less than five volts and the board may be unstable. If using more than 12V, the voltage
regulator may overheat and damage the board. The recommended range is 7 to 12 volts. The
power pins are as follows: VIN. The input voltage to the Arduino board when it's using an
external power source (as opposed to 5 volts from the USB connection or other regulated
power source). You can supply voltage through this pin, or, if supplying voltage via the
power jack, access it through this pin. 5V.This pin outputs a regulated 5V from the regulator
on the board. The board can be supplied with power either from the DC power jack (7 - 12V),
the USB connector (5V), or the VIN pin of the board (7-12V). Supplying voltage via the 5V
or 3.3V pins bypasses the regulator, and can damage your board. We don't advise it. 3V3. A
3.3 volt supply generated by the on-board regulator. Maximum current draw is 50 mA.
GND. Ground pins.
Sit COE Yadrav 26
Automatic RTO Symbol Detection System Year 2017-18
Memory The ATmega328 has 32 KB (with 0.5 KB used for the boot loader). It also has 2 KB
of SRAM and 1 KB of EEPROM (which can be read and written with the EEPROM library).
Input and Output Each of the 14 digital pins on the Uno can be used as an input or output,
using pin Mode (), digital Write (), and digital Read() functions. They operate at 5 volts. Each
pin can provide or receive a maximum of 40 mA and has an internal pull-up resistor
(disconnected by default) of 20-50 k Ohms. In addition, some pins have specialized
functions:
Serial: 0 (RX) and 1 (TX). Used to receive (RX) and transmit (TX) TTL serial data.
These pins are connected to the corresponding pins of the ATmega8U2 USB-to-TTL
Serial chip.
External Interrupts: 2 and 3. These pins can be configured to trigger an interrupt on a
low value, a rising or falling edge, or a change in value. See the attach Interrupt ()
function for details.
PWM: 3, 5, 6, 9, 10, and 11. Provide 8-bit PWM output with the analog Write()
function.
SPI: 10 (SS), 11 (MOSI), 12 (MISO), 13 (SCK). These pins support SPI
communication using the SPI library.
LED: 13. There is a built-in LED connected to digital pin 13. When the pin is HIGH
value, the LED is on, when the pin is LOW, it's off.
Communication
The Arduino Uno has a number of facilities for communicating with a computer, another
Arduino, or other microcontrollers. The ATmega328 provides UART TTL (5V) serial
communication, which is available on digital pins 0 (RX) and 1 (TX). An ATmega16U2 on
the board channels this serial communication over USB and appears as a virtual com port to
software on the computer. The '16U2 firmware uses the standard USB COM drivers, and no
external driver is needed. However, on Windows, a .in file is required. The Arduino software
includes a serial monitor which allows simple textual data to be sent to and from the Arduino
board. The RX and TX LEDs on the board will flash when data is being transmitted via the
USB-to-serial chip and USB connection to the computer (but not for serial communication on
pins 0 and 1). A Software Serial library allows for serial communication on any of the Uno's
digital pins. The ATmega328 also supports I2C (TWI) and SPI communication. The Arduino
software includes a Wire library to simplify use of the I2C bus; see the documentation for
details. For SPI communication, use the SPI library.
Rather than requiring a physical press of the reset button before an upload, the Arduino Uno
is designed in a way that allows it to be reset by software running on a connected computer.
One of the hardware flow control lines (DTR) of the ATmega8U2/16U2 is connected to the
reset line of the ATmega328 via a 100 nano farad capacitor. When this line is asserted (taken
low), the reset line drops long enough to reset the chip. The Arduino software uses this
capability to allow you to upload code by simply pressing the upload button in the Arduino
environment. This means that the boot loader can have a shorter timeout, as the lowering of
DTR can be well-coordinated with the start of the upload. This setup has other implications.
When the Uno is connected to either a computer running Mac OS X or Linux, it resets each
time a connection is made to it from software (via USB). For the following half second or so,
the boot loader is running on the Uno. While it is programmed to ignore malformed data (i.e.
anything besides an upload of new code), it will intercept the first few bytes of data sent to
the board after a connection is opened. If a sketch running on the board receives one-time
configuration or other data when it first starts, make sure that the software with which it
communicates waits a second after opening the connection and before sending this data. The
Uno contains a trace that can be cut to disable the auto-reset. The pads on either side of the
trace can be soldered together to re-enable it. It's labeled "RESET-EN". You may also be able
to disable the auto-reset by connecting a 110 ohm resistor from 5V to the reset line; see this
forum thread for details.
WEBCAM
Fig 3.4.4
CD-ROM, graphics card, Internet connection, sound card, USB port, speakers
VIDEO INPUT
SYSTEM REQUIREMENTS
OS Required
Linux, Microsoft Windows Vista / XP, Microsoft Windows 7, Microsoft Windows
Vista, Microsoft Windows XP SP2 or later
INTERFACES
INTERFACE REQUIRED
LENS SYSTEM
OPTICAL SENSOR
VIDEO CAPTURE
LCD
LCD (Liquid Crystal Display) screen is an electronic display module and find a wide range of
applications. A 16x2 LCD display is very basic module and is very commonly used in
various devices and circuits. These modules are preferred over seven segments and other
multi segment LEDs. The reasons being: LCDs are economical; easily programmable; have
no limitation of displaying special & even custom characters (unlike in seven segments),
animations and so on.
A 16x2 LCD means it can display 16 characters per line and there are 2 such lines. In this
LCD each character is displayed in 5x7 pixel matrix. This LCD has two registers, namely,
Command and Data.
The command register stores the command instructions given to the LCD. A command is an
instruction given to LCD to do a predefined task like initializing it, clearing its screen, setting
the cursor position, controlling display etc. The data register stores the data to be displayed
on the LCD. The data is the ASCII value of the character to be displayed on the LCD. Click
to learn more about internal structure of a LCD.
Pin Diagram:
Table 3.3
CHAPTER 4 TESTING
PCB Checking:
Visual Testing:
Polarities of all the components like capacitors, connectors etc are checked.
It is seen that all the IC sockets are soldered properly.
Multi meter Testing:
All the IC sockets and power supply are soldered and continuity is checked
Also VCC and GND voltage are checked.
Voltages at all the pins of the microcontroller are checked with respect to ground.
Values of all possible components are checked on multimeter.
Testing Of webcam:
5.1 APPLICATIONS
Can be used to assist drivers in to detect and alert signs automatically.
Can be used to help visually impaired people to detect road signs with some
modification.
Detect all RTO signs.
It can be used in smart vehicles.
5.2 CONCLUSION
In automatic traffic sign detection system we are going to detect the various RTO signs by
using image detection technique with MATLAB software. So we can able to detect RTO
signs and it will assist the driver for safe driving. This system is helpful for reducing the
accident happens by avoiding the RTO signs.
5.3FUTURE SCOPE
5.4 REFERENCES
International Journal of Computer Applications (0975 – 8887) Volume 120 – No.24, June 2015
ISPRS Annals of the Photogrammetric, Remote Sensing and Spatial Information Sciences, Volume II-5, 2014
ISPRS Technical Commission V Symposium, 23 – 25 June 2014, Riva del Garda, Italy.
www.electronicsforyou.com
www.google.com
www.datasheets.com
www.wikipedia.com
5.5 ACHIVEMENTS
This paper discusses the problem of road safety that is biggest problem faced by the drivers.
There are lot of things are carried out for increasing the level of the road safety. The road
safety sign on road are for guiding the people for proper driving and maintaining traffic
safety. For this reason we are making system which will be guide the vehicle driver on road
while driving. The main goal of this system is to provide the information of road sign’s
present on road side. In this system RTO symbol get identified by the help of the image
processing carried out by MATLAB image processing tools. The proposed system will
capture images of road sign with help of the camera, by doing image processing the captured
image get compared with original image. The final result will display on the LCD display.
This system will alert the driver about various road sign present on the road. This system will
helpful for increasing the road safety level.
Certificates