|
 



 




 

Submitted by
Sobin Chandras Jayaram
(7946)
Guide:Mrs. Sheeba.O



 @ smart car should primarily be able of sensing its
state.

 Making cars safer is one major challenges of the

automotive industry.

 @dvanced driver assistance systems are build into

commercial cars to assist the driver and prevent
accidents from happening.

 @ large part of these systems is vision based.

|
 
 

 





 


 
 @dvanced Driver @ssistance Systems are
embedded computing systems which
performs actions which can assist the
driver e.g.
 Lane Detection
 Driver Drowsiness Detection
 Sign Board Recognition
 Collision Detection
 Night Vision

|
 
 

 





 





|
 
 

 





 


 

 
 Development of vision for automobiles is
slowed down by the challenges in analysis
of rapidly changing image flows in real-
time.

 Huge amount of data images contain.

 Large computational and memory

resources needed for real-time completion
of even conceptually simple task.

|
 
 

 





 
Do you think we are Lacking an high
end reference system to compare
with?

Definitely

Where Man fails Mother Nature Wins.

Natural Vision systems have

been improved through
millennia of evolution and are
more robust, compact, and
efficient than artificial
counterparts.

|
 
 

 





 

|

 



 Vision systems improved through

millennia of evolution.
 Insects rely on vision for cruise control,
navigation and collision avoidance.

 Why not to take advantage of the

knowledge about these systems?

|
 
 

 





 
r  
|

 


 Lobula Giant
Movement Detector
(LGMD)

 Topological Feature
Estimator (TpFE)

 @ttention Focusing
@lgorithm (@F@)

|
 
 

 





 

|


!

 Basic components of the proposed bio-inspired
system contain input visual information.

 Input Visual information is passed to the LGMD

module for evaluation.

 Spatial attention of that LGMD is driven by the @F@

module.

 Finally, information regarding the nature of the

input object is extracted by the TpFE module.

|
 
 

 





 







 The model parameters and state variables
are tuned such that everything can be
satisfactorily executed.

 The LGMD threshold is made adaptive

instead of constant

 Threat scenarios are classified according

to the firing rate of a neuron which
receives information from LGMD and
Threshold Cell.

|
 
 

 





 



 

 
 Heuristic search shows
information is contained
within reduced regions of the
last model layers

 Focusing of region of interest

reduces amount of
information to be processed.

 The @FE divides the input

frame by defining an
attention grid formed by the
group of cells, some of which
are enabled other disabled.

 Modules are used for

activation of attention cells.
@ttention, @ctivating and
Disabling Modules

|
 
 

 





 
‰


 

! 

 LGMD potential calculation
involves loss of information
about shape of object, however
it is vital in many cases.

 Sharp turning or bulge in road

can shake the camera making
the background move rapidly.

 TpFE module overcomes these

problems by early classification
of approaching objects.

 Vertical-shaped, Horizontal-
shaped, Spatially Global,
Square-shaped class.

|
 
 

 





 
 


"

 
 
 Lane Departure Warning

 Driver Drowsiness Detection

 Sign Board Recognition

 Collision Detection and Warning

|
 
 

 





 


# 
 To navigate autonomously or follow a road,
intelligent vehicles need to detect lanes.

 It seems that the best cue for lane detection is to

use the lane markings painted on roads

 The video sensors are the best candidate for

finding lane markings.

|
 
 

 





 
ü

 





|
 
 

 





 
  

$ 


 Drowsiness slows reaction time, decreases
awareness, and impairs judgment, just like drugs
or alcohol.

|
 
 

 





 


  %&&
 @ camera will be monitoring drivers eye.

 If situation arises the warning system will be activated,

alerting the driver

 The eye regions in the face present great intensity

changes, the eyes are located using intensity changes in
the face.

 Once the eyes are located, measuring the distances

between the intensity changes in the eye area
determine whether the eyes are open or closed.

 If the eyes are found closed for 5 consecutive frames,

the system issues a warning signal.
|
 
 

 





 
ü 
 


|
 
 

 





 
  |

'
 

 The principle of Pattern Recognition is employed in
Sign-board classification.

 Traffic signals and Sign boards are employed so as

to direct the driver.

 @ database of various signs to be recognised is

made.
 The real-time image is compared with the
averaged image present in the database
 Decision are made with image having highest
correlation

|
 
 

 





 





"
ü

'
 

 
 @ Sensor
 @ Pre-processing mechanism
 @ Feature extraction mechanism
 @ Classification @lgorithm
 @ Set of examples already classified or described

|
 
 

 





 
‰


"
'
 @daptive Cruise Control
 Lane Keeping @ssistance
 Pre-Crash Safety
 Blind spot Detection/Lane Change
@ssistant
 Night Vision
 Motion Stabilization
 Parking @ssistant

|
 
 

 





 
 |" 
&
  
 More safety and comfort for the driver and other
traffic participants.
 Better utilization of the infrastructure, lower
energy consumption.

 Users of advanced driver assistance systems have

the tendency to perform other activities, because
they have a false sense of security.
 The driver can intervene when the system makes a
mistake, but also a disadvantage, because the
driver can make a wrong intervention.

|
 
 

 





 




 Conventional engineering methodologies follow a
top-down approach. @lternatively, biology has
evolved to solve complex sensory-perception-
actuation problems by following what can be
considered as a bottom-up approach.

 Future systems will be integrated with other

systems and these future systems will require
more computational power.
 More Research is needed to develop an practically
fail-safe assistance system.

|
 
 

 





 
 '"
 6



 

 
!
 
" 

#

$


 


"
 !
%!
&V

 V

 
    



  
Ú
V 
  

 
'

(
'
)*+
*,,(

 6*
"'| 


&
      



Ú'
   V !!! V   



*,,)
'
*-.,'

 6.
'|
!!

'
&
 
   
Ú

/
 

0

111

'
2,
3
*,,)
'
*-( *4 '

|
 
 

 





 
|
 
 

 





 
|