Application Artificial Neural Networks in

civil Engineering

Shivam kumar gupta

Department of Civil Engineering
2016-17
BE121020107

1
 Artificial Neural Networks

Definition
Works on the principles of human brain
Requires training
Supervised or unsupervised mode
Requires validation
To test the ability of understanding
Used for prediction of future values
Success depends up on the
type of activation
Number of training data points
One of the most successful Soft Computing tool in
Civil Engineering 2
 Application in Civil Engineering

Water Resources
Time series Prediction
Rainfall-runoff prediction
Rainfall forecasting
Stream-flow prediction
Reservoir inflow prediction
Reservoir operation
Hydrology, irrigation engineering
Evaporation prediction
Evapotranspiration prediction
Irrigation return-flow prediction

3
 Application in Civil Engineering

Structural Engineering
Automated conceptual design of structural systems
Structural dynamics involving Earthquake
Non-linear analysis of plates
Detection of damages
Vibration analysis
Transportation Engineering
Traffic flow simulation
Automatic signals
Priority of highway maintenance
4
 Application in Civil Engineering

Geotechnical Engineering
Hydraulic conductivity
Soil thermal resistivity
Strain-rate dependent behaviour of soils
Prediction of settlements during tunneling
Predict settlement of shallow foundation
Assessment of damage of pre-stressed piles
Capacity of piles in cohesionless soils

5
 Advantages and Disadvantages of ANN

Advantages
Nonlinearity
Input-output mapping
Adaptivity
Trained to operate in a specific environment and can e run with
minor changes to environment

Disadvantages
Lack of physical concept and relations between input and output
It just mimic the hydrologic process
Cannot be used for extrapolation
No standardized way of selecting the network architecture

6
 Fuzzy Programming
Real world problem is very complex
Deterministic approaches
Stochastic approaches
Implicit and explicit approaches
Handle statistical uncertainty
Cannot handle non statistical uncertainty
Vagueness or impreciseness

Fuzzy theory introduced by Zadeh (1965)

Can handle the impreciseness
Fuzzy logic
Fuzzy set theory
Fuzzy optimization

7
 Genetic Algorithms
Genetic algorithms are computerized search and optimization algorithms
based on the mechanics of natural genetics and natural selection
Derived by biologists
The offspring have certain desirable characteristics
Mathematical terminology Equivalent biological
terminology
Parameter Gene
Set of parameters Chromosome
Objective function evaluation Fitness value

Population of individuals Set of solutions

Steps in GA modeling
Coding
Fitness function evaluation
Selection
Crossover, and
Mutation
8
 Contd
Coding
Each chromosome coded in binary bits of 0 to 1 represents a potential
solution consisting of the components of the decision variables (genes),
that either form can be used to evaluate the objective function.

Each variable is coded to a specified length 1 0 1 0 1

Length may vary from variable to variable

ai bi 10
2l l
All substrings are then concatenated together to form a single string
1010101101

Fitness function evaluation

To evaluate the string

The sub-strings are decoded and fitted into the objective function

9
 Contd
Selection
string is selected for mating to form the next generation

with a probability, proportional to its fitness value

weak solutions are eliminated and strong solutions survive to form the
next generation the survival of the fittest

fitness function evaluation + selection processes = reproduction

Crossover
the selected individuals are exchanged between two selected
chromosomes to create new chromosomes that preserve the best
material from two parent strings

Single point
Two point
Uniform crossover 10
 Single point crossover
Parents Offspring
101010101 101010000
110011000 110011101

Two point cross over

101010101 110010000
110011000 101011101

Uniform cross over

101010101 111011100
110011000 100010001
11
 Contd

Mutation
Gives a new genetic character to the string
Uniform
Non uniform
Modified mutation

Fitness function and convergence

Average fitness of the population approach the best individual values
Higher population quicker in convergence
Lower population misses some values
Relation between population size and length of string

P 1.65 20.21l
12
 Application of GA in water resources

Pipe network
Design of networks, and analysis

Ground water management problems

Quantity and quality management models

Reservoir operation
Single purpose single reservoir
Multi-purpose single reservoir
Multi-reservoir systems
Multi-purpose multi-reservoir systems

13
 Advantages of GA model
1. The GA typically uses a coding of the decision variable set, not the decision
variable itself

2. The GA searches from a population of decision variable sets, not a single

decision variable set

3. The GA uses the objective function itself not the derivative information

4. The GA algorithm uses probabilistic (not deterministic) search rules

5. GA takes care of stochasticity also

6. GA does not requires discretization of state variables

7. GA does not requires transition probabilities

8. GA does not have curse of dimensionality problems

9. GA models results in optimal or near optimal solutions

14
 Disadvantages of GA model

1. Cannot handle large number of constraints like LP models

2. Computationally difficult to provide very long string length with binary coding
- To some extent overcome by hexagonal coding

3. Every iteration need objective function evaluation

4. Difficult to handle mutation

Still GA model provide better solutions than

the conventional optimization techniques in
developing reservoir operating rules

15
 Application case study 1

Artificial Neural Network model

to predict inflow into a reservoir

16
 Inflow into a reservoir

Most important input variable in water

resources planning and management
Considered as
Deterministic variable
Probabilistic variable
Stochastic variable
Fuzzy variable
Historical data or Generated data
17
Conventional Models of Synthetic Streamflow generation

AR
AR(1)
AR(2)
ARMA
ARIMA
Thomas-Fierring model

All the models uses the statistical properties of the inflow

Can be used for monthly, seasonal and annual inflow prediction

18
Neural Network Model for Synthetic Streamflow generation

Using the ANN technique

Using the daily inflow data
Training of the network
Validating the network
Predicting the inflow

19
 Backpropagation Network (BPN)
BPN is a fully interconnected, layered, and feed
forward network.
No connection bypasses one layer to go directly
to a later layer.
A versatile Network, useful in handling
problems that require recognition of complex
patterns and in performing nontrivial mapping
functions.
20
 Application of BPN (Inflow Prediction)

The pattern matching ability of ANN is utilised in the present study,

to match the daily inflow values

The network was trained with a data set for twenty

years.
The output from the network is validated for five years

21
 Input Layer
Hidden Layer Output Layer

Inflow volume
during
Time t-1
It-1

Inflow volume
during
Time t-2
It-2 Inflow volume
during time t
It

time period
t-1

time period t

time period
t-2

ANN model developed for predicting the daily inflow into the reservoir
22
 Results

Trained for 20 years

Validated for five years
The network developed, predicted daily inflow values
within the tolerance limit in 390 epochs.
The tolerance limit was set as 10% of difference between
maximum and minimum values of validation set.
The Root Mean Square validation (RMSE) error is 0.629.
Coefficient of regression is 0.85

23
 175

150
HISTORICAL
ANN Model Predicted

125
6 3
Inflow x 10 m

100

75

50

25

0
0 25 50 75 100 125 150 175 200 225 250 275 300 325 350 375
Number of months starting from June 1970

Time series plot of monthly inflow into Pechiparai reservoir

24
 Application case study 2

Application of Artificial
Neural Network
. to predict
Reference crop
evapotranspiration

25
Reference crop evapotranspiration (Ref-ETr)

Estimation of Ref-ETr is indispensable for an effective

management of water resources
Numerous methods varying from simple empirical
equation to complex methods are available for its
estimation.

26
FAO modified Penman method

Developed by Pruitt (Doorenbos and Pruitt, 1975; Doorenbos and Pruitt, 1977).
The complete expression for the FAO modified Penman method is given by
ETr = CP [(/(+)) Rn + (/(+)) * f (u) * (es ea)]
where, CP = 0.68 + 0.0028(RHmax) + 0.018(Rs)-0.068(U2day)
+0.013(Uday/Unight)+0.0097 Uday(Uday/Unight)
+0.43*10-4*(RHmax) (Rs) (U2day)
Rao et al, 1974 and Schultz, 1974, Mohan (1991) has recommended Penman
method for reliable estimation of Ref-ETr in India.
Daily ETr has been estimated for 5 years used for training the ANN

27
 10

Daily reference crop evapotranspiration (mm/day)

2
0 400 800 1200 1600 2000
Days starting from Jan 1992 to Dec 1996

Daily Ref-ETr estimated using FAO Modified Penman method28

Application of BPN (The Ref-ETr network)
The pattern matching ability of ANN is utilised in the present study,
to match the Ref-ETr values to its four vital parameters namely,
relative humidity, maximum and minimum temperature and wind
speed.

The network was trained with a data set for five years.

29
 Input Layer Hidden Layer Output Layer

Mean
Relative
Humidity in
%

Maximum
Temperature
in C
REF-ET in
mm/day

Minimum
Temperature
in C

Wind speed
in km/hr

ANN model developed for predicting daily Ref-ETr

30
 Results

Trained for 5 years

Validated for two years
The network developed, predicted daily Ref-ETr values
within the tolerance limit in 190 epochs.
The tolerance limit was set as 10% of difference between
maximum and minimum values of validation set.
The Root Mean Square validation (RMSE) error is 0.629.
Coefficient of linear regression is 0.925.
ETr predicted for three years

31
 10

ANN model

FAO modified Penman method

Daily reference crop evapotranspiration (mm/day)

2
1 201 401 601
Days starting from Jan 1995 to Dec 1996

Daily Ref-ETr values estimated using FAO modified Penman method and ANN model for
validation set data
32
 8

r = 0.962

r 2 = 0.925

6
REF-ET using ANN model

2
2 4 6 8 10
REF-ET using FAO Modified Penman Method

Regression results of FAO modified Penman method Vs ANN model 33

 10

Daily reference crop evapotranspiration (mm/day)

2
0 200 400 600 800 1000 1200
Days starting from Jan 1997 to Dec 1999

Daily REF-ET predicted using ANN model34

Thank you

35