STABILITY ANALYSIS OF CONTINOUS-TIME

RECURRENT NEURAL NETWORKS

A PROJECT REPORT
Submitted by
K.BALAJI (822411104301)
S.SUNDHARRAJAN (822411104302)

in partial fulfillment for the award of the degree

of
BACHELOR OF ENGINEERING
in
COMPUTER SCIENCE AND ENGINEERING
MRK INSTITUTE OF TECHNOLOGY, KATTUMANNARKOIL

ANNA UNIVERSITY::CHENNAI 600 025

APRIL 2015

ANNA UNIVERSITY: CHENNAI 600 025

BONAFIDE CERTIFICATE
Certified that this project report STABILITY ANALYSIS OF CONTINOUSTIME RECURRENT NEURAL NETWORKS is the bonafide work of
K.BALAJI (822411104301), S.SUNDHARRAJAN (822411104302) who
carried out the project work under my supervision.

SIGNATURE

SIGNATURE

Ms.R.SEETHALAKSHMI. B.E.,M.Tech.,

Mr.S.RAMALINGAM.,M.E.,

HEAD OF THE DEPARTMENT,

SUPERVISIOR,

Department of CSE,

Assistant Professor,

MRK Institute of Technology,

Department of CSE,

Kattumannarkoil-608 301.

MRK Institute of Technology,

Kattumannarkoil-608 301.

Submitted for the project work (CS2451) and Viva-Voce Examination held
on .. at MRK Institute of Technology, Kattumannarkoil.

INTERNAL EXAMINER

EXTERNAL EXAMINER

ABSTRACT

Dynamical neural networks are being increasingly employed in a variety of

different contexts, including as simple model nervous systems for autonomous
agents. For this reason, there is a growing need for a comprehensive understanding
of their dynamical properties. Using a combination of elementary analysis and
numerical experiments, this paper begins a systematic study of the dynamics of
continuous-time recurrent neural networks. Specifically, a fairly complete
description of the possible dynamical behavior and bifurcations of 1- and 2-neuron
circuits is given, along with a few specific results for larger networks. This analysis
provides both qualitative insight and, in many cases, quantitative formulae for
predicting the dynamical behavior of particular circuits and how that behavior
changes as network parameters are varied. These results demonstrate that even
small circuits are capable of a rich variety of dynamical behavior (including
chaotic dynamics). An approach to understanding the dynamics of circuits with
time-varying inputs is also presented. Finally, based on this analysis, several
strategies for focusing evolutionary searches into fruitful regions of network
parameter space are suggested.

TABLE OF CONTENTS
CHAPTER NO

TITLE

PAGE NO

ABSTRACT

LIST OF FIGURES

Vi

LIST OF SYMBOLS

Vii

LIST OF ABBREVIATIONS

Viii

INTRODUCTION

1.1 GENERAL

1.2 OVERVIEW

LITERATURE SURVEY

SYSTEM ANALYSIS

11

3.1 EXISTING SYSTEM

11

3.2 PROPOSED SYSTEM

12

REQUIREMENTS

14

4.1 GENERAL

14

4.2 SOFTWARE TOOLS

14

SOFTWARE SPECIFICATION

14

4.3 GENERAL

14

4.4 LANGUAGE REPORT

15

4.5. NET FRAMEWORK

4.5.1 GENERAL

16
ii

4.5.2 Components of the .Net framework

17

4.5.3Common Type System (CIS)

19

4.5.4Microsoft Intermediate Language (MSIL)

19

4.5.5Just In Time (JIT)

20

4.5.6 .Net Class Library

20

4.6C# LANGUAGE

21

4.7TECHNICAL FEASIBILITY

23

4.8OPERATIONAL FEASIBILITY

24

4.9ECONOMIC FEASIBILITY

25

4.10HARDWARE REQUIRED

25

4.11SOFTWARE REQUIRED

25

METHODOLOGIES

26

5.1 PROBLEM DEFINITION

27

5.2 MODULES DESCRIPTION

28

5.2.1 SERVER MODULE

28

5.2.2 PATH SET MODULE

28

5.2.3 PACKET TRANSACTION MODULE

28

5.2.4 CLIENT MODULE

28

DESIGN PHASE

29

6.1 GENERAL

29

iii

29
6.2 UML DIAGRAMS

29

6.2.1 USE CASE DIAGRAM

29

6.2.2 CLASS DIAGRAM

29

6.2.3 SEQUENCE DIAGRAM

6.2.4 ACTIVITY DIAGRAM
7

IMPLEMENTATION

35

7.1 GENERAL

35

7.2 IMPLEMENTATION

35

7.3 REQUIREMENTS GATHERING

35

7.4 DESIGN

36

7.5 SAMPLE CODING

37

SNAPSHOTS

82

8.1 GENERAL

82

8.2 SCREENSHOTS

82

TESTING

86

9.1 TESTING

86

9.2 INTEGRATION TESTING

86

9.2.1 BOTTOM-UP TESTING

87

9.2.2 TOP-DOWN TESTING

87

9.3 BLACK BOX TESTING

88

9.4 WHITE BOX TESTING

89

iv

10

CONCLUSION AND FUTURE ENHANCEMETS

91

11

CONCLUSION

91

12

FUTURE ENHANCEMENT

92

13

REFERENCES

93

LIST OF FIGURES
FIG NO

FIGURE NAME

PAGE NO

4.5

Components Of The .NET Framework

17

6.2

Use Case Diagram

30

6.3

Activity Diagram

32

6.4

Sequence Diagram

33

6.5

Class Diagram

34

8.1

Home Page

82

8.2

Channel-1 & Channel-2 File Transmit

83

8.3

Start Server Diagram

83

8.4

Sender to Receiver Side Location

84

8.5

Acknowledgement Receive

84

8.6

Average Delay Probabilities

85

vi

LIST OF SYMBOLS

SYMBOL

SYMBOL NAME
ACTOR

DESCRIPTION
Actor is anything that
interacts with a usecase.

Initial state

It represents the starting

point of the flow.

Final state

It represents the end of the

diagram

State

Represents the state of

process.

Event/action

Represents the action or

transition in the flow.

vii

LIST OF ABBREVATION

ABBREVATION

DESCRIPTION

CTRNNs

Continuous-Time Recurrent Neural Networks

HSPDA

High Speed Downlink Packet Access

UE

User Equipment

CQI

Channel Quality Indicator

HS-PDSCH

High Speed Physical Downlink Shared Channel

BLER

Block Error Rate

TFRC

Transport Format Resource Combination

ACK/NACK

Acknowledgement/Nyquist Acknowledgement

SAA

Stochastic Approximation Algorithm

MSIL

Microsoft Intermediate Language

JIT

Just-In Time

CLR

Common Language Runtime

CTS

Common Type System

IL

Intermediate Language

DBA

Database Administrator

ICT

In-Circuit Testing

AOI

Automated Optical Inspection

viii