DRIVE TEST REQUIREMENTS

Proprietary and confidential

REQUIREMENT FOR DRIVE TESTING

Proprietary and confidential

OMC statistics provide an efficient means of evaluating performance of the entire network. However in addition to this it is extremely valuable to conduct drive test performance measurements for the following reasons: Test the network from the subscribers point of view Test the complete system, end-to-end (mobile-to-land) Benchmark performance against competitor networks Test specific important routes and areas Test in-building coverage for specific buildings (walk test) AIRCOM International can conduct drive test data collection and analysis using the NEPTUNE drive test tool, and can provide comprehensive reports supporting all of the above requirements. This includes detailed competitor analysis and benchmarking supported by the PROBE benchmarking tool.
Proprietary and confidential

DRIVE TEST PROCESS

Proprietary and confidential

Drive testing involves driving in a vehicle and collecting network data by making a lot of calls. The data collected includes data for serving cell as well as the neighbors. This data collected helps us to find and analyze the problems in the network. Equipment Necessary for Drivetesting. Vehicle Drive test mobile phone (e.g.Ericcson TEMS) External vehicle mounted GPS Laptop with drive test software and GPS connection capability.

Proprietary and confidential

Drive Test Setup

Proprietary and confidential

 Drive test routes should be chosen to be representative of the part of the

network under study, covering a range of different coverage areas (urban, suburban, etc.). If possible simultaneously collect GSM speech and GPRS drive test data. Drive test to be carried out during normal daylight hours to reflect normal network load conditions. Calls to be made preferably mobile-to-PSTN. Call duration to be equal to the average call duration for the network, as derived from OMC statistics. Allow 10s idle time between calls. GPRS data calls to be set according to the average data call length for the network. At least 1000 calls required for good statistical confidence.

Proprietary and confidential

Drive test types:

Drive test can be categorized in three types

Routine drive test
Problem specific drive test Cell coverage analysis drive test

Proprietary and confidential

Routine drive test

Optimization is a ongoing process and the network needs to be monitored

on a daily basis.

Routine drive test forms a integral part of this process. Drive test routes are decided by the Network operator and these routes are
regularly drive tested and any problems found are reported.

These problems are then further analyzed and solved. Hence it is important that these drive test routes are selected carefully. Drive test routes should include all the major road, important location,
airports etc.

Also they should be able to cover most of the cells. Each drive test route should be typically 2 - 3 hours long.
Proprietary and confidential

Typical Optimization process using routine drive testing

The drive test routes must be decided by the operator and a priority set on
the routes for testing.

The drive test routes are usually 2 - 3 hours in duration in order to ensure
that the data generated is of a manageable size.

The drive test teams use the Test Mobile equipment (e.g.TEMS) to make
test calls to the MSC test number on the network of 2 minute duration with a 15 second break.

All data is logged on the computer, location information is also taken using
a GPS receiver.

During or after completion of the drive test route, analysis of the data
collected is performed to identify areas of dropped or noisy calls.

This will be done using FICS or other similar software.

Proprietary and confidential

 Should the analysis of the route indicate problems of either dropped or

noisy calls then with the aid of the RF design and Database parameters, an assessment is made to identify the possible source of interference causing the noisy or dropped call. If a call is dropped and no interference is present a retest is made in the same area, if the scenario of the dropped call can be repeated, the identity of the problem cell will be obtained and corrective action taken. To assist in confirming possible sources of interference there may be a requirement to remove the suspected interfering channel. This would be done by the optimisation engineers. The suspected interfering carrier would be removed temporarily from service and test calls made again in the problem area, this would show if the interference had been removed. The process for temporarily removing carriers would have to be agreed with the operator, this usually varies as to the importance of the cell as to what time of day it can be taken out of service.
Proprietary and confidential

After conformation as to what is causing the problem with the drive test route, the drive test engineer will attempt to find a solution to the problem. This can be one of a number of possibilities i.e. Power Change to BTS, Frequency Plan change, Neighbor addition required, etc. Once a possible solution to the problem has been found it may be possible in some circumstances to immediately attempt the solution via the OMC, this usually relates to minor database changes and adding neighbors. The solution is implemented and proven immediately. If the problem is rectified the change remains in place and a change request is raised for the solution for the purpose of keeping records of all changes in the network. If the solution requires a major database change or antenna work a change request must be raised via the Optimization Control Engineers. After the solution is implemented a retest of the problem area is carried out to confirm the problem has been solved
Proprietary and confidential

Problem drive testing Any problem reported by statistical analysis, routine drive testing, customer care centre , alarms need to be analyzed in detail to find a solution. Problem specific drive testing is a important tool which helps us do it. Here we make a list of problematic cell and drive test them thoroughly to analyze the problem. There may be many different methods which a optimization engineer may employ for the analysis. As an example, if a particular cell is being interfered the frequency of the cell may be changed temporarily to identify the interferer. Also the levels and TA at which the cell is being interfered may be analyzed. Here the data collection and analysis are done simultaneously.

Proprietary and confidential

Cell Coverage Analysis Drive Test It has been found that normally that the coverage and server area of the cells differ from the planned area. Hence it is often found that new cells that come on air serve far more or much less area than initially planned and same could be the case with the coverage. This could lead to two problems. If the server area is less than planned it could lead to coverage holes or poor cover areas. If the coverage area is more than planned it may cause interference in the network. Hence it is important that once new cells come on air they must be thoroughly drive tested to determine their server and coverage areas. If any major deviation from the initially planned design is found the cell sites should be optimized.

Proprietary and confidential

Scanning This is a important feature of the drive test software. It enables us to lock onto a particular frequency during the drive test which is helpful in determining the server area of a cell. Also we scan a set of frequencies and have a graphical display of the same or can also be stored for further analysis. This is helpful in finding interfering frequencies and also in finding clear frequency.

Proprietary and confidential

Optional Features Some drive test equipment provide supplementary features which help during drive test. Map displaying the drive tested area showing the major roads, location, cell sites is provided ,this helps us to be always aware as to where we are in the network. Also some vendors provide spectrum analyzer which helps in finding the interfering frequencies and to find clear frequencies.

Proprietary and confidential

DRIVE TEST OUTPUTS

Proprietary and confidential

Using the drive test equipment we can monitor the following Status Information

Error reports
Mode reports Layer 2 messages

Layer 3 messages

Proprietary and confidential

Status Information In status information we get the following information General Information: This includes the Latitude ,longitude data, server call name, Marker ,data, time , log file name etc. Serving cell: This includes Cell Identity, BSIC, ARFCN ,MCC, MNC, LAC. Serving + Neighbor cell data: This includes CI, BSIC, ARFCN, Rxlev, C1 and C2 for the serving and the best 6 neighbors. Dedicated channel: This includes data such as Channel number, Timeslot number, Channel type and TDMA offset,hopping information and channel mode. Radio Environment: This includes serving cell,lat , long, rxlev, rxqual, TA, DTX and RL Timeout counter information.

Proprietary and confidential

Error reports If any errors are reported during the call they can be analyzed from this report. Mode reports These are the channel mode reports.

Layer 2 messages
All the layer 2 messages can be analyzed. Layer 3 messages All the layer 3 messages can be analyzed.

Proprietary and confidential

MEASUREMENT METRICS

Proprietary and confidential

GSM Drive Test Metrics GSM drive test data can be presented in a number of ways. A combination of graphical presentation and statistical analysis is recommended. The examples below show measurements for 2 networks for comparison purposes. Graphical Presentation The following parameters can be displayed on a map, allowing the visualisation of specific problems by location: Route Plots RxLev Full: Route Coverage Plot RxLev Sub: Route Coverage Plot (excluding dummy bursts during DTX operation) RxQual Full: Route Quality Plot RxQual Sub: Route Quality Plot (excluding dummy bursts during DTX operation) FER: Route Frame Erasure Rate Plot MS TX Power: Route plot of Mobile Transmit Power SQI Plot: Route Plot of Speech Quality Index (or equivalent, if available) Events Events plots may be superimposed on one of the above route plots, eg. RxLev or RxQual. Call Drops: Plot of dropped call events Setup Failures: Plot of call setup failure events HO Failures: Plot of Handover Failure events HO Success: Plot of Successful Handover events (if required)

Proprietary and confidential

GPRS Drive Test GPRS drive test data can be presented in a number of ways, much the same as GSM drive test data. A combination of graphical presentation and statistical analysis is recommended. Graphical Presentation The following parameters can be displayed on a map, allowing the visualisation of specific problems by location: Route Plots UL/DL RLC Throughput: Radio Link Layer data throughput UL/DL LLC Throughput: Logical Link Layer throughput (user data) UL/DL RLC Block Error Rate (BLER): Radio Link Block Error Rate UL/DL RLC Retransmission Rate: Radio Link Retransmission Rate UL/DL Coding scheme used (CS1-4): Allocated Coding Scheme UL/DL Number of timeslots used: Allocated timeslots Events Events plots may be superimposed on one of the available route plots, eg. RxLev, RxQual, RLC throughput, etc. PDP Context Activation Failure: Failure to activate PDP Context (Packet Data Protocol) PDP Context Loss: Loss of PDP Context (GPRS Call Drop)

Proprietary and confidential

Additional GPRS Metrics The following metrics are also useful, if available: UL/DL TCP Throughput UL/DL UDP Throughput Delay (Latency) UL/DL/Round-trip IP Packet Loss Rate Jitter

Proprietary and confidential

DRIVE TEST ANALYSIS

Proprietary and confidential

Following types of analysis are carried out: Coverage Analysis Interference Analysis: Handover Analysis Neighbour Analysis: Call Analysis: Layer 2 Analysis Layer 3 Analysis Level Analysis Quality Analysis To identify co-channel and adjacent channel interference related problem To identify missing neighbours. To check network performance against predefined KPIs like DCR,CSSR,CSR,Call Setup time,Call hold time etc.

Proprietary and confidential

RxLev Distribution
RxLev Distribution
4500000

Number of Measurements

4000000 3500000 3000000 2500000 2000000 1500000 1000000 500000 0 0-10 11-20 21-30 31-40 41-50 51-60 61-70

Network A Network B

RxLev

Proprietary and confidential

RxQual Distribution
RxQual Distribution
12000000

Number of Measurements

10000000 8000000 6000000 4000000 2000000 0

Network A Network B

ua l0

ua l1

ua l2

ua l3

ua l4

ua l5

ua l6 xQ R

xQ

xQ

xQ

xQ

xQ

xQ

Proprietary and confidential

xQ

ua l7

FER Distribution
Frame Erasure Rate Distribution
12000000

Number of Measurements

10000000 8000000 6000000 4000000 2000000 0

0-10 11-20 21-30 31-40 41-50 51-60 61-70 71-80 81-90 91-100

Network A Network B

FER

Proprietary and confidential

MS TX Power
Mobile Transmit Power Distribution
10000000

Number of measurements

9000000 8000000 7000000 6000000 5000000 4000000 3000000 2000000 1000000 0 33 31 29 27 25 23 21 19 17 15 13

Network A Network B

MS TX Power

Proprietary and confidential

Access Failure Rate (1-Call Setup Success Rate )

Access Failure Rate %
12.0% % 10.0% of Ac ce 8.0% ss Att 6.0% em pts 4.0% 2.0% 0.0% Network A Network B 9.8% 8.2%

Proprietary and confidential

Blocked Call Rate

Blocked Calls and No Service [%]
12% 10% 8% 6% 4% 2% 0.3% 0% Network A Network B No Service Attempts Blocked Calls 0.2% 9.5% 8.0%

Proprietary and confidential

Call Drop Rate

Dropped Call Rate %
3.5% % 3.0% of Co 2.5% mp let 2.0% ed Cal 1.5% ls 1.0% 0.5% 0.0% Network A Network B 2.9%

1.3%

Proprietary and confidential

Handover Failure Rate

Handover Summary
1600 1400 Nu m be r of Ha nd ov er s 1200 1000 800 600 400 200 0 Network A Network B Handover completed Handover failed 1176 1444 35 12

Proprietary and confidential

Average SQI
Average Speech Quality Index (SQI)
24 21 SQI 18 15 12 9 6 3 0.0 Network A Network B 19.3 19.1

Proprietary and confidential

DL RLC Throughput (bytes/sec) vs DL RLC BLER

6000 5000 4000 3000 2000 1000 0 90% 50% 10%

12

18

26

33

41

52

63

Proprietary and confidential

83

DL LLC Throughput (bytes/sec) vs DL RLC BLER

4500 4000 3500 3000 2500 2000 1500 1000 500 0 90% 50% 10%

12

18

26

33

41

52

63

Proprietary and confidential

83

NEPTUNE AND PROBE

Proprietary and confidential

NEPTUNE is a sophisticated test and diagnostic optimization tool on the market and, uniquely, does not simply collect, log and display the necessary data, but also suggests possible causes and solutions to any problems. NEPTUNE can be used for GSM900, 1800, 1900 and Dual Band and GPRS technologies, fully supporting dual-mobile tests and measurement such as GSM900/DCS1800 or GSM1900.

Proprietary and confidential

Features
State-of- the-art PC based optimization tool delivering real time
analysis capabilities. User friendly with intuitive menu structure making it ideal for both real-time and post measurement analysis. Automatic fault finding and problem solving diagnostic capabilities Live call analysis

Statistical and graphical display

Long and short term cost savings due to competitive pricing and the substantial shortening of the optimization process. It also supports additional testmobile formats, which can be loaded and analyzed

Proprietary and confidential

Commercial-in-Confidence

Testmobile Import Facilities

NEPTUNE allows import of additional file formats (GSM and TETRA) in order to undertake analysis of data collected from other systems. For example: TEMS Investigator

TOM Measurement System

GPRS and HSCSD, Nemo technologies GSM log files from X-PLOR ANT units.

Proprietary and confidential

Commercial-in-Confidence

Analysis
In terms of data analysis, NEPTUNE provides: Full summary of actual signal coverage (RXLev) Full summary of received quality (RXQual) Enhanced handover performance and level distribution calculations Statistical Analysis Replay & Analysis Call Success
Proprietary and confidential

Commercial-in-Confidence

Call Analysis
NEPTUNE can analyze live calls, call success, signal levels and call quality and provide separate graphical displays on the 2D Map View in real time. NEPTUNE also incorporates the following features - mean and worst call levels, quality, detailed comparative summary of cells signal strengths, analysis of sites which utilize the co-channel and adjacent channels and results of co-channel and adjacent channel interference. The user may define thresholds for acceptable signals and quality levels.

Proprietary and confidential

Commercial-in-Confidence

Statistical Reporting
Once a file is loaded, NEPTUNE will automatically generate a statistical summary enabling the improvement of ongoing system engineering to be measured.

Proprietary and confidential

Commercial-in-Confidence

Handover Analysis
All handovers are analysed and problems are identified.For each problem, causes and solutions are suggested. NEPTUNE examines handovers in great detail:
Problem areas are automatically identified Handover success/failure is shown on route Position failure is located on XY graph Cause/solution proposed for each failure Step-by-step replay control allows every stage of handover to be broken down for detailed analysis Forced Handover
Proprietary and confidential

Commercial-in-Confidence

Neighbour Analysis
NEPTUNE summarizes critical information relating to the neighbour relations and, once a problem is perceived, will provide the following:
The serving cells ID and full geographic location The ID and full geographic location of the Neighbour cells that are either missing or have not been measured Problem areas are separately displayed on the 2D map view

Proprietary and confidential

Commercial-in-Confide

Diagnostic Capabilities
NEPTUNE is the only system to provide automatic faultfinding and problem solving diagnostic capabilities. Full location and proposed solutions are provided for: Low signal level Poor speech quality Failed handovers Missing system neighbour definitions

Proprietary and confidential

Commercial-in-Confidence

Testmobile Import Facilities

NEPTUNE allows import of additional file formats (GSM and TETRA) in order to undertake analysis of data collected from other systems. For example: TEMS Investigator

TOM Measurement System

GPRS and HSCSD, Nemo technologies GSM log files from X-PLOR ANT units.

Proprietary and confidential

Commercial-in-Confidence

PROBE
PROBE is an add on module to Neptune that a gives you the ability to perform time-based, operator based and distance based analyses. As a network analysis tool, PROBE differs from the existing analysis functionality of Neptune because the statistics generated show the system s problems as a whole rather than pin-pointing each and every problem.

Proprietary and confidential

Commercial-in-Confidence

Features
Ideal for both real-time and post measurement analysis Displays a networks Key Performance Indicators Key Performance Indicators are combined to produce the Network Quality and Efficiency Factor Statistical and graphical display Long and short term cost savings due to competitive pricing and the substantial shortening of the optimization process

Flexible hardware option

Proprietary and confidential

Commercial-in-Confidence

SPECIFIC FUNCTIONS OF PROBE

Handover Statistics Handover describes the change in the serving cell for the mobile when the handover margin for the received level is achieved. PROBE provides information regarding:

Handover Distribution - The number of

Inter and intra cell handovers attempted, completed and failed

Handover Performance - Inter and intra

cell success rate and the total HO success rate

Number of Handovers per call - The

number of handovers that occurred per call within the testmobile survey.
Proprietary and confidential

Commercial-in-Confidence

Level Statistics
The level statistics refer to the received signal level for a mobile:
Level (Full) Distribution (between -46 and -110) Level (Sub) Distribution (between -46 and -110) Cumulative Level Distribution Level Banding

Proprietary and confidential

Commercial-in-Confidence

Quality Statistics
These provide with important system level information about the received quality:
Quality full and Sub distribution

for both hopping and nonhopping samples

Interference

Cumulative Quality Distribution

Proprietary and confidential

Commercial-in-Confidence

Call Statistics
Offer similar functionality to the call success analysis performed for every survey in NEPTUNE

Call Distribution - Evaluates every call and

categorizes it as a Good Call or a No setup call

Call Holding Time - Displays the duration of each call. Call Performance - Details for the Setup rate, Failure
rate and Release rate.

Call Setup - Time Distribution Call Timers

Proprietary and confidential

Commercial-in-Confidence

Cell Statistics
Important statistics for all the cells that were observed within a survey are provided. Cell Domination Cell poor Quality Distribution

Cell Average Quality Distribution

Cell Average Level Distribution Cell Mean Call Holding Time Cell average TA Distribution
Commercial-in-Confide nce
Proprietary and confidential

Network Quality and Efficiency Factor

Information from all the above Key Performance Indicators are combined to provide:
Network Performance Indicators Network Quality and Efficiency Factor

Proprietary and confidential

Commercial-in-Confidence

EXPANSION STRATEGY

Proprietary and confidential

Following needs to be defined 1.Propagation model 2.Coverage model 3.Traffic model

4.Service model

Proprietary and confidential

1.Propagation model- A model needs to be defined which is used to simulate the propagation characteristics of the environment. 2.Coverage model-Based upon the link budget various coverage thresholds need to be defined for various clutter categories. 3.Service model-Based upon the requirements a service model is defined which will enlist the services to be provided like voice,data,SMS,VMS etc. 4.Traffic model-This model gives a description of the traffic growth that needs to be implemented vis a vis service model and demographic distribution of subscriber.Traffic model also gives an idea about the mE/sub for a region for different offered services.

Proprietary and confidential

Based upon all the models an Expansion strategy is formulated.The expansion strategy should meet the following objectives:

1. The new areas should be provided adequate coverage based upon the coverage model.
2. The congestion which is existing in the network should be removed by proposing Delta sites which are over and above the traffic which needs to be distributed for expansion. 3.Based upon the traffic model new sites should be proposed. Demographic distribution of the data should be done based upon existing traffic and by mapping the additional sites on the hotspots. 4.The KPIs set for the network should be met after addition of the new sites.Hence the network needs to be optimised.
Proprietary and confidential