Final R5 Data Report Template

3G BENCHMARK DRIVE TEST REPORT
UMTS DATA MONITORING BENCHMARK DRIVE TEST REPORT

PREPARED BY
MERIT TELECOMS
15 Adepegba Street by Obokun Street off Coker Road Ilupeju Lagos.

+234 1 740 1333 / 814 9907
CALABAR
JUNE, 2013
TABLE OF CONTENTS
1.0 EXECUTIVE SUMMARY ---------------------------------------------------------------------------------------------------------------------------4
2.0 BENCHMARKING METHODOLOGY ------------------------------------------------------------------------------------------------------------5
JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 1, Total 43 Pages

3.0 DATA COLLECTION DETAILS ---------------------------------------------------------------------------------------------------------------------6
4.0 TEST ANALYSIS -------------------------------------------------------------------------------------------------------------------------------------10

4.1 Overall Test Analysis -----------------------------------------------------------------------------------------------------------------------10
4.1.1 Calabar RSCP Sample Map----------------------------------------------------------------------------------------------------10
4.1.2 Calabar BLER Sample Map----------------------------------------------------------------------------------------------------13
4.1.3 Calabar UE Tx Power Sample Map------------------------------------------------------------------------------------------15
4.1.4 Calabar CQI Sample Map------------------------------------------------------------------------------------------------------19
4.1.5 Calabar Modulation Technique Sample -----------------------------------------------------------------------------------22
4.1.6 Calabar Session Mean Application Throughput--------------------------------------------------------------------------23
4.1.7 Calabar HSDPA Throughput---------------------------------------------------------------------------------------------------24
4.2 FTP TEST ANALYSIS--------------------------------------------------------------------------------------------------------------------------26
4.2.1 Point Test Areas------------------------------------------------------------------------------------------------------------------29
4.2.2 FTP Load Throughput Data----------------------------------------------------------------------------------------------------31
4.3 HTTP TEST ANALYSIS-----------------------------------------------------------------------------------------------------------------------33
4.3.1 HTTP DL Throughput Sample Distribution--------------------------------------------------------------------------------33

5.0 MTN DATA ERROR ANALYSIS------------------------------------------------------------------------------------------------------------35
6.0 MTN DATA KPI TRENDING----------------------------------------------------------------------------------------------------------------39
6.1 Data KPIs--------------------------------------------------------------------------------------------------------------------------------39
6.2 Network Quality KPIs----------------------------------------------------------------------------------------------------------------40
7.0 CONCLUSION AND RECOMMENDATION---------------------------------------------------------------------------------------------42
7.1 Conclusion------------------------------------------------------------------------------------------------------------------------------42
7.2 Recommendation---------------------------------------------------------------------------------------------------------------------43
1.0 EXECUTIVE SUMMARY ( CALABAR TEST ROUTE)

Above is a snap showing the coverage area of Calabar. The covered areas are the City Main Roads and highway, etc
2.0 BENCHMARKING METHODOLOGY

Ericsson TEMS drive test equipment (4 MS) with 3G capability were used to collect subscriber’s experience in data throughput level at
different point for each of the network operators. Both the coverage and the KPI data were collected at the same time while driving
the pre-defined routes which includes all highways, main roads and major streets.
Measurements (Data calls) were concentrated on areas with most inhabitants. Highways and motorways were driven within the speed
limits (60km/hr and 40km/hr respectively on highways and within Populated areas) according to MTN specifications.
Pre-paid SIM cards were used for the MOC benchmark the four (4) network operators.
3.0 DATA COLLECTION DETAILS

This section provides a summary of the test parameters used during the benchmark drive test.
 Networks Surveyed – MTN, Airtel, Globacom and Etisalat.

 Hardware used – TEMS Investigation License (version 13.1), Garmin GPS 60, Dell Vostro laptop, DC to AC vehicle inverter and 6
port USB power hub.
 Handsets used (MOC) – Sony Ericsson W995 phones (4 units) with pre-paid SIM cards for MTN, Airtel, Globacom and Etisalat.
 Software’s used – TEMS Investigation 13.1, TEMS Discovery Professional 3.0.3, Microsoft excel 2007, Microsoft word 2007
 Data collection time – 8.00am to 6pm daily
 Data collection date(s) – 25th to 27th Jun. 2013
Test Details Specifications

No of Operator Tested (MTN,AIRTEL,GLO,ETISALAT)
Data Test Algorithm
Attached & PDP Activation Before Every Test
FTP Download 10Mb
FTP Upload No Upload
HTTP 3 Different Websites
HTTP Websites cnn.com/aljazeera.com/facebook.com
Idle time before the next test 20 Sec
Table 1.0 below summarises the overall network call performance for the MTN benchmark drive test.
Event Details MTN AIRTEL GLO ETISALAT

Accessibility

PS attached 144 148 140 140

PS attach failures 0 0 0 0
PS attaches 144 148 140 140
PDP context activated 102 106 60 98
PDP context rejects 1 0 91 0
PDP Context activations 103 106 151 98
PDP context deactivated 101 102 58 96
% PS attach Success rate 100 100 100 100
% PDP Context activation Success rate 99.03 100.00 39.74 100.00
% PDP Context Cut-Off Ratio 99.02 96.23 96.67 97.96
Retainabiltiy
FTP Download IP Service Access Success 24 24 12 22
FTP Download IP Service Access Failure 0 3 0 1
HTTP IP Service Access Success 82 78 47 66
HTTP IP Service Access Failure 7 14 0 4
IP Service Access Failure Ratio 6.19 14.29 0.00 5.38
FTP Download Data Transfer Success 12 8 6 11
FTP Download Data Transfer Cutoff 0 6 0 1
HTTP Data Transfer Success 37 31 21 30
HTTP Data Transfer Cutoff 119 197 72 107
Data Transfer Cut-Off Ratio 70.83 83.88 72.73 72.48
FTP Download Success Sessions 12 17 6 14
HTTP Download Success Sessions 49 57 24 58
Successful PS Session 61 74 30 72

FTP Download Sessions error /failure 0 9 0 1

HTTP Download Session error / failure 128 207 72 112
PS session errors 128 216 72 113
Total PS session success rate 32.28 25.52 29.41 38.92
FTP Download Start 12 17 6 14
FTP Download End 12 17 6 14
HTTP Download Start 49 59 25 58
HTTP Download End 49 57 24 58
FTP % PS session success rate 100 100 100 100
HTTP % PS session Success rate 100.00 96.61 96.00 100.00
Throughput
Mean Application Throughput (kbps) 385.39 134.05 388 366.42
Others
Network Connect 101 105 58 97
Network Connect Error 7 11 105 26
Network Disconnect 98 102 56 96
Missing Neighbour Alerts 18 1 71 0
RRC Established 399 604 423 384
RRC Connection Reject 0 0 0 0
RRC Connection Abnormal Release 22 2 0 0
% RRC connection success 94.77 99.67 100.00 100.00
Soft Handover

Radio Link Addition 505 629 297 423

Radio Link Addition Failure 5 5 4 0
Radio Link Removal 406 451 214 307
Radio Link Removal Failure 3 1 3 1
Radio Link Replacement 98 99 58 75
Radio Link Replacement Failure 0 0 0 0
Soft Handover success 1009 1179 569 805
Soft Handover Failure 8 6 7 1
% Soft Handover success Rate 99.21 99.49 98.78 99.88
4.0 TEST ANALYSIS

4.1 OVERALL TEST ANALYSIS
4.1.1 CALABAR RSCP Sample Map

MTN AIRTEL
GLO ETISALAT
CALABAR RSCP Sample Distribution
Probability Density
Downlink RxSignal Code Power Function (PDF)
%Probability Density Functon (PDF)
MTN AIRTEL GLOBACOM ETISALAT

Ranges/ dbm
[Min, -105) 0.12 0.28 0.53 0.48
[-105, -90) 8.01 29.86 28.73 18.75
[-90, -80) 21.66 37.03 39.13 34.94
[-80, -70) 28.89 22.37 24.71 35.24
[-70, -60) 36.53 9.21 6.76 8.42
[-60, -40) 4.79 1.26 0.15 2.18
[-40, Max] 0 0 0 0
%Coverage Reliability
%RSCP > (-90dbm) 91.87 69.87 70.75 80.78
CALABAR %Good coverage Graph Distribution
MTN recorded a value of 91.87% performing above the acceptable threshold of above 90% using the basis RSCP > -90dBm.
Etisalat recorded the value 80.78%. While Glo and Airtel have 70.75% and 69.87% respectively. There’s still need for
optimization in the MTN network to enhance her performance.
4.1.2 CALABAR Block Error Rate Sample Map
MTN AIRTEL
ETISALAT
GLO
GLO ETISALAT
CALABAR Block Error Rate Sample Distribution

(% Probability Density Function)

Downlink Block Error Rate

Block Error Rate
[Min, 0) 0 0 0 0
[0, 1) 88.62 98.91 100 78.24
[1, 2) 0.49 0 0 0.08
[2, 3) 1.2 0 0 0.24
[3, 5) 2.19 0 0 1.91
[5, 100) 7.28 0.66 0 19.46
[100, Max] 0.21 0.43 0 0.08

Block Error Rate
BLER < 2% 89.11 98.91 100 78.32
CALABAR %Block Error Rate Distribution Graph
4.1.3 CALABAR UE Tx Power Sample Map

MTN AIRTEL
GLO ETISALAT
CALABAR UE Tx Power Sample Distribution

(% Probability Density Function)

UE TxPower Distribution (dBm)
Ranges MTN AIRTEL GLOBACOM ETISALAT

[Min, -50) 0 0 0 0
[-50, -30) 12.85 0.6 0.06 1.23
[-30, -20) 22.06 3.25 1.17 5.76
[-20, -10) 26.91 12.52 19.5 26.2
[-10, 0) 31.08 30.97 46.25 28.94
[0, 10) 6.03 23.82 27.87 27.74
[10, 20) 1.07 21.8 5.09 8.98
[20, Max] 0 7.04 0.06 1.13
UE Tx Power < -10dBm MTN AIRTEL GLOBACOM ETISALAT

TxPower <-10dBm 61.82 16.37 20.73 33.19
CALABAR %UE Tx Power Distribution Graph
4.1.4 Channel Quality Indicator (CQI) Mean Map
MTN AIRTEL
ETISALAT
GLO
Channel Quality Indicator (CQI) Mean Map
% Probability Density Functon (PDF)

Channel Quality Indicator
Ranges
[Min, 0) 0 0 0 0
[0, 5) 0.39 0.37 0.15 0.13
[5, 10) 3.88 3.86 2.47 2.48
[10, 15) 18.76 21.02 15.28 11.46
[15, 20) 27.34 35.2 27.19 31.47
[20, 25) 28.89 28.95 39.63 39.11
[25, 31) 20.74 10.59 15.28 15.36
[31, Max] 0 0 0 0

Channel Quality Indicator
CQI > 15 76.97 74.74 82.1 85.94
CALABAR %Mean CQI Distribution Graph
4.1.5 CALABAR Modulation Technique Sample
% Usage - Modulation Technique MTN AIRTEL GLOBACOM ETISALAT

%QPSK 86 46.93 74.39 73.13
%16QAM 14 53.07 25.61 26.87
4.1.6 CALABAR Session Mean App. Throughput DL (kbps)
Throughput MTN AIRTEL GLOBACOM ETISALAT

Mean Application Throughput (kbps) 385.39 134.05 388 366.42
4.1.7 CALABAR HSDPA Throughputs (kbps)
HSDPA Throughput / Kbps (PDF & Mean)

[Min, 0) 0 0 0 0
[0, 128) 59.25 74.87 64.83 69.44
[128, 256) 6.75 7.67 4.73 4.33
[256, 512) 12.05 10.29 8.13 7.2
[512, 1024) 13.16 6.31 15.18 11.62
[1024, 2048) 7.68 0.85 5.73 7.11
[2048, 4196) 1.1 0 1.39 0.3
[4196, Max] 0 0 0 0
HSDPA Throughput (Kbps) MTN AIRTEL GLOBACOM ETISALAT

Mean HSDPA Throughput (kbps) 295.4 115.01 271.09 230.79
4.2 FTP TEST ANALYSIS (HOT-SPOT TEST)

The hot-spot analysis test is aimed at seeing the download performance of each operator at strategy points. In Calabar, the points
considered are; Calabar Housing Estate and Eta-Agbor Road. The following parameters were considered in the test.
HS-DSCH
The High-Speed Downlink Shared Channel is the data transport channel that all active HSDPA users connected to the NodeB will use.
The use of a shared channel is a key characteristic of HSDPA and being a common resource, the HS-DSCH is dynamically shared between
users. The HS-DSCH supports adaptive coding and modulation changing to adapt to the changing conditions within the system.
Mean Application Throughput (MAT)
Mean Application Throughput is the calculated data throughput received at the application level over the whole of the data session. It is
also called the mean downlink throughput.
RSCP
The Receive Signal Code Power is the power measured by UE on a particular physical communication channel. It is used as an indicator
of signal strength, handover criteria and in downlink power control.
UE Tx Power
It is the power with which the UE communicates the NodeB via an uplink channel. A higher UE Tx power exerted the poorer the radio
environment.
CQI
Channel Quality Indicator (CQI) is a measure of the communication quality or shows the quality status of wireless channels. It contains
values (CQI (Min): 0 – 10, CQI (Mean): 11 – 20 and CQI (Max): 21 - 30) representing the measure of quality of a serving channel. A high
CQI average value depicts a channel with high quality and throughput. The CQI for a channel is dependent on the transmission or
modulation scheme used by the communication system.
BLER
Block Error Rate is used in measuring the error rate when extracting data frames. The BLER measurement is often used as a quality
control measure with regards to how well data packets are retained over time when transmitted. It is measured after channel
modulation and demodulation by evaluating the error detecting code (Cyclic Redundancy Check (CRC)) on each packet. A BLER-value of
0.01% is ideal.
HTTP
It is an application protocol for distributed, collaborative, hypermedia information systems. HTTP is the foundation of data
communication for the World Wide Web. It’s session is a sequence of network request-response transactions. An HTTP client initiates a
request by establishing a Transmission Control Protocol (TCP) connection to a particular port on a server. An HTTP server listening on
that port waits for a client's request message. Upon receiving the request, the server sends back a status line and a message of its own.
A throughput-value >512kbps is ideal.
FTP
File Transfer Protocol is the protocol for exchanging files over the internet. Just like the HTTP, FTP transfers Web pages from a server to
a user's browser and SMTP for transferring electronic mail across the Internet in that, like these technologies, FTP uses the
internet's TCP/IP protocols to enable data transfer. FTP is most commonly used to download a file from a server using the internet or
to upload a file to a server (e.g., uploading a Web page file to a server. An FTP download – value ≥ 1024kbps is suitable.
4.2.1 POINT-TEST AREA
CALABAR POINT TEST ANALYSIS

CALABAR HOUSING ESTATE ETA AGBOR ROAD
HS-DSCH MAT Avg. Tx Pwr< HS-DSCH MAT Tx Pwr<
OPERATORS (kbps) (kbps) RSCP CQI -10dBm BLER<2% (kbps) (kbps) RSCP Avg. CQI -10dBm BLER<2%
MTN 741.58 1085.48 100 26.67 100 75.44 727.71 1044.86 100 23.44 100 77.94
AIRTEL 80.42 85.78 3.95 14.08 0 99.76 257.97 274.3 99.59 18.25 16.46 100
GLO 730.88 1323.6 32.3 20.51 1.19 100 679.99 1086.57 100 24.26 66.38 100
ETISALAT 475.43 790.45 100 23.2 85.77 71.6 463.87 838.28 59.34 22.19 0 50.88
4.2.2 FTP DL Throughput Data
FTP Load Throughput / Kbps (%PDF & Mean)

[Min, 0) 0 0 0 0
[0, 128) 16.67 37.76 33.93 14.93
4.3 HTTP
[128, 256) 2.9 27.59 3.57 4.48
TEST
[256, 512) 2.9 27.07 3.57 6.72 ANALYSIS
[512, 1024) 19.57 5.86 7.14 19.4 4.3.1
[1024, 2048) 40.58 1.72 5.36 47.01
CALABAR
[2048, 4196) 17.39 0 46.43 7.46
[4196, Max] 0 0 0 0 HTTP DL
FTP Load Throughput (Kbps) MTN AIRTEL GLOBACOM ETISALAT Throughput

Mean FTP Load Throughput (kbps) 1112.66 394.91 1553.53 1059.77
Sample
Distributions
HTTP Load Throughput / Kbps (%PDF & Mean)

[Min, 0) 0 0 0 0
[0, 128) 33.26 58.54 21.68 30.21
[128, 256) 13.57 11.95 5.65 18.17
[256, 512) 16.41 11.91 12.39 15.51
[512, 1024) 18.64 9.52 33.52 19.44
[1024, 2048) 12.9 1.71 22.59 10.76
[2048, 4196) 1.72 0.14 2.73 1.5
[4196, Max] 0.22 0.03 0 0
HTTP Load Throughput (Kbps) MTN AIRTEL GLOBACOM ETISALAT

Mean HTTP Load Throughput (kbps) 473.86 182.08 675.74 439.25
CALABAR HTTP DL Throughput Sample Distribution Graph
5.0 CALABAR Data Error Analysis Table
Sector Tx BLER Mean HTTP TECHNICAL

Time Date Latitude Longitude SC RSCP HTTP_Error_Cause SUGGESTED RECOMMENDATION
ID Pwr (%) CQI Error CAUSE
13:07:49.000 6/25/2013 4.9396923 8.3197130 2599GC 124 -84.6 -13.0 0.0 18
13:07:49.744 6/25/2013 4.9396926 8.3197130 HTTP An error occured on Poor Apply congestion control or rate adjustment
Error the socket, Unable to congestion mechanism and carry-out SSV on the site
connect to the remote control 2599
server
13:07:59.000 6/25/2013 4.9396923 8.3197120 2599GC 124 -83.6 -13.0 0.0 17
13:07:59.542 6/25/2013 4.9396923 8.3197120 HTTP Failed to look up Poor Apply congestion control or rate adjustment
Error domain name, The congestion mechanism and carry-out SSV on the site
remote name could control 2599
not be resolved.
13:09:01.000 6/25/2013 4.9398165 8.3197160 2319GC 98 -82.3 -15.0 0.0 16
not be resolved.
13:10:03.000 6/25/2013 4.9509950 8.3464700 2228GA 98 -72.9 -18.0 20
13:10:04.828 6/25/2013 4.9509950 8.3464700 HTTP Failed to look up Poor Carry-out SSV on the site 2228 as a network
Error domain name, The congestion anomaly is observed
remote name could control
not be resolved.
13:11:07.000 6/25/2013 4.9509950 8.3464700 2053GA 90 -65.6 -21.0 0.0 23
not be resolved.
13:12:11.000 6/25/2013 4.9509950 8.3464700 2395GC 500 -82.1 -14.0 0.0 16
not be resolved.
13:13:25.000 6/25/2013 4.9509950 8.3464700 2395GC 500 -71.2 -7.0 21
not be resolved.
13:15:51.000 6/25/2013 4.9509950 8.3464700 2395GB 492 -59.9 -31.0 25
not be resolved.
13:20:43.000 6/25/2013 4.9509950 8.3464700 2261GB 84 -82.8 -21.0 0.0 7
13:20:44.262 6/25/2013 4.9509950 8.3464700 HTTP Failed to look up Poor channel Adjust fast-feedback channel allocation
Error domain name, The quality
remote name could reported
not be resolved.
13:24:55.000 6/25/2013 4.9509950 8.3464700 2296GA 100 -77.7 -8.0 20
Error domain name, The congestion mechanism
not be resolved.
13:31:07.000 6/25/2013 4.9509950 8.3464700 2313GA 474 -74.9 -17.0 0.0 24
not be resolved.
13:32:27.000 6/25/2013 4.9509950 8.3464700 2537GA 124 -79.8 -18.0 20
not be resolved.
13:33:55.000 6/25/2013 4.9509950 8.3464700 206GB 493 -83.7 -8.0 0.0 17
13:33:56.290 6/25/2013 4.9509950 8.3464700 HTTP Failed to look up Poor Carry-out SSV on the site and apply
Error domain name, The congestion congestion control or rate adjustment
remote name could control mechanism on 206
not be resolved.
13:35:11.000 6/25/2013 4.9509950 8.3464700 206GB 493 -80.7 -13.0 0.0 16
not be resolved.
13:37:29.000 6/25/2013 4.9509950 8.3464700 206GC 501 -77.3 -26.0 0.0 14
not be resolved.
13:39:07.000 6/25/2013 4.9509950 8.3464700 206GC 501 -75.2 -19.0 28
not be resolved.
13:40:57.000 6/25/2013 4.9509950 8.3464700 206GC 501 -76.4 -27.0 22
not be resolved.
13:42:25.000 6/25/2013 4.9509950 8.3464700 2044GA 266 -78.2 -14.0 0.0 15
not be resolved.
6.0 MTN DATA KPI TRENDING

6.1 DATA KPIs
The data KPIs considered are RSCP, CQI, BLER and Tx power. These KPIs have been discussed earlier in this report.
There’s an improvement of 12.03% on the data KPIs
6.2 NETWORK QUALITY KPIs
The data KPIs considered are:
PDP Context Activation
Packet data protocol (PDP) context activation is a term used to show the success logical association of the UE and Public Data Network
(PDN) running across a GPRS network in a mobile wireless network.
PS Session Success
It shows the successful completion of GRPS service over a channel. This channel focuses on that packet alone been transmitted. It can
be used to ascertain the level of accessibility of a network in performing GPRS service
RRC Connection Success
The RRC connection success shows the when the UE leaves the idle mode and correctly establishes signalling radio bearers on the
DCCH.
There’s an improvement of 9.14% on the network quality KPIs
7.0 CONCLUSION AND RECOMMENDATIONS.
CONCLUSION
Two alternative tests on UE data capability with relation to the user experience at various points was covered in Calabar using client-
recommended testing tools.
The first part was majorly the File Transfer Protocol (FTP) test at strategic points (Hot-spots) while the second part captured HyperText
Transfer Protocol (HTTP) test round the City.
RECOMMENDATIONS
In the FTP Test, MTN performed credibly in the areas the test was carried-out. Hence, she reported a Mean FTP throughput above
1000kbps second to Glo. Her performance was affected by loss of data packets and the reported CQI or the CQI reporting technique. To
this end, there should be an overview of the CQI mapping table and reporting schemes.
In the HTTP test although MTN performed well among others in most of the metrics used for the benchmarking methodology; she still
needs to improve in her coverage performance and reduce the BLER in the city as they were traces of bad radio environment revealed
by the overall low UE Tx power. Improvements should be made on the channel quality as it affected the overall throughput.

Final R5 Data Report Template

Caricato da

Informazioni sul documento

Titolo originale

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

Final R5 Data Report Template

Caricato da

Copyright:

Formati disponibili

3G BENCHMARK DRIVE TEST REPORT

UMTS DATA MONITORING BENCHMARK DRIVE TEST REPORT

15 Adepegba Street by Obokun Street off Coker Road Ilupeju Lagos.

2.0 BENCHMARKING METHODOLOGY ------------------------------------------------------------------------------------------------------------5

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 1, Total 43 Pages

3.0 DATA COLLECTION DETAILS ---------------------------------------------------------------------------------------------------------------------6

4.0 TEST ANALYSIS -------------------------------------------------------------------------------------------------------------------------------------10

4.1.1 Calabar RSCP Sample Map----------------------------------------------------------------------------------------------------10

4.1.2 Calabar BLER Sample Map----------------------------------------------------------------------------------------------------13

4.1.3 Calabar UE Tx Power Sample Map------------------------------------------------------------------------------------------15

4.1.4 Calabar CQI Sample Map------------------------------------------------------------------------------------------------------19

4.1.5 Calabar Modulation Technique Sample -----------------------------------------------------------------------------------22

4.1.6 Calabar Session Mean Application Throughput--------------------------------------------------------------------------23

4.1.7 Calabar HSDPA Throughput---------------------------------------------------------------------------------------------------24

4.2 FTP TEST ANALYSIS--------------------------------------------------------------------------------------------------------------------------26

4.2.1 Point Test Areas------------------------------------------------------------------------------------------------------------------29

4.2.2 FTP Load Throughput Data----------------------------------------------------------------------------------------------------31

4.3 HTTP TEST ANALYSIS-----------------------------------------------------------------------------------------------------------------------33

4.3.1 HTTP DL Throughput Sample Distribution--------------------------------------------------------------------------------33

5.0 MTN DATA ERROR ANALYSIS------------------------------------------------------------------------------------------------------------35

6.0 MTN DATA KPI TRENDING----------------------------------------------------------------------------------------------------------------39

6.1 Data KPIs--------------------------------------------------------------------------------------------------------------------------------39

6.2 Network Quality KPIs----------------------------------------------------------------------------------------------------------------40

7.0 CONCLUSION AND RECOMMENDATION---------------------------------------------------------------------------------------------42

1.0 EXECUTIVE SUMMARY ( CALABAR TEST ROUTE)

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 3, Total 43 Pages

2.0 BENCHMARKING METHODOLOGY

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 4, Total 43 Pages

3.0 DATA COLLECTION DETAILS

 Networks Surveyed – MTN, Airtel, Globacom and Etisalat.

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 5, Total 43 Pages

 Data collection time – 8.00am to 6pm daily

 Data collection date(s) – 25th to 27th Jun. 2013

Test Details Specifications

Event Details MTN AIRTEL GLO ETISALAT

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 6, Total 43 Pages

PS attached 144 148 140 140

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 7, Total 43 Pages

FTP Download Sessions error /failure 0 9 0 1

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 8, Total 43 Pages

Radio Link Addition 505 629 297 423

4.0 TEST ANALYSIS

JUNE, 2013(R5) MTN 3G Benchmark DT Report – CALABAR Page 9, Total 43 Pages

CALABAR RSCP Sample Distribution

MTN AIRTEL GLOBACOM ETISALAT

[Min, -105) 0.12 0.28 0.53 0.48

[-105, -90) 8.01 29.86 28.73 18.75

[-90, -80) 21.66 37.03 39.13 34.94

[-80, -70) 28.89 22.37 24.71 35.24

[-70, -60) 36.53 9.21 6.76 8.42

[-60, -40) 4.79 1.26 0.15 2.18

CALABAR %Good coverage Graph Distribution

4.1.2 CALABAR Block Error Rate Sample Map

CALABAR Block Error Rate Sample Distribution

(% Probability Density Function)

MTN AIRTEL GLOBACOM ETISALAT

[0, 1) 88.62 98.91 100 78.24

[1, 2) 0.49 0 0 0.08

[2, 3) 1.2 0 0 0.24

[3, 5) 2.19 0 0 1.91

[5, 100) 7.28 0.66 0 19.46

[100, Max] 0.21 0.43 0 0.08

MTN AIRTEL GLOBACOM ETISALAT