GSM Key Performance Indicator KPI Guidebook V1.1

5
GSM Key Performance IndicatorKPIGuidebook
Version: V1.1
10
Security Category: Secret Serviceable range: Radio Planning Section
15 GSM Network Planning & Optimization Dept. of Engineering Service Division
ZTE Corporation
Secret
Work Guidebook for GSM P&O Dept.
Version Introduction
Version V1.0 Date 2008-01-21 Writer Chen Chun Assessor Zheng Hao None 1V3 KPI and EDGE KPI were added. 2 Amendment: mainly directed at V2.97 Zheng Hao, V1.1 2008-12-07 Yang Jiazhi Chen Chun, Fei Aiping and V6.0. 3 Some classic KPI cases and comments were added. 4 Principles for KPI risk analysis were added. Amendment Records
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
Secret
CONTENTS
1 Overview.................................................................................................................................................1 2 CS Radio Service Statistical KPI.........................................................................................................4 2.1 Availability .....................................................................................................................................4
2.1.1
SDCCH availability/SDCCH .............................................................................................4
2.1.2 TCH availability/TCH ........................................................................................................4 2.1.3 Cell utilization.....................................................................................................................4
2.2 Accessibility ...................................................................................................................................5 2.2.1 Random Access Success rate ..............................................................................................5 SDCCH blocking rate ........................................................................................................5
10
2.2.2
2.2.3 TCH blocking rate ..............................................................................................................6 2.2.4 2.2.5 2.2.6 Radio connection ratio ........................................................................................................6 SDCCH drop rate................................................................................................................7 SDCCH assignment success rate.........................................................................................7
15
2.2.7 TCH assignment success rate..............................................................................................7 2.2.8 Call setup success rate ........................................................................................................8
2.3 Mobility ..........................................................................................................................................9 2.3.1 Handover success rate ........................................................................................................9
2.4 Reliability........................................................................................................................................9
20
2.4.1 TCH Call Drop Rate ...........................................................................................................9 2.4.2 Traffic Call Drop ..............................................................................................................10 2.4.3 2.4.4 2.4.5 Call Completion rate .........................................................................................................10 UL RxQual 0-4 .................................................................................................................10 DL RxQual 0-4 .................................................................................................................11
25
2.5 Call Setup time...............................................................................................................................11 2.5.1 2.5.2 Call setup time (GSM to PSTN) .......................................................................................11 Call setup time (GSM to GSM) .......................................................................................12
3 CS Radio Service Test KPI.................................................................................................................13 3.1 Call Setup Success Rate ...............................................................................................................13
30
3.2 Handover Success Rate ................................................................................................................13 3.3 Call Drop Rate ..............................................................................................................................13
Secret
3.4 Coverage (Drive Test)...................................................................................................................13 3.4.1 3.4.2 3.4.3 SQI ...................................................................................................................................14 MOS .................................................................................................................................14 MOS & PSEQ...................................................................................................................15
54 PS Radio Service Statistical KPI.......................................................................................................18

4.1 Accessibility..................................................................................................................................18 4.1.1 4.1.2 4.1.3 DL TBF establishment success rate ..................................................................................18 UL TBF establishment success rate ..................................................................................18 GPRS RLC .......................................................................................................................19 GPRS RLC .......................................................................................................................19 EGPRS RLC .....................................................................................................................20 EGPRS RLC .....................................................................................................................20
10
4.1.4 4.1.5 4.1.6
5 PS Radio Service Test KPI..................................................................................................................22 5.1 Accessibility..................................................................................................................................22
15
5.1.1 Attach success rate ...........................................................................................................22 5.1.2 Average GPRS attach time ...............................................................................................22 5.1.3 5.1.4 5.1.5 PDP context activation success rate .................................................................................22 PDP context activation time .............................................................................................23 PING test success rate ......................................................................................................23
20
5.1.6 Average PING test time ....................................................................................................23 5.2 Mobility ........................................................................................................................................24 5.2.1 Routing Area Update Successful rate ...............................................................................24
5.3 Data Throughput ...........................................................................................................................24 5.3.1 Average FTP download rate...............................................................................................24
25
5.3.2 Average FTP upload rate...................................................................................................25 5.3.3 Throughput........................................................................................................................25 5.4 Reliability .....................................................................................................................................25 5.4.1 PDTCH Drop Rate ...........................................................................................................25
6 Introduction to CN Statistical KPI....................................................................................................27
30
6.1 Paging success rate .......................................................................................................................27 6.2 Location update success rate ........................................................................................................27 6.3 Attach success rate ........................................................................................................................27 6.4 GPRS average attach time ............................................................................................................28 This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.
Secret
6.5 PDP context activation success rate .............................................................................................28 6.6 Routing Area Update Success rate ................................................................................................28 7 Comments on KPI Cases.....................................................................................................................30 7.1 Pengshui (Chongqing) PS Test Result...........................................................................................30
7.2 Jishou (Hunan) China Mobile EDGE Test Result.........................................................................31 7.3 Acceptance requirements for EDGE KPI of Data Service of a network......................................33 7.4 Operation & Maintenance KPI of a Network................................................................................34 7.5 Operation & Maintenance KPI of a network in Southeast Asia ...................................................36 7.6 KPI requirements for Indonesia Telkomsel network......................................................................40
Secret
1 Overview
This guidebook collected the Key Performance Indicators (KPI) for CS and PS services, which are now commonly adopted in presales bidding projects; and the definitions of different KPIs and counter formulas for V2/V3 are explained here as
well. Meanwhile, with the aim to unify response on KPIs and avoid the possible market risks, after analyzing the performance indicators of current networks of both domestic and overseas key projects, the writer provides the reference values and risk values of different KPIs in this guide. If the KPIs listed in the bidding documents go beyond the reference values and risk values (suppose risk value of the KPI is
10
provided; otherwise, suggested values shall be applied.), we need to conduct risk analysis and evaluation, meanwhile, try to avoid the risk and send out pre-warning. The KPIs can be quite different due to the differences in network structure and dimension. To make sure that our KPI can meet requirements in bidding documents, we need not only support from theories, but accumulation of work experience as
15
well. The suggested values and risk values of KPI mentioned in this guide are reference suggestions concluded from the current conditions of GSM network. As GSM techniques and skills are developing and equipment performance is improving constantly, the reference standards for KPI will change accordingly. The key requirement for engineers engaged in presales network planning is to
20
thoroughly understand and master the related KPIs, which is also the basic but highest demand for radio network planning engineers. Why network operators set up KPIs and what are they aimed at? How to define KPI and what can be resulted from deviation of KPI? How much influence can the value of KPI impose on presales bidding?
25
How to clarify KPI and how to achieve favorable negotiation results during KPI clarification? How to avoid and pre-warn KPI risks? What is the development direction of KPI assessment? Each presales radio network planning engineer shall possess related techniques of
30
and up-to-date answers to the six questions above. For lack of space, the six This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 1Total 46 pages
Secret
questions will not be further discussed in this guidebook. The engineers will be able to experience and get to know them in presales planning work in future. Generally, KPI can be classified into four types: statistical KPI, testing KPI, equipment performance KPI, customer perception KPI. Only statistical KPI and
testing KPI are elaborated here. As for equipment performance KPI and customer perception KPI, they are focused on in another guidebook. Nowadays, network operators are attaching more and more importance to KPI during negotiations. Besides the four types mentioned above, a lot more aspects are involved in KPI. KPI is also closely related to the basic network environment. Therefore, KPI is affected
10
by various factors. That is why operators are now regarding KPI as a very important leverage to shift risk and decrease network investment and maintenance cost. Equipment manufacturers must commit themselves to suitable, reasonable and timely KPI, so as to bring down contract risk and ensure profits. Rationalize commitment, share risks is an important principle in presales planning work.
15
The following are the factors that shall be taken into consideration when we work on KPI: 1. network dimension; 2. network type; 3. degree of subscriber(number) growth;
20
4. geographical distribution of network(urban, countryside, village) 5. equipment types; there is difference in KPI for V2 and V3. Functional principles for this guidebook (mainly directed at KPI): 1. This guide is only available to the radio network planning engineers engaged in presales bidding. No one is entitled to spread it outside or extensively spread it inside the company. The right to interpret the serviceable range of this guide remains with GSM Technical Research Section & Resources Section. 2. It is suggested to release the guidebook in encrypted document. It can not be procured unless logging into document security software. 3. The guide is a reference to radio network planning staff engaged in presales bidding. It can not replace the presales KPI project evaluation.
25
30
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 2Total 46 pages
Secret
4. The KPI values enclosed in this guide are valid within only half a year since the release of it. After half a year, it needs to be updated and reassessed. 5. The guide is mostly applicable to V2.97 of V2 and V6.0 (ISMG) and V6.1 (Minos) of V3.
5
Notes: V6.0 (ISMG), V6.1 (Minos), sic passim
Secret
2 CS Radio Service Statistical KPI

2.1 Availability
2.1.1 SDCCH availability/SDCCH
KPI KPI reference value Indicator definition Counter formula V2 V3 V6.0 V6.1 C11601*100%/(C11601+C11602) C100030122*100%/( C100030122+ C100030123) C900060122*100%/(C900060122+C900060123) SDCCH usable total*100%/(SDCCH usable total +SDCCH unusable total SDCCH availability (SDCCH in service rate) 99%
The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used to examine equipment performance, especially to inspect the utilization of SDCCH in Notes the cells. It is directly related to the stability of equipment transmission and power supply, etc.. It reflects the utilization ratio of network equipment and the stability of initial network operation.
2.1.2 TCH availability/TCH

KPI KPI reference value Indicator definition V2 Counter formula V3 V6.1 V6.0 C11607*100%/(C11607+C11608) (C100030125+C100030134+C100030155)*100% / (C100030125 + C100030134 + C100030155 + 100030126+ C100030217+ C100030218) (C900060125+C900060134+C900060155) (C900060125+C900060134+ C900060155+C900060126+C900060217+C900060218) The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used Notes to examine equipment performance, especially to inspect the utilization of SDCCH in the cells. It is directly related to the stability of equipment transmission and power supply, etc.. *100%/ TCH usable total*100%/(TCH usable total+ TCCH unusable total TCH availability (TCH in service rate) 98%
52.1.3 Cell utilization

KPI KPI reference Cell utilization 80%
Secret
value Indicator definition Counter formula This is mainly to compare performance of preplanning network with that of actual Notes network. The prerequisite is that precise traffic model traffic dispersion network capacity and redundancy rate shall be provided in preplanning period. This KPI is also related with network configuration and traffic distribution. None Cells, in which ratio of actual traffic / desired traffic<1
2.2 Accessibility
2.2.1 Random Access Success rate
KPI KPI reference value Indicator definition V2 Counter formula V3 V6.1 Notes V6.0 (C11626+C11696-C11697)*100%/(C11625+C11696) (C100030004+C100030010+C100030038-(C100030011 *100%/(C100030003+C100030010+C100030038) (C900060004+C900060010+C900060038-(C900060011 *100%/(C900060003+C900060010+C900060038) +C900060039)) +C100030039)) Random Access Success rate Suggested value Risk value 99% 99.5%
Random access success times *100% / Random access call attempt times
SDCCH congestion rate shall be taken into consideration, because of its direct influence on this KPI.
2.2.2 SDCCH blocking rate

KPI KPI reference value Indicator definition V2 Counter formula V3 V6.1 Notes V6.0 (C11625-C11626+C11697)*100%/(C11625+C11696) (C100030005+C100030011+C100030039) C100030010+C100030038) (C900060005+C900060011+C900060039)*100%/(C900060003+ C900060010+C900060038) *100%/ (C100030003+ Signaling channel congestion times*100% / signaling channel call attempt times SDCCH blocking rate 1%
This is mainly to evaluate the fitness between preplanned network and actual network. It will be affected by the following factors: 1. the fitness between network desired capacity and actual capacity; fitness between preset traffic model and the actual one; 2. burst traffic; 3. lack of SDCCH capacity; 4. internal & external interference; 5. preplanned redundancy rate; 6. operators special requests; 7. FR and
Secret
HR used as signaling channel.
2.2.3 TCH blocking rate

KPI KPI reference value Indicator definition TCH congestion times*100%/ TCH call attempts V2 C11612-C11699*100%/C11611-C11698 (C100030020+C100030031+C100030043+C100030047+C100030022 + Counter formula V 3 V6.1 V6.0 C100030033+C100030045+C100030049)*100%/(C100030019+C100030030+ C100030042+C100030046+C100030021+C100030032 +C100030044+C100030048) (C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+ C900060045+C900060049)*100%/(C900060019+C900060030+C900060042+C900060046+ C900060021+C900060032+C900060044+C900060048) This is mainly to evaluate the fitness between preplanned network and actual network, and the precondition is that precise traffic model traffic dispersion network capacity and redundancy rate shall be provided in Notes preplanning period. It is related to the following factors: 1. the fitness between network desired capacity and actual capacity; fitness between preset traffic model and the actual one; 2. burst traffic; 3. lack of TCH capacity; 4. internal & external interference; 5. preplanned redundancy rate; 6. handovers. 2% TCH blocking rate
2.2.4 Radio connection ratio

KPI KPI reference value Indicator definition 1-signalling channel congestion rate *(1-voice channel congestion rate)*100% V2 Counter formula V 3 V6.0 (1-(C11625-C11626+C11697)*100%/(C11625+C11696))*(1-(C11612-C11699)/(C11611-C11698)) (1-(C100030005+C100030007)*100% / (C100030003+C100030006)) * (1-(C100030011 +C100030020+ C100030031+C100030039 +C100030043 + C100030047 +C100030013+ C100030022 +C100030033+C100030041 +C100030045+C100030049) / (C100030010+ C100030019+ C100030030 + C100030038+ C100030042+C100030046+ C100030012+ C100030021 +C100030032+C100030040 +C100030044+C100030048)) V6.1 (1-(C900060005+C900060011+C900060039)*100%/ (C900060003+C900060010+C900060038))*(1(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+ C900060045+C900060049)/(C900060019+C900060030+C900060042+C900060046+ 97% Radio connection ratio
Secret
C900060021+C900060032+C900060044+C900060048))
This is mainly to compare performance of preplanned network with that of actual network. The prerequisite is that Notes precise traffic model traffic dispersion network capacity and redundancy rate shall be provided in preplanning period. This KPI is in direct tie-in constraint with SDCCH blocking rate and TCH blocking rate.
2.2.5 SDCCH drop rate

KPI KPI reference value Indicator definition Counter formula SDCCH drop rate Suggested value Risk value 0.1% 0.05%
SDCCH call drop total*100%/(random access call attempts + voice channel call attempts total (handover excluded)signalling) V2 V3 V6.0 V6.1 C11605*100%/(C11625+C11696) C100030053*100%/(C100030003+C100030010+C100030038) C900060053*100%/(C900060003+C900060010+C900060038)
C11605 accumulates SDCCH call drops resulted from all reasons, including radio link failure LAPD link breaks handover failure, etc., but except the following four reasons: lost connection with SMM, forced OMC-R disconnection, forced disconnection by other calls, and other Notes causes. If we compute according to the formula above, SDCCH call drop rate will be rather low. If counter 116135 is included (BSS call drop times on SDCCH), the suggested KPI value is 0.6%, and suggested risk value 0.4%. C100030053/C900060053 is used to find out the frequency of call drops resulted from radio link failureLAPD link breakshandover failure. This KPI value is relatively lower.
2.2.6 SDCCH assignment success rate

KPI KPI reference value Indicator definition SDCCH assignment success rate Suggested value Risk value failure times) V2 Counter formula V3 V6. 0 V6. 1 Notes SDCCH assignment success rate is involved with many factors, such as LAPD link frequency interferenceaccess parameters, etc.. C901250014*100%/(C901250014+C901250015) C11644*100%/( C11644+ C11645) C100420014*100%/ C100420014+C100420015) 96% 98%
SDCCH assignment success rate*100/(SDCCH assignment success times +SDCCH assignment
2.2.7 TCH assignment success rate

KPI KPI reference value TCH assignment success rate Suggested value 98%
Secret
Risk value Indicator definition failure times) V2 C11657*100%/(C11657+C11658) (C100030017+C100030028+C100030036+C100030235 + C100030199+C100030210)*100%/(C100030017+C100030028 V6.0 Counter formula V3 +C100030036+C100030018+C100030029+C100030037+ C100030235+C100030199+C100030210+C100030200+ C100030211+C100030135) (C900060017+C900060028+C900060036+C900060199+ C900060210+C900060235) *100%/(C900060018+C900060029+ V6.1 C900060037+C900060200+C900060211+C900060135+ C900060017+C900060028+C900060036+C900060199+ C900060210+C900060235) Notes This KPI is directly related to radio environment frequency carrier 99% TCH assignment success times*100/( TCH assignment success times +TCH assignment
problemsassignment methodsapplication of data service, etc..
2.2.8 Call setup success rate

KPI KPI reference value I Indicator definition I Note I Call setup success rate CSSR Suggested value Risk value` 92% 94%
(1-SDCCH blocking rate)* (1-SDCCH assignment failure rate)*(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate) The definition of this CSSR is relatively strict because too many factors are included (LAC SMS, etc.). The definition is not rational from the view of voice call, so that the CSSR used in MOTO excluded SMS factor. Handover is excluded.
KPI reference value II Indicator definition II Note II KPI reference value III Indicator definition III Note III Counter formula Explanation
Suggested value Risk value
93% 95%
((MOC success + MTC success / (MOC attempt + MTC attempt)) *(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate) According to common understanding, CSSR is mostly applied to inspect the establishment of voice call. It is rather reasonable to exclude LAC and SMS. Handover is excluded. Suggested value Risk value 97% 95%
((MOC success + MTC success / (MOC attempt + MTC attempt)) *(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate) The CSSR is mainly measured in the view of congestion. It is similar to Hutchisons definition of CSSR. Handover excluded. CSSR is usually obtained from the combination of original KPI. Different manufacturers have different definitions for CSSR. The formula above is regarded too strict. Some may define it to be TCH assignment success rate or radio access completion rate. We need to make clear the formula with customers. It is regarded a
Secret
favorable way to exclude location update indicators when we define this KPI.
2.3 Mobility
2.3.1 Handover success rate
KPI KPI reference value Indicator definition V2 (C11618+C11669-C11675)*100%/(C11617+C11668C11675) (C100030098+C100030102+C100030120+C100030094+ C100030096)*100 V6.0 Counter formula V3 C100030214+ +C100030095) (C900060098+C900060102+C900060120+C900060094+ C900060096) V6.1 (C900060097+C900060213+C900060214+ C900060215+C900060099+C900060100+C900060101+ C900060216+C900060119+C900060093+C900060095) This formula includes both incoming and outgoing handovers, while some operators may take into consideration only one of them. As for V3 equipment, 1-2% can be appropriately increased Notes according to real situations. This KPI can differ a lot from each other due to different types of network. In many presales bidding, the operators require a handover success rate of around 98%, which involves high risks to be reached, though several networks have reached 98%. *100%/ %/ (C100030097+C100030213+ C100030215+C100030099+C100030100 Handover success rate V2 V3 Suggested value Risk value Suggested value Risk value 94% 96% 95% 97%
Handover success times in busy hours*100% / handover request times in busy hours
+C100030101+C100030216 +C100030119 +C100030093
2.4 Reliability
2.4.1 TCH Call Drop Rate
KPI KPI reference value Indicator definition TCH drop rate / Call drop rate V2 V3 Suggested value Risk value Suggested value Risk value 1.0% 0.7% 0.7 0.5
TCH call drop times*100%/TCH assignment success times
Secret
V2 Counter formula V3 V6. 0 V6. 1 C11615*100%/(C11611-C11698-(C11612+C11656+C11658+ C11617-C11618-C11699-C116103-C116133)) (C100030054+C100030055)*100%/(C100030028+ C100030199+C100030210+ C100030098+C100030102+C100030120) (C900060054+C900060055) *100%/(C900060028+C900060036+ C900060199+C900060210+C900060098+C900060102+ C900060120) C100030036+
Voice channel call drop rate falls into two types: one is with handover included; the other is with handover excluded. The formula above takes handover in it. If handover is not included, the indicator Notes will be about 0.2% higher than the one with handover included. This discrepancy is not universally definite yet, for it can be bigger in dual-band network. Generally, call drop rate of V3 equipment is a bit lower than the one of V2. This KPI differs a lot in varied types of network. The discrepancy can reach 0.3%.
2.4.2 Traffic Call Drop

KPI KPI reference value Indicator definition V2 Counter formula Notes V 3 V6.0 V6.1 (C11616/3600)*60/C11615 ((C100030129+C100030127)/3600)*60/ (C100030054+C100030055) ((C900060129+C900060127)/3600)*60/(C900060054+C900060055) Minute per drop(MPD) V2 V3 Suggested value Risk value Suggested value Risk value 90 120 120 180
Traffic /TCH call drop times*60
This KPI of different networks varies to a large extent. Generally, its difficult for to reach this KPIs standards, if the call drop (with handover included) rate is higher than 0.5%.
2.4.3 Call Completion rate

KPI KPI reference value Indicator definition Counter formula Notes This formula is a customer KPI. We need to make it clear with customers when referring to this KPI. But it is close to customers perception. None. Refer to Indicator Definition II under Item 2.2.8 Call Success Rate CSR Suggested value Risk value 94% CSSR*(1- Call drop rate) 92%
2.4.4 UL RxQual 0-4

KPI UL RxQual 0-4
Secret
KPI reference value Indicator definition Counter formula (C116114+C116115+C116116+C116117+C116118) * 100 / (C116114 V2 +C116115+C116116+C116117+C116118+ +C116120+C116121) (C100030066+ V6.0 V3 V6.1 Notes None C100030070)*100/ (C900060066+ C900060070)*100/ C100030067+ (C100030066+ C900060067+ (C900060066+ C100030068+ C100030067+ C900060068+ C900060067+ C100030069+ C100030068+ C900060069+ C900060068+ C116119 Suggested value Risk value 97% UL RxQual 0-4 *100 / UL RxQual 0-7 95%
C100030069+ C100030070+ C100030071+ C100030072+ C100030073)
C900060069+ C900060070+ C900060071+ C900060072+ C900060073)
2.4.5 DL RxQual 0-4

KPI KPI value Indicator definition (C116122+C116123+C116124+C116125+C116126+C116127)* V2 (C116122 ( +C116123+C116124+C116125+C116126 C100030075 + C100030076+ +C116128+C116129) Counter formula V3 V6. 1 V6. 0 C100030074+ C100030077 + C100030078)*100/ ( C100030074+ C100030075 + C100030076+ C100030077 + C100030078+ C100030079+ C100030080+ C100030081) ( C900060074+ C900060075 + C900060076+ C900060077 + C900060078)*900/ ( C900060074+ C900060075 + C900060076+ C900060077 + C900060078+ C900060079+ C900060080+ C900060081) 100 / +C116127 reference DL RxQual 0-4 Suggested value Risk value 97% DL RxQual 0-4 *100 / DL RxQual 0-7 95%
Notes
None
2.5 Call Setup time

2.5.1 Call setup time (GSM to PSTN)
KPI KPI reference value Call setup time (GSM to PSTN) Suggested value 8 seconds
Secret
Risk value Indicator definition Notes We can use test software to estimate the time duration, which is related with network structure routing and radio environment. MSC provides this KPI. It differs in different network configurations. 5 seconds time duration from starting call to ringing out
2.5.2 Call setup time (GSM to GSM)

KPI KPI reference value Indicator definition Notes We can use test software to estimate the time duration, which is related with network structure routing and radio environment. MSC provides this KPI. It differs in different network configurations. Call setup time (GSM to GSM) Suggested value Risk value 5 seconds Obtain from test the time duration from starting call to ringing out 7 seconds
Secret
3 CS Radio Service Test KPI

3.1 Call Setup Success Rate
KPI KPI reference value Indicator definition Indicator value Notes DT&CQT, test pre-defined locations and Drive Test route None Call Setup Success Rate Suggested value Risk value 98% Call connection times*100% / call attempt times 95%
3.2 Handover Success Rate

KPI KPI reference value Indicator definition Indicator value Notes DT&CQT, Pre Defined Drive Test Route or NMS None Handover Success Rate Suggested value Risk value 98% Handover success times*100% / handover attempt times 95%
3.3 Call Drop Rate

KPI KPI reference value Indicator definition Indicator value Notes DT&CQT, test Pre Defined Drive Test Route or NMS None Call Drop rate Suggested value Risk value 2% Call drop times*100% / call connection times 3%
53.4 Coverage (Drive Test)

Urban Illustration of coverage requirement 85% sample of the values Suburban 85% sample of the values Rural 85% sample of the values Road 85% sample of the values
should have a value
should have a value
should have a value
should have a value
Secret
equal to or higher than 75 dBm. Influencing factors equal to or higher than 80 dBm. equal to or higher than 85 dBm. equal to or higher than 90 dBm.
1. landform; 2. inconsistency between project implementation and project plans; 3. test equipment; 4. test routes Detailed coverage requirements (as shown above) are delivered in the bid documents. Estimation of network dimension is also based on the requirements. Nowadays, requirements for network coverage are higher, so the accordingly estimated number of sites will meet the needs. If the network dimension has to be reduced due to market strategies needs, this KPI will cause problems in the acceptance inspection. Further more, we need to make sure that our customers are aware of regional assignment DT routes and test methods. Coverage KPI is one of the most important KPIs, because it directly reflects not only our radio network planning ability and the performance of our equipment, but also our core competitive strength in network planning. Due to lack of space, there is no more illustration of coverage KPI hereafter in this guide.
Notes
3.4.1 SQI
KPI KPI reference value Indicator definition This KPI is for inspecting the sound distortion degree resulted from incapable link transmission. The formula is Ericssons patent. It takes into consideration many factors, including BER FER handover times handover conditions DTX activated (or not) and Notes the encoder in use, etc., to finally get the SQI. There are different SQI top limits for different types of encoders. For half-rate encoder, the SQI top limit is 19; for full-rate encoder, 21; for enhanced full-rate encoder, 30. SQI ranges from 18 to 30. SQI value will increase when EFR is applied. SQI Suggested value Risk value 95% sample >=25 TEMS test value 95% sample >=18
3.4.2 MOS
KPI KPI reference value Indicator definition Notes The commonly used MOS assessment method consists of subjective and objective scoring parts. In the subjective part, engineers subjectively compare the original voice material and the deteriorated voice material according to ITU-T Suggestion book P.800 and P.830, and give their MOS scores respectively, then average the scores from different engineers. While in the objective part, PESQ method from ITU-T Suggestion book P.862 is employed, that is special equipment or software (e.g. the VQT test equipment of Agilent) is used to proceed the assessment. In MOS, 0 means the worst quality, 5 stands for the highest. Standard PCM quality shall reach around 4.4. Test value Mean Opinion Score ( MOS) Refer to the form attached bellow.
Secret
The MOS values for commonly used coding formats are as follows: G.711MOS 4.8 G.721G.723G.726MOS 4.2 G.728 MOS4.2 G.729 MOS4.2 G.723.15.3MOS3.5 G.723.16.3MOS3.98 MOS can be affected greatly by the performance of test equipment. The test results from different manufacturers are different. Currently, the test equipment from Actena performs the best.
Average MOS(Including FR &HR Voice version combination MOS) Frequency hopping 100% FR 100% EFR 100% AMR FR 60% HR (+EFR) 30% HR (+EFR) 10% HR (+EFR) 60% AMR HR (+AMR FR) 30% AMR HR (+AMR FR) 10% AMR HR (+AMR FR) 3.04 3.63 3.56 No hopping 3.29 3.57 3.54
TFO No frequency hopping
frequency Frequency hopping
3.4.3 MOS & PSEQ

Subjective scoring method had been used in assessment on voice quality until 2001. Users were requested to assess the voice quality of incoming calls by scoring 1-5 (5-
best, 1 - worst). This assessment method was regulated to be a standard by ITU in August, 1996. MOS assessment method was defined in its P.800 standard in details. But later it was found that this method not only took too much time, but also cost a lot. So there was an urgent need for a kind of economic test equipment, which can be used to simulate the voice quality received by users, and thus can play its part in
10
designingtesting and debugging new type of voice encoders. With the aim to meet the need, in February 2001 ITU issued the new test standard on voice transmission quality-P.862 (PESQ-Perceptual Evaluation of Speech Quality). It adopts the new algorithm developed by Psytechnics company. PESQ can be used to compute voice samples MOS-LQO value (Mean Opinion Score-Listening
15
Quality Objective). The computed result and the subjective scoring result are This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 15Total 46 pages
Secret
basically the same. PESQ compares the output signal (collected after the signal is transmitted through equipment) and the reference signal, then works out the difference. In the ordinary course of event, the bigger the difference between the output signal and the reference signal, the smaller the reference value of MOS will
be. PESQ is testified to be a reliable economic and fast measuring tool for voice encoder. Compare PESQs predicted value and the result from subjective scoring method, we can see the correlation between the two values is 0.935(refer to P862E.doc for correlation factors). For 22 kinds of ITU benchmark tests, the absolute error is within 0.5 MOS, 69.2% among which is within 0.25 MOS. It is
10
worth our attention that PESQ value ranges from 0.5 to 4.5, while MOS value ranges from 1 to 5.
Fig 1 MOS/PESQ Correlation Diagram
15
At the present time, there are two types of QOS test method-subjective and objective methods. MOS subjective test method is defined in ITU-T P.800. The objective test methods includes PSQM PSQM+ and PESQ etc.. ITU-T P.862 PESQ is the method currently recommended by ITU to test end-to-end network voice quality. It would be ideal if MOS and PESQ are simultaneously supported in the QOS test.
20
Form 1 Definition of MOS Values

Level MOS
Secret
Excellent Good Fair Poor Bad 5 4 3 2 1
Secret
4 PS Radio Service Statistical KPI

4.1 Accessibility
4.1.1 DL TBF establishment success rate
KPI KPI reference value Indicator type Indicator definition DL TBF establishment success rate Suggested value Risk value Statistical value GPRS DL signalling TBF link setup times+ GPRS DL data TBF link setup times +EGPRS DL signalling TBF link setup times +EGPRS DL data TBF link setup times*100%/ DL packet channel request times V3 V2 (C70043+C70057+C70071)*100/C70041 (C100010007+C100010015+C100010008+C100010016) V6.0 Counter formula V3 V6.1 *100%/(C100010141+C100010142+C100010143+ C100010144+C100010145+C100010146+C100010147 +C100010148) (C900040007+C900040015+C900040008+C900040016) *100%/(C900040141+C900040142+C900040143+ C900040144+C900040145+C900040146+C900040147 +C900040148) This KPI reflects the request fulfilled status of PS downlink resources. Its TBF includes DL signaling TBF GPRS DL data TBF and EGPRS DL data TBF. DL TBF link setup success rate can reflect the DL PS quality of a cell. Its major influencing factors are as follows: Notes 1. 2. 3. 4. Interference: internal & external interference; Parameters setting: eg. errors in Timer and functional parameters Stability of equipment and transmission: eg. instant breakdown(flash) resulted from high error rate or unstable link; Usability of data service functions. 95% 96%
4.1.2 UL TBF establishment success rate

KPI KPI reference value Indicator type Indicator definition UL TBF establishment success rate Suggested value Risk value 95% Statistical value GPRS UL signalling TBF link setup times + GPRS UL data TBF link setup times +EGPRS UL signalling TBF link setup times +EGPRS UL data TBF link setup times*100/ UL packet channel request times V3 92%
Secret
V2 (C70042+C70055+C70069)*100%/C70040 (C100010025+C100010033+C100010026+C100010034) Counter formula V3 V6.1 V6.0 *100% /(C100010159 +C100010160+C100010161+C100010168 +C100010163+C100010164+ C100010165+C100010166) (C900040025+C900040033 +C900040026 +C900040034) *100%/ (C900040159+ C900040160 +C900040164 +C900040161+C900040168+C900040163 +C900040165+C900040166) This KPI reflects the request fulfilled status of PS uplink resources. Its TBF includes UL signaling TBF GPRS UL data TBF and EGPRS UL data TBF. UL TBF link setup success rate can reflect the UL PS quality of a cell. Its major influencing factors are as follows: Notes 1. 2. 3. 4. Interference: internal & external interference; Parameters setting: eg. errors in Timer and functional parameters Stability of equipment and transmission: eg. instant breakdown resulted from high error rate or unstable link; Usability of data service functions.
4.1.3 GPRS RLC

KPI KPI reference value Indicator type Indicator definition UL GPRS RLC retransmission rate Suggested value Risk value 5% Statistical value GPRS UL TBF NACK blocks *100% / valid data statistics received by GPRS UL TBF V2 Counter formula V3 V6.1 V6.0 C70066*100%/ C70065 C100010063*100%/C100010062 C900040063*100%/C900040062 10%
This KPI reveals UL GPRS RLC retransmission rate, which is the most important indicator to reflect the sensibility of GPRS UL service and to show whether instability congestion and interference exist in the system. Its major influencing factors Notes are as follows: 1. 2. Interference: internal & external interference; Stability of equipment and transmission: eg. instant breakdown resulted from high error rate or unstable link;
4.1.4 GPRS RLC

KPI KPI DL GPRS RLC retransmission rate Suggested 10%
Secret
reference value Indicatory type Indicator definition GPRS DL TBF NACK blocks *100% / valid data statistics received by GPRS DL TBF V2 Counter formula V3 V6.1 V6.0 C70068*100%/ C70067 C100010065*100%/C100010064 C900040065*100%/C900040064 value Risk value Statistical value 5%
This KPI reveals DL GPRS RLC retransmission rate, which is the most important indicator to reflect the sensibility of GPRS DL service and to show whether instability congestion and interference exist in the system. Its major influencing factors Notes are as follows: 1. 2. Interference: internal & external interference; Stability of equipment and transmission: eg. instant breakdown resulted from high error rate or unstable link;
4.1.5 EGPRS RLC

KPI KPI reference value Indicatory type Indicator definition EGPRS UL TBF NACK blocks *100% / valid data statistics received by EGPRS UL TBF V2 Counter formula V3 V6.1 Notes V6.0 C70080*100%/ C70079 C100010071*100%/C100010070 C900040071*100%/C900040070 UL EGPRS RLC retransmission rate Suggested value Risk value Statistical value 5% 10%
Refer to UL GPRS RLC retransmission rate
4.1.6 EGPRS RLC

KPI KPI reference value Indicatory type DL EGPRS RLC retransmission rate Suggested value Risk value Statistical value 5% 10%
Secret
Indicator definition V2 Counter formula V3 V6.1 Notes V6.0 C70082*100%/ C70081 C100010073*100%/C100010072 C900040073*100%/C900040072 EGPRS DL TBF NACK blocks *100% / valid data statistics received by EGPRS DL TBF
Refer to DL GPRS RLC retransmission rate
Secret
5 PS Radio Service Test KPI

5.1 Accessibility
5.1.1 Attach success rate
KPI KPI reference value Indicator definition Indicatory type Counter formula Notes Normally, this KPI is the CQT value. Attach success means that the mobile phone receives the Attach Accept signaling within 15 seconds after it sends the Attach Request. It is required to perform the Attach test ten times at each test site. None test Attach success rate Suggested value Risk value 98% Attach success times/Attach attempt times100 95%
5.1.2 Average GPRS attach time

KPI KPI reference value Indicator definition Indicatory type Counter formula Notes Normally, this KPI is the same as the CQT value. Authentication included. Average GPRS attach time Suggested value Risk value 2 sec 1.5 sec
Sum of attach success duration/ Attach success times. It is the duration from the mobile sends out the first Attach Request to it receives the Attach Accept signaling. It is required to perform the test ten times at each test site. Test value None
55.1.3 PDP context activation success rate

KPI KPI value Indicator reference PDP context activation success rate Suggested value Risk value 98% PDP activation success times/attempt times 100. 95%
Secret
definition PDP activation success means that the mobile phone receives the Activate PDP Context Accept signaling 15 seconds after it sends the Activate PDP Context Request. Indicatory type Counter formula Notes Normally, this KPI is the same as the CQT value. It is required to perform the PDP activation test ten times at each test site. Test methods for GPRS and EDGE are the same. Test None
5.1.4 PDP context activation time

KPI KPI reference value Indicator definition PDP context activation time Suggested value Risk value times. PDP activation time means the duration from the mobile phone sends out the first Activate PDP Context Request to it receives the Activate PDP Context Accept. Indicatory type Counter formula Notes Normally, this KPI is the same as the CQT value. Authentication included. GPRS and EDGE are not separated in this test. Test value None 1.5 sec 1.2 sec
Sum of PDP activation duration/ PDP activation success
5.1.5 PING test success rate

KPI KPI reference value Indicator definition Counter formula Notes It is regarded as failure if the time exceeds 30 seconds. None PING test success rate Suggested value Risk value 95% 98%
Ping success times/Ping attempt times*100%
5.1.6 Average PING test time

KPI KPI reference value Indicator PING test time GPRS EDGE Suggested value Risk value Suggested value Risk value 1.5 sec 1.4 sec 1 sec 0.6 sec
Sum of Ping success duration/ Ping success times
Secret
definition Indicatory type Counter formula Notes Authentication is included in this KPI. The Ping package size will have influence on the test result. Generally, the smaller the Ping package is, the better the test result will be. It is sometimes referred as Round Trip Time. Test value None
5.2 Mobility
5.2.1 Routing Area Update Successful rate
KPI KPI reference Indicator definition Indicatory type Counter formula Notes test None Usually it can be statistical value. It also can be obtained from DT too. Routing Area Update Success rate Suggested value Risk value 90% 95%
Routing update attempt times*100% / Routing update success times
5.3 Data Throughput

5.3.1 Average FTP download rate
KPI FTP download rate Suggested value GPRS KPI reference value EDGE Risk value Suggested value Risk value 20kbps 30kbps 80kbps 120kbps
Indicator definition Indicatory type Counter formula Notes
Actual download data quantity (byte)/actual download duration Test value None Normally, this KPI is the CQT value. Class 4 mobile. Size of the downloaded document will affect the test result. Usually, the smaller the document size is, the better the test result will be. It is related to the number of PS channels terminal type encoding method and test software, etc.. The test result can also be affected
Secret
by the adoption of encoding method for CS3 and CS4. 3static time slots are configured.
5.3.2 Average FTP upload rate

KPI FTP upload rate Suggested value GPRS KPI reference value EDGE Suggested value Risk value 25kbps 35kbps Risk value 8kbps 10kbps
Indicator definition Indicatory type Counter formula Notes
Actual upload data quantity (byte)/actual upload duration Test value None Normally, this KPI is the same as the CQT value. Class 4 mobile. Size of the uploaded document will affect the test result. Usually, the smaller the document size is, the better the test result will be. It is related to the number of PS channels terminal type encoding method and test software, etc.. The test result can also be affected by the adoption of encoding method for CS3 and CS4. This KPI is the result of single time slot.
5.3.3 Throughput
Mobile phone with multi-timeslot Level 8; single Preconditions Indicators (EN) GPRS: Max data throughput-DL GPRS: Max data throughput-UL GPRS: Average data throughput-DL GPRS: Average data throughput-UL EDGE: Max data throughput-DL EDGE: Max data throughput-UL EDGE: Average data throughput-DL EDGE: Average data throughput-UL subscriber; 4 DL static signaling channels, 1 UL static signaling channel Indicators (CN) GPRS DL maximum transmission rate GPRS UL maximum transmission rate GPRS DL average transmission rate GPRS UL average transmission rate EDGE DL maximum transmission rate EDGE UL maximum transmission rate EDGE DL average transmission rate EDGE UL average transmission rate Suggested value 9.8kbyte/s 2.4kbyte/s 5kbyte/s 1.3kbyte/s 26.5kbyte/s 7kbyte/s 14kbyte/s 3.5kbyte/s
5.4 Reliability
5.4.1 PDTCH Drop Rate
KPI PDTCH Drop Rate
Secret
KPI value Indicatory type Indicator definition Counter formula Notes None reference Suggested value Risk value DT test value PDTCH drop times/ FTP download attempt times *100% 5% 2%
Secret
6 Introduction to CN Statistical KPI

6.1 Paging success rate
KPI KPI reference value Indicator definition Counter formula Paging request times refer to the sum of PAGING information sent out by all MSCs in the area, excluding the secondary paging information. Paging response times refer to the sum of the PAGING RES received by all MSCs in the area, including the second paging response. Statistical point is at MSC side. Notes BSC can indirectly provide this KPI, but its statistical point differs from that of MSC. The difference lies in call loss at Interface A. Paging success rate Suggested value Risk value 90% 93%
Paging response times*100% / Paging request times
6.2 Location update success rate

KPI KPI reference value Indicator definition Counter formula Notes This KPI can be indirectly provided by BSC, but the value is different and its statistical point differs from that of MSC too. Provided by the SMC side Location update success times *100%/ location update request times Location update success rate Provided by the SMC side
6.3 Attach success rate

KPI KPI reference value Indicator definition Indicatory type Counter formula Notes excluding Unregistered subs GPRS attach success times SGSN delivers ATTACH ACCEPT 3GPP TS 24.008excluding redeliver Statistics at SGSN side Attach success rate Suggested value Risk value 90% 95%
GPRS attach success times *100% / GPRS attach times
Secret
6.4 GPRS average attach time

KPI KPI reference value Indicator definition Indicatory type Counter formula GPRS average attach time Suggested value Risk value To be confirmed To be confirmed
Customer attach establishment duration *100% / customer number of attach establishment success Statistics Attach establishment time refers to the time duration from the receipt of GPRS ATTACH REQUEST by MS to the delivery of ATTACH ACCEPT by SGSN. If the attach time exceeds the timer, the attach duration is only computed within the attach accepted period.
Notes
6.5 PDP context activation success rate

KPI KPI value reference PDP context activation success rate Suggested value Risk value 80% 85%
success times of PDP context activation started by MS*100%/ attempt times of PDP context activation started by MS Indicator definition The attempt times of PDP context activation started by MS is the times GGSN received Create PDP Context Request from SGSN. The success times of PDP context activation started by MS is the statistic of Create PDP Context Response sent from GGSN to SGSN when Cause value is Request Accepted. Indicatory type Counter formula Notes The performance evaluation in China Mobile in 2003 (success times of PDP context activation started by GPRS terminal/ attempt times of PDP context activation started by GPRS) results are as follows: Excellency index: 94% Reach-the-mark index: 90% Lowest Threshold index: 85% Test or statistics Statistics at GGSN side
6.6 Routing Area Update Success rate

KPI KPI reference value Indicator definition Indicatory type From statistical value or DT. Routing Area Update Success rate Suggested value Risk value 92% 95%
Routing update attempt times*100%/ routing update success times
Secret
Counter formula Notes Statistics at SGSN side, provided by GPRS core network Update success rate at routing area crossing SGSN is lower than that at the SGSN routing area.
Secret
7 Comments on KPI Cases

7.1 Pengshui (Chongqing) PS Test Result
1 2 CQT scenenear cell EDGE Commissioned Multi-timeslot capability3+1 Number of PDCH static channels: 3
FTP sizeKbyte 102.381 48.18 204.8 2188.817 102.381 102.381 512.304 512.304 512.304 512.304 512.304 Download speed (Kbyte/s) 8.99 8.10 2.97 7.21 9.05 8.66 15.97 13.34 15.81 15.74 14.33 Ping timelagms 1 2 3 4 61 2 77 9 75 6 82 1 857 75 5 5 6 7 8 9 10 Download speed (kbps) 71.93 64.80 23.78 57.72 72.42 69.29 127.73 106.69 126.51 125.88 114.67 Average speedkbps 23.98 21.60 7.93 19.24 24.14 23.10 42.58 35.56 42.17 41.96 38.22 Averag e timelag ms 839 816 571 839 862 634 590 650 955 760 612 581 697 107 5 608 757 753 779 672 589 73 3 65 1 73 7 81 1 566 716 711 918 690 765 692 729 894 811 561 812 707 875 709 761 609 688 840 825 655 709 691 873 775 timeslot
3 4
Test serial 1 2 3 4 5 6 7 8 9 10 11
Test state
FTP type
Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Ping Ping interval package size byt e 0 5 2 2 5 32 32 100 500 500
Download Download Download Download Download Download Download Download Download Download Download
Ping success rate 100% 100% 100% 100% 100%
Secret
2 2 2 800 1000 1200 959 115 7 107 8 8 840 910 115 869 880 897 86 9 90 7 95 7 7 8 101 9 845 102 8 95 1 82 3 91 4 119 0 781 105 883 881 102 8 860 108 2 101 2 7 104 846 103 865 1010 1002 100% 100% 100%
Comments on case:
1. When C/I is in good condition, the EDGE download speed of current equipment can reach above 40kbps.
2. The Ping success rate and Ping timelag can vary very much due to different Ping intervals different Ping package sizes and different Ping servers.
7.2 Jishou (Hunan) China Mobile EDGE Test Result

Test Specification
Test equipmentANT Pilot for E-GPRS
10
Test phone SEGAM OT490(one set) Test laptop: memory 1024M harddisk 80G CPU
1.60Ghz Windows XP-SP2 standard 28800bps modem rate at 115200bps modem error control and compression forbidden no software irrelevant to the test.
15
Test method outdoor static FTP download test Test location 11 sites at Baoqing market in Fenghuang county Test time 19th30th, June 2008 Test aim to test E-FPRS network performance under static state Test aimto download 1000KB document
20
Timeslot 4 static timeslots
Test Result
Branc Test sites Test Test Download Test location RLC RLC
Secret
h office Fenghuang County Jishou prefectural government office building Cell 1 Fenghuang County Jishou prefectural government office building Cell 2 Fenghuang County Jishou prefectural government office building Cell 3 Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou Old district Cell 1 Old district Cell 2 Old district Cell 3 Rainbow Bridge Cell 1 Rainbow Bridge Cell 2 TianXia Feng Huang Cell 1 TianXia Feng Huang Cell 2 BaoQing market Cell 1 BaoQing market Cell 2 BaoQing market Cell 3 Xinhua Bookstore Cell 1 Xinhua Bookstore Cell 2 Xinhua Bookstore Cell 3 Comprehensive Building Cell 1 Comprehensive Building Cell 2 Comprehensive Building Cell 2 Comprehensive Building Cell 1800M1 Comprehensive Building Cell 1800M2 Telecom Bureau Cell 1 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 -49 -32 -56 -43 -43 -34 -59 -38 -36 -46 -50 -53 -45 -37 -45 -60 -50 -62 -51 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 Basketball field of Jiandaoping Primary School Basketball field of Jiandaoping Primary School Kindergarten next to Jiandaoping Primary School Opposite Wanmingta River Opposite Wanmingta River Square in front of TianXiaFengHuang Hotel Square in front of TianXiaFengHuang Hotel Gate of Linlinlou Drug Store Gate of Linlinlou Drug Store Gate of Linlinlou Drug Store Lobby of Xinhua Hotel Lobby of Xinhua Hotel Parking lot of Xinhua Hotel Lane, west to ChinaMobile business hall Gate of XingGuang Hotel Gate of XingGuang Hotel Gate of XingGuang Hotel Gate of XingGuang Hotel Business Hall of Telecom Bureau 197.74 207.29 198.83 185.72 191.37 197.46 197.09 207.85 162.16 180.51 195.81 198.02 183.08 178.96 185.46 184.07 193.98 176.22 180.75 1000 -51 2 Opposite MingDu Hotel 197.09 1000 -40 2 Lobby of MingDu Hotel 192.6 1000 -44 2 Gate of Prefectural government office 201.19 181.3 documen t size KB electrical level dB m times average rate Kbp s average s
rate Kb
198.98
206.26
201.79
193.91
196.38 191.1
181.36
186.55
206.26
198.02
185.34 191.5
180.09
188.38
190.16
157.44
187.98
184.45
184.51
185.21
197.88
Secret
Jishou Jishou Jishou Jishou Jishou Telecom Bureau Cell 2 Telecom Bureau Cell 3 Telecom Bureau Cell 1800M1 Telecom Bureau Cell 1800M2 Telecom Bureau Cell 1800M3 1000 1000 1000 1000 1000 -64 -57 -59 -73 -84 2 2 2 2 2 Business Hall of Telecom Bureau Backdoor of Supermarket (next to Telecom Bureau) Gate of furniture store (next to Telecom Bureau) Business Hall of Telecom Bureau Business Hall of Telecom Bureau 171.85 182.7 105.44 181.85 159.20
199.19
179.49
106.48
185.85
166.92
Comments on case:
1. When C/I is in good condition, the average EDGE download speed can reach above 180kbps with a peak value of above 200kbps; 2. This test is the CQT. Cell reselection and RAC renewal can be neglected, that is
they are not necessary to the test conditions.
7.3
Serial 1
Acceptance requirements for EDGE KPI of Data Service of a network

Indicators GPRS/EGPRS attach success rate Explanation GPRS/EGPRS Attach success means that the mobile phone receives the Attach Accept signaling 15 seconds after it sends the Attach Request. Formula GPRS/EGPRS success attach times/attach success rate GPRS Attach attempt times100 Average attach time sum of attach success duration /attach success times <3s Target >95%
Average attach time
Attach
time
means
the
duration from the mobile sends out Attach Request until it receives GPRS attach accept signaling.
PDP activation success rate
PDP activation success means that the mobile phone receives the Activate PDP context Accept signaling 15 seconds after it sends the Activate PDP Context Request.
PDP
activation
success
>95%
rate PDP activation success times/attempt times100
PDP average activation time
PDP average activation time means the duration from the delivery of Activate PDP Context receipt Context Request of Accept to by the PDP the Activate
PDP average activation time sum success of PDP activation duration/PDP
<3s
activation success times
mobile phone. 5 WAP website log-in success rate WAP website log-in success means that the homepage fully and correctly displays within 60seconds after the WAP log-in website website success log-in log-in times/ attempt >95% success rate WAP website
Secret
mobile phone started the WAP website log-in request. 6 average WAP homepage displaying time WAP homepage displaying time refers to the duration from the WAP website log-in request is sent out until the homepage 7 WAP webpage refresh success rate 8 Ping success rate 9 Ping average timelag 10 FTP download speed 11 FTP speed upload WAP success fully and refresh that the correctly displays. webpage means average successful homepage success times WAP refresh webpage webpage success refresh refresh times / >95% success rate WAP webpage attempt >95% WAP homepage homepage displaying <10s displaying time sum of displaying duration / WAP times100
selected webpage can be refreshed within 60seconds.
times100 Ping success rate ping success times/ping attempt times100 Ping average timelag sum of each Ping success >80kbp s duration/ping success times FTP download speed actual download download time(sec)9 FTP upload speed actual upload upload time(sec) 9 data quantity Byte /actual >20kbp s data quantity Byte /actual <2s
Comments on case:
1. Requirements of operation and maintenance KPI are not as strict as those of acceptance check KPI. 2. Usually these KPI requirements can be satisfied.
57.4 Operation & Maintenance KPI of a Network

SN 1 Indicator SDCCH Ratio Drop Unit % Target Level 1 Permissible Level 1.2 Base on system performance report of OMCR, Indication Definition: SDCCH Drop Ratio=SDCCH call drops/ Access attempt Number 2 TCH Ratio Drop % 2 2.2 Base on system performance report of OMCR, Indication Definition: TCH Drop Remark
Secret
Ratio = TCH call drops/ Seized TCHs (include handover ) 3 Call Ratio 4 SDCCH Blocking Ratio % 0.5 0.75 Success % 98 97 Base on system performance report of OMCR, Indication Definition: Call Success Rate = 1TCH assignment failure rate Base on system performance report of OMCR, Indication Definition: SDCCH Blocking 5 TCH Blocking Ratio % 2 2.5 Ratio=SDCCH overflows/ SDCCH call attempts Base on system performance report of OMCR, Indication Definition: TCH Blocking Ratio=TCH overflows (include handover)/ TCH call attempts (include handover) 6 TCH Assignment Success Ratio % 98 97 Base on system performance report of OMCR, Indication Definition: TCH assignment Success Ratio=Number of TCH assignment successful / Number of TCH call attempts (include handover) 7 GPRS DL 8 per TBF EDGE average DL 9 throughout s % Rate % % 94 < 98% Setup Rate Drop (Drive MOS (Drive >= 95% samples 15 Coverage (Drive Test) dBm >= -85 for 95% of 3 for of >= 90% samples >= -85 for 90% of Depend on the DT route and method 3 for of Depend on the DT route and method % 2 3 Depend on the DT route and method % 97 2 of for all 93 < 90% 90 2 of for all Depend on the DT route and method Based on OMC-R statistics 99 97 24-Hour measurement per TBF Attach Success 10 11 (GPRS/ EDGE) Handover Success Ratio Call Blocking Ratio 12 Call Success 13 Call Rate Test) 14 Speech Quality Test) Kbp 45 40 24-Hour measurement average s Kbp 28 25 24-Hour measurement throughout
GSM cells
GSM cells
(Drive Test)
measurement
measurement
Secret
measurement samples 16 17 18 UL Throughput DL Throughput BSC/RNC down 19 time % (unscheduled) TRX/channel element failure (unscheduled) 20 SDCCH Mean Time 21 22 Radio Access Success Ratio Worst GOS Cells Less than Less than per BSC/RNC / BH of a week 1.5% cells of Network with GOS 5% or above 23 24 RXQUAL 0 to 3 AMR FER voice % % >97 <1 1.5% cells of Network with GOS 5% or above >95 <1 per BSC/RNC / BH of a week per BSC/RNC / BH of a week % >99.5 >99 per BSC/RNC / BH of a week Holding s <2 <3 per BSC/RNC / BH of a week < 1 of all active TRX < 2 of all active TRX per BSC/RNC / week % >99.999 (< 6 sec) >99.999 (< 6 sec) per BSC/RNC / week Kbps >30 >30 Based on DT Kbps >10 measurement samples >10 Based on DT
Comments on case:
1. This KPI comprises statistical KPI testing KPI and equipment performance KPI, which features detailed classification and all-round evaluation; 2. Requirements for KPIs like GPRS average DL throughout per TBF and EDGE average
DL throughout per TBF are higher. 3. Requirements for evaluation of CS voice quality are higher.
7.5 Operation & Maintenance KPI of a network in Southeast Asia

No. KPI % of outdoor area with 2G signal level > -104 dBm Measuremen t pre-defined Drive test route Level 0 Level 1 Level 2 Scope and interval
>90%
>97%
>99%
per city / monthly
Secret
2 Call Setup Success Rate (exclude blocking) pre-defined locations and Drive test route/NMS 95% >98% >99% per city / BH of a week (drive test monthly) per city / BH of week. With condition that Core Network is achived the same value of Level 1 and Level 2 per city / BH of a week (drive test monthly) per city / BH of a week (drive test monthly) per city / BH of a week (drive test monthly),per city / BH of week. With condition that Core Network is achived the same value of Level 1 and Level 2 Average value per city / BH of a week
Paging Success Rate
NMS
>90%
>95%
>97%
Call blocking rate Drop Call Rate (excluding inter RAT)
pre-defined locations and Drive test route/NMS Pre Defined Drive Test Route/NMS
<0.5%
<0.5%
<1%
GSM: <3%
GSM: <2%
GSM: <1%
Handover Success Rate
Pre Defined Drive Test Route or NMS
>90%
>97%
>97%
SQI (TEMS) Call setup delay (PSTN to MS, time from number dialed to ring) Call setup delay (MS to PSTN, time from send pressed to ring) Call Setup Successful Rate SDCCH Access Success
Pre Defined Drive Test Route
>20(95%)
> 25(95%)
> 25(95%)
10
<6s
< 6s
<6s
per Media Gateway/ monthly
11
<5s
< 5s
<5s
per Media Gateway/ monthly
12
NMS
>95%
>98%
>99%
per BSC/RNC / BH of a week per BSC/RNC / BH of a week
13
NMS
>99%
>99%
>99.5%
Secret
15 SDCCH Blocking Rate TCH Blocking Rate Drop Call Rate Pre Defined Drive Test Route/NMS Pre Defined Drive Test Route/NMS Pre Defined Drive Test Route/NMS <0.5% <0.5% <1% per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) With condition that Core Network is achived the same value of Level 1 and Level 2 per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) per city / BH of a week per city / BH of a week
16
<0.5%
<0.5%
<1%
18
<5%
<2%
<1.5%
19
Handover Success Rate
Pre Defined Drive Test Route/NMS
Inter BSS: >92% : Inter Cell: >92%
20
RXQUAL 0 to 3
Pre Defined Drive Test Route/NMS Pre Defined Drive Test Route/NMS
>80%
>85%
>90%
21
AMR voice FER Successful PS Attachmen t Successful PDP context activation Data session Setup Success Rate (PDP context already exist) Moving MS FTP download 1MB file
<1%
<1%
< 1%;
23
NMS
>98%
>98%
>98%
24
NMS
>98%
>98%
>98%
25
Pre Defined Drive Test Route/NMS
>95%
>98%
>98%
per city / BH of a week
26
Pre Defined Drive test route
GPRS>30kbps
GPRS (Class 4 MS): >30Kb
GPRS (Class 4 MS):> 30Kbps
per city / BH of a month
Secret
Moving MS FTP upload 1MB file Stationary MS near site, FTP download 1MB file Stationary GPRS MS in cell border, FTP download 1MB file Stationary UMTS MS in cell border (SHO), FTP download 1MB file PDTCH blocking rate 60 second data transfer drop Rate (MS moving) Routing Area Update Successful rate MS initiated service setup time MS roundtrip Ping time (20 ping averaged) PDP update success rate Pre Defined Drive test route GPRS (Class 4 MS): > 9Kbps; GPRS (Class 4 MS): > 9Kbps; per city / BH of a month
27
GPRS>8kbps
28
Pre-defined locations
GPRS (Class 4 MS): > 40 Kbps
29
GPRS (Class 4 MS): > 20 Kbps;
GPRS (Class 4 MS): > 20 Kbps;
30
N/A
> 150 Kbps
> 150 Kbps
31
NMS
<0.5%
<0.5%
<1%;
per BSC / BH of a week
32
<3%
<2%
<1.5%
33
NMS
> 95%
> 95%
>97%
per city / BH of week
34
Pre Defined Drive Test Route Pre Defined Drive Test Route
<5s
<5s
<5s
35
<1
<1
<0.8s
36
NMS
>98%
>98%
>99%
Comments on case:
Secret
1. This OM KPI just got some of the indicators, excluding the weighing of all KPIs and 2/3G interoperate KPI, etc.. Due to market factors, the OM KPI of this network is set unreasonable, and there is risk in some of the KPIs. 2. The evaluation of this KPI falls into three grades. The requirements for
handover success rate and paging success rate are very high, which are difficult to reach. But the attached prerequisites can lower the risk to some extent. Besides, the definition of handover success rate varies with different manufacturers, which we need to make clear with customers in technical clarification.
10
3. The requirements for data service and voice KPI are higher.
7.6 KPI requirements for Indonesia Telkomsel network
KPI requi rem ent s f or I ndi nesi a Tel kom sel . xl s
Comments on case
1. The evaluation scale of KPI is relatively large, mainly dealing with statistical KPI and testing KPI; 2. It ranges from 2G to 3G network. Its service includes voiceGPRS and 3G data service, etc.. 3. The division of KPI evaluation scenes and most KPI values are relatively reasonable.
15

GSM Key Performance Indicator KPI Guidebook V1.1

Caricato da

Informazioni sul documento

Titolo originale

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

GSM Key Performance Indicator KPI Guidebook V1.1

Caricato da

Copyright:

Formati disponibili

5

GSM Key Performance IndicatorKPIGuidebook

Security Category: Secret Serviceable range: Radio Planning Section

15 GSM Network Planning & Optimization Dept. of Engineering Service Division

Work Guidebook for GSM P&O Dept.

SDCCH availability/SDCCH .............................................................................................4

2.1.2 TCH availability/TCH ........................................................................................................4 2.1.3 Cell utilization.....................................................................................................................4

2.3 Mobility ..........................................................................................................................................9 2.3.1 Handover success rate ........................................................................................................9

54 PS Radio Service Statistical KPI.......................................................................................................18

4.1.4 4.1.5 4.1.6

5 PS Radio Service Test KPI..................................................................................................................22 5.1 Accessibility..................................................................................................................................22

5.3 Data Throughput ...........................................................................................................................24 5.3.1 Average FTP download rate...............................................................................................24

6 Introduction to CN Statistical KPI....................................................................................................27

Notes: V6.0 (ISMG), V6.1 (Minos), sic passim

2 CS Radio Service Statistical KPI

2.1.2 TCH availability/TCH

52.1.3 Cell utilization

2.2.2 SDCCH blocking rate

2.2.3 TCH blocking rate

2.2.4 Radio connection ratio

2.2.5 SDCCH drop rate

2.2.6 SDCCH assignment success rate

SDCCH assignment success rate*100/(SDCCH assignment success times +SDCCH assignment

2.2.7 TCH assignment success rate

problemsassignment methodsapplication of data service, etc..

2.2.8 Call setup success rate

Suggested value Risk value

+C100030101+C100030216 +C100030119 +C100030093

TCH call drop times*100%/TCH assignment success times

2.4.2 Traffic Call Drop

Traffic /TCH call drop times*60

2.4.3 Call Completion rate

2.4.4 UL RxQual 0-4

C100030069+ C100030070+ C100030071+ C100030072+ C100030073)

C900060069+ C900060070+ C900060071+ C900060072+ C900060073)

2.4.5 DL RxQual 0-4

2.5 Call Setup time

2.5.2 Call setup time (GSM to GSM)

3 CS Radio Service Test KPI

3.2 Handover Success Rate

3.3 Call Drop Rate

53.4 Coverage (Drive Test)

should have a value

should have a value

should have a value

should have a value

TFO No frequency hopping

frequency Frequency hopping

3.4.3 MOS & PSEQ

Fig 1 MOS/PESQ Correlation Diagram

Form 1 Definition of MOS Values

4 PS Radio Service Statistical KPI

4.1.2 UL TBF establishment success rate

4.1.3 GPRS RLC

4.1.4 GPRS RLC

4.1.5 EGPRS RLC

Refer to UL GPRS RLC retransmission rate

4.1.6 EGPRS RLC

Refer to DL GPRS RLC retransmission rate

5 PS Radio Service Test KPI

5.1.2 Average GPRS attach time

55.1.3 PDP context activation success rate

5.1.4 PDP context activation time