Ifaces - Broker Service Rating Call: Pip Phase-2 (Trials) : Day-1 6 Months 12 Months

Classification: Internal #
IFaces - Broker Service Rating Call: PIP Phase-2

[Trials]
Day-1 6 Months 12 Months
Test 4 Test 1 Test 2

07/07/2017 07/07/2017 10/07/2017
(08:35:19 - 09:36:07) (12:44:30 - 13:45:21) (08:31:24 - 09:32:17)
Average Response Time
10 u 10 u 10 u
No of Txns % No of Txns % No of Txns

Total Passed Txns 15,532 10,200 6,397
10 u 10 u 10 u
Error rate
No of Txns % No of Txns % No of Txns
Failed Txns 0 0.00 0 0.00 0
Total Txns executed 15,532 10,200 6,397
10 u 10 u 10 u
CPU utilisation
Avg Max Avg Max Avg
BBPPTEIDPAPP4B1 2.0 3.7 1.5 3.2 2.0
BBPPTEIDPAPP4B2
BNFUUATLORGEN1 / 2.0 3.7 1.6 2.9 1.5
BNFUPRDCMSAPP4 1.0 5.2 2.0 5.4 2.0
(Loadgen)
Rating Call: PIP Phase-2

als]
6 Months
Day-1
12 Months +
Incremental Load
Large Policies

10/07/2017 10/07/2017 11/07/2017
(08:31:24 - 09:32:17) (11:32:18 - 13:34:15) (16:46:00 - 17:47:50)
10 u 100 u 12 u
% No of Txns % No of Txns %
6,397 157,017 Total Passed Txns 10,312
10 u 100 u 12 u
Error rate
0.00 0 0.00 Failed Txns 0 0.00
6,397 157,017 Total Txns executed 10,312
10 u 100 u 12 u
CPU utilisation
Max Avg Max Avg Max
52.8 8.7 16.0 BBPPTEIDPAPP4B1 2.0 4.5
6.1 8.8 16.9 BBPPTEIDPAPP4B2 2.0 4.9
BNFUPRDCMSAPP4
27.2 4.0 7.7 2.0 7.5
(Loadgen)

[New Model ID]
12 Months
Day-1
+ Day-1 6 Months 12 Months
Incremental Load
Large Policies
Test 2 Test 3 Test 4 Test 5 Test 6

12/07/2017 12/07/2017 12/07/2017 13/07/2017 13/07/2017
(09:22:00 - 10:23:39) (11:05:14 - 12:06:06) (13:45:42 - 14:46:31) (09:40:00 - 10:40:54) (11:45:19 - 13:47:15)
12 u 10 u 10 u 12 u 100 u
No of Txns % No of Txns % No of Txns % No of Txns % No of Txns

5,787 15,586 10,196 5,664 157,070
12 u 10 u 10 u 12 u 100 u

0 0.00 0 0.00 0 0.00 0 0.00 0
5,787 15,586 10,196 5,664 157,070
12 u 10 u 10 u 12 u 100 u
Avg Max Avg Max Avg Max Avg Max Avg

1.8 4.8 2.3 4.4 1.8 3.7 1.6 4.2 10.2
1.8 3.7 2.3 3.9 1.8 3.5 1.6 2.9 10.3
1.8 8.1 2.0 6.5 1.9 4.0 1.8 4.3 4.1
2 IFaces PIP R 1709 -
Day-1 Day-1 Day-1

Day-1 Incremental Load + Incremental Load +
+
Incremental Load Large Policies Large Policies
Large Policies
Test 6 Test 7 Test 8 Test 1

13/07/2017 13/07/2017 14/07/2017 08/08/2017
(11:45:19 - 13:47:15) (14:40:48 - 16:51:03) (08:36:00 - 09:36:59) (16:41:08 - 18:51:22)
100 u 102 u 12 u 102 u
% No of Txns % No of Txns % No of Txns

157,070 208,391 20,905 Total Passed Txns 195,334
100 u 102 u 12 u 102 u

Error rate
0.00 2 0.00 0 0.00 Failed Txns 0
157,070 208,393 20,905 Total Txns executed 195,334
100 u 102 u 12 u 102 u

CPU utilisation
Max Avg Max Avg Max Avg
18.9 12.0 22.3 12.1 17.5 BBPPTEIDPAPP4B1 10.8
19.3 12.3 49.9 12.3 16.1 BBPPTEIDPAPP4B2 10.9
BNFUPRDCMSAPP4
7.8 4.9 30.0 3.8 5.7 4.7
(Loadgen)
IFaces PIP R 1709 - Broker Service Rating Call: PIP Phase-2

[New Model ID]
Day-1 Day-1 + Large Policies ONLY +

Incremental Load + Large Policies Incremental Load
Large Policies [No TT & Pacing] [No TT & Pacing]

08/08/2017 10/08/2017 11/08/2017
(16:41:08 - 18:51:22) (14:55:00 - 15:56:01) (12:10:00 - 14:13:30)
102 u 12 u 100 u
195,334 248,080 29,287 Total Passed Txns
102 u 12 u 100 u
Error rate
0.00 0 0.00 44 0.15 Failed Txns
195,334 248,080 29,331 Total Txns executed
102 u 12 u 100 u
CPU utilisation
Max Avg Max Avg Max
20.2 30.6 39.0 49.3 86.6 BBPPTEIDPAPP4B1
20.3 30.9 66.1 47.1 75.1 BBPPTEIDPAPP4B2
8.8 14.2 17.3 22.5 45.6 BNFUPRDCMSAPP4 (Loadgen)
[CCO-MCV-PHL]
[CCO-MCV-PHL] [CCO-MCV-PHL] Average
[MCV-PHL] Average + [MCV-PHL] Average +
Average Average + Large Policies
Large Policies Large Policies
+ Large Policies + Large Policies Incremental Load
Pacing | TT 5

04/10/2017 04/10/2017 04/10/2017 05/10/2017 05/10/2017
(11:55:00 - 12:55:54) (13:50:00 - 14:50:55) (16:56:00 - 17:57:24) (08:37:00 - 09:38:23) (11:15:00 - 13:15:37)
22 u 22 u 33 u 33 u 108 u

12,684 12,666 19,666 19,673 84,057
22 u 22 u 33 u 33 u 108 u

0 0.00 0 0.00 0 0.00 0 0.00 0
12,684 12,666 19,666 19,673 84,057
22 u 22 u 33 u 33 u 108 u

5.9 8.6 6.2 10.6 7.6 10.9 7.8 10.8 18.8
5.5 8.6 5.7 8.7 7.3 11.4 7.2 9.9 17.8
2.7 6.3 2.7 6.2 3.3 11.1 3.4 8.5 5.3
IFaces PIP R 1711 - Broker Service Rating Call: PIP Phase-2

[CCO-MCV-PHL]
[CCO-MCV-PHL] [CCO-MCV-PHL]
Average Average [CCO-MCV-PHL] [CCO (LB) -MCV-PHL] [CCO (LB) -MCV-PHL]
+ Large Policies + Large Policies Very Large Policies Average Large Policies
Incremental Load Incremental Load No Pacing | TT 3-5 + Large Policies No Pacing | TT 3-5
Pacing | TT 5 No Pacing | TT 2.5

05/10/2017 09/10/2017 10/10/2017 13/10/2017 20/10/2017
(11:15:00 - 13:15:37) (14:48:00 - 16:48:27) (16:00:00 - 17:00:59) (13:31:00 - 14:32:24) (11:28:40 - 12:29:38)
108 u 108 u 24 u 33 u 24 u
% No of Txns % No of Txns % No of Txns % No of Txns %

84,057 417,505 12,617 19,451 17,587
108 u 108 u 24 u 33 u 24 u
% No of Txns % No of Txns % No of Txns % No of Txns %

0.00 285 0.07 0 0.00 0 0.00 0 0.00
84,057 417,790 12,617 19,451 17,587
108 u 108 u 24 u 33 u 24 u
Max Avg Max Avg Max Avg Max Avg Max

58.4 45.5 75.3 26.9 31.9 4.8 6.9 31.4 41.2
46.7 39.0 71.2 25.3 30.3 5.1 48.7 29.1 44.0
8.9 14.4 39.1 15.5 19.2 7.7 10.8 8.4 33.8
Call: PIP Phase-2
[CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL]

[CCO (LB )-MCV-PHL] V
[CCO (LB )-MCV-PHL] Average Average
Large Policies [CCO (LB )-MCV-PHL]
Average + + Large Policies + Large Policies
Incremental Load Very Large Policies
Large Policies Incremental Load Incremental Load
No Pacing | TT 3-5
Pacing | TT 5 No Pacing | TT 2.5

20/10/2017 24/10/2017 02/11/2017 07/11/2017 08/11/2017
(13:25:00 - 14:26:09) (09:30:00 - 11:51:47) (13:12:00 - 14:12:55) (13:32:00 - 15:32:31) (14:15:01 - 16:15:27)
27 u 96 u 24 u 108 u 108 u

16,929 13,628 10,203 82,225 213,549
27 u 96 u 24 u 108 u 108 u

0 0.00 69092 83.53 103 1.00 0 0.00 524803
16,929 82,720 10,306 82,225 738,352
27 u 96 u 24 u 108 u 108 u

8.0 11.3 63.4 96.6 33.3 45.5 18.5 33.9 56.1
7.6 10.7 59.9 97.0 32.1 46.5 17.2 31.7 45.7
3.5 29.1 21.1 59.6 12.3 16.3 4.7 8.9 38.7
[CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL]

[CCO (LB )-MCV-PHL]
Average Average
Large Policies Only
+ Large Policies + Large Policies
Incremental Load
Incremental Load Incremental Load
No Pacing | TT 3-5
No Pacing | TT 2.5 No Pacing | TT 2.5

08/11/2017 08/11/2017 27/11/2017
(14:15:01 - 16:15:27) (09:16:00 - 11:16:22) (14:51:00 - 16:51:29)
108 u 96 u 108 u
213,549 26,106 292,314 Total Passed Txns
108 u 96 u 108 u
Error rate
71.08 261228 90.91 204596 41.17 Failed Txns
738,352 287,334 496,910 Total Txns executed
108 u 96 u 108 u
CPU utilisation
Max Avg Max Avg Max
99.7 75.8 100.0 51.6 98.1 BBPPTEIDPAPP4B1
87.7 70.7 100.0 42.2 80.8 BBPPTEIDPAPP4B2
92.9 38.2 79.2 29.8 96.2 BNFUPRDCMSAPP4 (Loadgen)
IFaces PIP R 1711 - Broker Service Rating Call IFaces PIP R 180
[CCO (LB)-MCV-PHL] [CC
[CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL]
Average Avg + Large Policies Average Avg + Large Policies
+ Large Policies Re Baseline Due to load + Large Policies CCO New
Re Baseline Test change CCO New IFC XML IFC_FRED_ModelID
Pacing | TT 5 Pacing | TT 5 Pacing | TT 5 Pacing | TT 5
Test 1 Test 1 Rerun Test 2 Test 3

12/02/2018 13/02/2018 13/02/2018 14/02/2018
(14:50:00 - 15:51:10) (11:35:00 - 12:36:16) (10:05:00 - 11:06:19) (13:52:00 - 14:53:11)
27 u 28 u 28 u 28 u
No of Txns % No of Txns % No of Txns % No of Txns %

16,840 17,769 17,709 16,350
27 u 28 u 28 u 28 u
No of Txns % No of Txns % No of Txns % No of Txns %

0 0.00 0 0.00 0 0.00 0 0.00
16,840 17,769 17,709 16,350
27 u 28 u 28 u 28 u
Avg Max Avg Max Avg Max Avg Max

9.2 19.6 10.4 15.7 10.7 21.6 17.3 24.6
10.0 18.5 11.6 17.4 12.1 16.5 18.6 29.4
2.0 29.3 3.1 46.8 1.9 6.8 1.8 7.7
IFaces PIP R 1803 - Broker Service Rating Call IF PIP R 1803.1 Post Changes_CC te
[CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PH
Avg + Large Policies Avg + Large Policies Avg + Large Policies Avg + Large Policies
CCO New CCO New CCO New CCO New IFC_PIP_All New
PIP_FRED_ModelID IFC_PIP_FRED_ModelID IFC_PIP_FRED_ModelID Model ID's
Test4 Test 5 Test 6 Test 1

14/02/2018 15/02/2018 15/02/2018 27/04/2018
(16:00:00 - 17:01:17) (06:26:00 - 07:27:16) (10:17:00 - 12:17:34) (16:27:00 - 17:28:16)
28 u 28 u Incremental Load - 112 u 28 u
No of Txns % No of Txns % No of Txns % No of Txns

16,221 16,049 70,934 15,957

0 0.00 0 0.00 0 0.00 0
16,221 16,049 70,934 15,957
Avg Max Avg Max Avg Max Avg

17.4 32.7 18.0 60.7 33.9 64.4 6.8
19.3 28.4 18.8 38.0 41.4 79.4 9.7
1.7 9.7 1.8 8.7 3.1 12.8 1.8
PIP R 1803.1 Post Changes_CC team - BS Rating Call IF PIP R 1803.1 Radar Config Change - BS Rating Call
[CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PHL]
CO New IFC_PIP_All New CCO New IFC_PIP_All New CCO New IFC_PIP_All CCO New IFC_PIP_All Existing
Model ID's Model ID's Existing Model ID's Model ID's
Test 1 Test 2 Test 1 Test 2

27/04/2018 30/04/2018 10/05/2018 10/05/2018
(16:27:00 - 17:28:16) (14:15:15 - 16:16:25) (14:01:00 - 15:02:32) (15:30:00 - 17:30:40)
28 u Incremental Load - 112 u 28 u Incremental Load - 112 u
% No of Txns % No of Txns % No of Txns %

15,957 73,077 15,711 71,180
% No of Txns % No of Txns % No of Txns %

0.00 0 0.00 0 0.00 0 0.00
15,957 73,077 15,711 71,180
Max Avg Max Avg Max Avg Max

54.9 38.6 69.2 25.3 53.3 34.5 67.9
67.9 38.8 65.0 25.6 52.0 38.3 69.4
8.2 3.2 25.1 2.6 11.1 3.3 28.4

Avg + Large Policies Avg + Large Policies
CCO PIP_All Existing Model CCO PIP_All Existing Model
ID's ID's
Pacing | TT 5 Pacing | TT 5
Test 1 Test 2
19/12/2018 20/12/2018
(14:45:00 - 15:46:30) (09:30:00 - 10:31:30)
28 u 28 u
No of Txns % No of Txns %
Total Passed Txns 16,994 16,982
28 u 28 u
Error rate
No of Txns % No of Txns %
Failed Txns 0 0.00 0 0.00
Total Txns executed 16,994 16,982
28 u 28 u
CPU utilisation
Avg Max Avg Max
TV163NFUA011 25.3 53.3 26.3 47.6
TV163NFUA013 25.6 52.0 26.3 50.9
tv254nfua002
tv254nfua004
BNFUPRDCMSAPP4 (Loadgen) 2.6 11.1 2.7 25.4
IFaces PRPM Release 1812 Broker Service Rating call with New infrastructure of Broker Server
[CCO (LB)-MCV-PHL]
[CCO (LB)-MCV-PHL]
[CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PHL]
Avg + Large Policies
Avg + Large Policies Avg + Large Policies Avg + Large Policies
CCO PIP_All Existing Model
CCO PIP_All Existing Model ID's CCO PIP_All Existing Model ID's CCO PIP_All Existing Model ID'
ID's
Pacing | TT 5 Pacing | TT 5 Pacing | TT 5
Pacing | TT 5
Test 3 Test 4 Test 5 - Invalid Test Test 5 Re-Run

20/12/2018 20/12/2018 21/12/2018 24/12/2018
(12:30:00 - 13:31:30) (14:45:00 - 16:46:02) (10:00:00 - 12:01:06) (09:45:00 - 11:46:13)
28 u Incremental Load - 112 u Incremental Load - 112 u Incremental Load - 112 u

16,955 70,597 54,660 62,597

0 0.00 152 0.21 31113 36.27 1909
16,955 70,749 85,773 64,506
Avg Max Avg Max Avg Max Avg

26.8 56.2 52.8 95.7 56.3 99.1 52.6
26.0 59.1 54.5 100.0 67.2 100.0 63.0
50.0
66.9
2.6 11.7 3.6 13.4 5.1 34.1 3.3
ructure of Broker Servers and Configuration changes in Radar Servers

-MCV-PHL]
[CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PHL]

O PIP_All Existing Model ID's CCO PIP_All Existing Model ID's CCO PIP_All Existing Model ID's CCO PIP_All Existing Model ID's
Test 5 Re-Run Test 6 Test 7 Test 8

24/12/2018 24/12/2018 27/12/2018 28/12/2018
(09:45:00 - 11:46:13) (13:50:00 - 15:50:44) (13:00:00 - 15:00:49) (09:30:00 - 10:30:12)
ncremental Load - 112 u Incremental Load - 112 u Incremental Load - 112 u 28 u

62,597 64,492 69,166 16,306
Incremental Load - 112 u Incremental Load - 112 u Incremental Load - 112 u 28 u

2.96 1924 2.90 5 0.01 0
64,506 66,416 69,171 16,306
Incremental Load - 112 u Incremental Load - 112 u Incremental Load - 112 u 28 u
Max Avg Max Avg Max Avg

93.5 53.6 93.0 53.6 93.0 22.2
100.0 63.9 100.0 63.9 100.0 34.3
83.9 65.2 99.7 62.6 97.7 45.5
99.1 46.0 82.2 47.5 80.3 25.8
24.5 3.3 12.1 3.5 12.9 2.6

Avg + Large Policies Avg + Large Policies
O PIP_All Existing Model ID's CCO PIP_All Existing Model ID's
Pacing | TT 5 Pacing | TT 5
Test 8 Test 9
28/12/2018 28/12/2018
(09:30:00 - 10:30:12) (11:15:00 - 13:15:52)
28 u Incremental Load - 112 u
% No of Txns %
16,306 65,512
% No of Txns %
0.00 13092 16.66
16,306 78,604
Max Avg Max

47.3 49.9 91.6
68.8 73.7 100.0
75.4 58.8 99.5
57.5 47.4 84.3
23.7 4.0 29.1
Test4
Test Details
Day-1
10 Users
07/07/2017 (08:35:19 - 09:36:07)
Total Throughput (bytes): 241,034,157

Average Throughput (bytes/second): 66,055
Total Hits: 15,532
Average Hits per Second: 4.257
Total Passed: 15,532
Total Failed: -
Response Time
(In Seconds)
Transactions
Std. 90th
Min Avg Max
Dev % le
01_Get_Price_CoverLevel_MCV_MC0_MQ 0.0 0.1 3.2 0.1 0.1
02_Get_Price_CoverLevel_PHL_P01_MQ 0.1 0.1 3.1 0.1 0.1
02_Get_Price_CoverLevel_PHL_P03_MQ 0.0 0.1 2.3 0.1 0.1
03_MCV_PolicyLevel_Average_DQ 0.1 0.4 3.4 0.2 0.5
04_MCV_PolicyLevel_Average_MQ 0.1 0.4 3.4 0.2 0.4
05_PHL_PolicyLevel_Average_DQ 0.2 0.4 3.4 0.2 0.5
06_PHL_PolicyLevel_Average_MQ 0.2 0.4 3.0 0.2 0.5
07a_PHL_PolicyLevel_Large_Average_DQ N/A N/A N/A N/A N/A
07b_PHL_PolicyLevel_Large_Average_MQ N/A N/A N/A N/A N/A
08a_MCV_PolicyLevel_Large_Average_DQ N/A N/A N/A N/A N/A
08b_MCV_PolicyLevel_Large_Average_MQ N/A N/A N/A N/A N/A
09_CCO_PolicyLevel_Average_RQ N/A N/A N/A N/A N/A
09_CCO_PolicyLevel_Average_New_IFC_RQ N/A N/A N/A N/A N/A
09_CCO_PolicyLevel_Average_New_PIP_RQ N/A N/A N/A N/A N/A
10_CCO_PolicyLevel_Average_DQ N/A N/A N/A N/A N/A
10_CCO_PolicyLevel_Average_New_IFC_DQ N/A N/A N/A N/A N/A
10_CCO_PolicyLevel_Average_New_PIP_DQ N/A N/A N/A N/A N/A
12a_CCO_PolicyLevel_Large_Average_DQ N/A N/A N/A N/A N/A
12a_CCO_PolicyLevel_Large_New_IFC_DQ N/A N/A N/A N/A N/A
12a_CCO_PolicyLevel_Large_New_PIP_DQ N/A N/A N/A N/A N/A
12b_CCO_PolicyLevel_Large_Average_RQ N/A N/A N/A N/A N/A
12b_CCO_PolicyLevel_Large_New_IFC_RQ N/A N/A N/A N/A N/A
12b_CCO_PolicyLevel_Large_New_PIP_RQ N/A N/A N/A N/A N/A
15a_CCO_PolicyLevel_Large_x2_Average_DQ
15b_CCO_PolicyLevel_Large_x2_Average_RQ
16a_MCV_PolicyLevel_Large_x3_Average_DQ
16b_MCV_PolicyLevel_Large_x3_Average_MQ
17a_PHL_PolicyLevel_Large_x2_Average_DQ
17b_PHL_PolicyLevel_Large_x2_Average_MQ

[Trials]
Test4 Test1 Test2

10 Users 10 Users 10 Users
7 (08:35:19 - 09:36:07) 07/07/2017 (12:44:30 - 13:45:21) 10/07/2017 (08:31:24 - 09:32:17)
241,034,157 194,990,364 200,316,851

66,055 53,393 54,821
15,532 10,200 6,397
4.257 2.793 1.751
15,532 10,200 6,397
- - -
No. of Response Time No. of Response Time
Iterations Error (In Seconds) Iterations Error (In Seconds)
% Std. 90th % Std. 90th
Pass Fail Min Avg Max Pass Fail Min Avg Max
Dev % le Dev % le
4919 0 0 0.0 0.1 3.1 0.1 0.1 2456 0 0 N/A N/A N/A N/A N/A
3065 0 0 0.0 0.1 1.1 0.1 0.1 1560 0 0 N/A N/A N/A N/A N/A
3065 0 0 0.1 0.1 1.1 0.1 0.1 1560 0 0 N/A N/A N/A N/A N/A
801 0 0 0.1 0.3 1.4 0.1 0.4 857 0 0 0.1 0.2 2.0 0.1 0.4
801 0 0 0.1 0.3 1.8 0.1 0.4 857 0 0 0.1 0.2 2.9 0.2 0.4
1441 0 0 0.1 0.4 1.5 0.1 0.6 1455 0 0 0.1 0.3 2.6 0.1 0.4
1440 0 0 0.1 0.4 1.3 0.1 0.5 1455 0 0 0.1 0.3 2.6 0.1 0.4
N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
ase-2
Test2 Test1 Test1
12 Months Day-1 Incremental Load 6 Months + Large Policies

7 (08:31:24 - 09:32:17) 10/07/2017 (11:32:18 - 13:34:15) 11/07/2017 (16:46:00 - 17:47:50)
200,316,851 2,685,944,959 241,032,182

54,821 367,033 64,951
6,397 157,017 10,312
1.751 21.456 2.779
6,397 157,017 10,312
- - -
Dev % le Dev % le
N/A N/A N/A 0.0 0.1 1.7 0.1 0.1 60889 0 0 0.0 0.1 1.9 0.1 0.1
N/A N/A N/A 0.0 0.1 3.3 0.1 0.1 19460 0 0 0.1 0.1 1.1 0.1 0.1
N/A N/A N/A 0.0 0.1 4.1 0.1 0.1 19460 0 0 0.1 0.1 1.5 0.1 0.1
1205 0 0 0.1 0.2 3.5 0.1 0.3 10491 0 0 0.1 0.3 0.9 0.1 0.5
1087 0 0 0.1 0.1 1.1 0.1 0.3 10489 0 0 0.1 0.3 1.3 0.1 0.4
1699 0 0 0.1 0.3 3.4 0.2 0.5 17409 0 0 0.2 0.4 1.1 0.1 0.6
2406 0 0 0.1 0.2 3.6 0.2 0.5 18819 0 0 0.2 0.4 1.6 0.1 0.5
N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 1.2 1.4 1.8 0.1 1.6
Test1 Test2 Test3
hs + Large Policies 12 Months + Large Policies Day-1

7 (16:46:00 - 17:47:50) 12/07/2017 (09:22:00 - 10:23:39) 12/07/2017 (11:05:14 - 12:06:06)
241,032,182 221,842,778 245,579,358

64,951 59,958 67,227
10,312 5,787 15,586
2.779 1.564 4.267
10,312 5,787 15,586
- - -
Dev % le Dev % le
2455 0 0 N/A N/A N/A N/A N/A N/A N/A N/A 0.0 0.1 1.2 0.0 0.1
856 0 0 0.1 0.3 1.2 0.1 0.4 1206 0 0 0.1 0.4 0.7 0.1 0.5
856 0 0 0.1 0.2 1.1 0.1 0.4 1087 0 0 0.1 0.3 0.7 0.1 0.4
1455 0 0 0.2 0.4 1.5 0.2 0.5 1700 0 0 0.2 0.5 1.4 0.1 0.6
1452 0 0 0.2 0.3 2.0 0.1 0.5 1670 0 0 0.2 0.4 1.7 0.1 0.5
62 0 0 1.2 1.5 2.0 0.2 1.7 62 0 0 N/A N/A N/A N/A N/A
62 0 0 0.9 1.2 2.2 0.2 1.4 62 0 0 N/A N/A N/A N/A N/A

[New Model ID]
Test3 Test4 Test5

7 (11:05:14 - 12:06:06) 12/07/2017 (13:45:42 - 14:46:31) 13/07/2017 (09:40:00 - 10:40:54)
245,579,358 199,218,244 179,886,012

67,227 54,580 49,216
15,586 10,196 5,664
4.267 2.793 1.55
15,586 10,196 5,664
- - -
Dev % le Dev % le
4904 0 0 0.0 0.1 1.1 0.1 0.1 2459 0 0 N/A N/A N/A N/A N/A
3102 0 0 0.1 0.1 1.1 0.1 0.1 1557 0 0 N/A N/A N/A N/A N/A
3102 0 0 0.1 0.1 0.7 0.1 0.1 1557 0 0 N/A N/A N/A N/A N/A
801 0 0 0.1 0.4 1.4 0.1 0.5 857 0 0 0.1 0.3 1.2 0.1 0.4
801 0 0 0.1 0.3 1.6 0.1 0.4 857 0 0 0.1 0.2 1.2 0.1 0.3
1438 0 0 0.2 0.4 1.3 0.1 0.6 1455 0 0 0.2 0.4 1.3 0.2 0.6
1438 0 0 0.2 0.4 3.9 0.1 0.5 1454 0 0 0.2 0.3 2.3 0.1 0.5
ase-2
Test5 Test6 Test7
12 Months Day-1 Incremental Load Day-1 Incremental Load + Large Poli

7 (09:40:00 - 10:40:54) 13/07/2017 (11:45:19 - 13:47:15) 13/07/2017 (14:40:48 - 16:51:03)
179,886,012 2,700,640,795 3,332,487,700

49,216 369,091 426,367
5,664 157,070 208,393
1.55 21.466 26.663
5,664 157,070 208,393
- - 2
Dev % le Dev % le
N/A N/A N/A 0.0 0.1 1.6 0.1 0.1 62484 0 0 0.0 0.1 3.2 0.1 0.1
N/A N/A N/A 0.1 0.1 3.3 0.1 0.1 19405 0 0 0.1 0.1 2.7 0.1 0.1
N/A N/A N/A 0.1 0.1 3.5 0.1 0.1 19405 0 0 0.1 0.1 5.1 0.1 0.1
1207 0 0 0.1 0.2 3.0 0.1 0.3 10489 0 0 0.1 0.2 7.6 0.2 0.3
1088 0 0 0.1 0.1 1.3 0.1 0.3 10487 0 0 0.1 0.2 2.6 0.1 0.3
1699 0 0 0.2 0.4 3.3 0.2 0.7 17406 0 0 0.2 0.4 5.2 0.2 0.7
1670 0 0 0.2 0.3 3.3 0.2 0.5 17394 0 0 0.2 0.3 5.3 0.2 0.5
Test7 Test8 Test1
ental Load + Large Policies Day-1 + Large Policies Day-1 Incremental Load + Large Poli
7 (14:40:48 - 16:51:03) 14/07/2017 (08:36:00 - 09:36:59) 08/08/2017 (16:41:08 - 18:51:22)
3,332,487,700 2,090,862,802 3,143,710,368

426,367 571,274 436,626
208,393 20,905 196,456
26.663 5.712 27.286
208,393 20,905 195,334
2 - -
Dev % le Dev % le
65801 0 0 0.0 0.1 3.1 0.1 0.1 4911 0 0 0.0 0.1 2.6 0.1 0.1
41552 0 0 0.1 0.1 3.1 0.1 0.1 3072 0 0 0.1 0.1 3.1 0.1 0.1
41551 1 0 0.1 0.1 2.6 0.1 0.1 3072 0 0 0.1 0.1 3.8 0.1 0.1
10224 0 0 0.1 0.4 3.5 0.2 0.5 800 0 0 0.1 0.2 3.4 0.1 0.4
11015 0 0 0.1 0.3 3.3 0.1 0.4 800 0 0 0.1 0.2 3.2 0.1 0.3
19679 1 0 0.2 0.5 2.0 0.2 0.8 1438 0 0 0.1 0.2 3.3 0.1 0.4
18381 0 0 0.2 0.4 3.6 0.1 0.5 1435 0 0 0.2 0.3 4.1 0.1 0.4
95 0 0 1.1 1.5 2.7 0.2 1.8 2372 0 0 0.9 1.3 2.0 0.2 1.5
95 0 0 0.8 1.2 3.1 0.2 1.4 3005 0 0 1.0 1.2 2.8 0.2 1.5

[New Model ID]
Test1 Test2 Test3
Day-1 + Large Policies Large Policies ONLY + Increment

ental Load + Large Policies
[NO TT & Pacing] [NO TT & Pacing] [MCV x3 PHL
102 Users
12 Users 100 Users
7 (16:41:08 - 18:51:22)
10/08/2017 (14:55:00 - 15:56:01) 11/08/2017 (12:10:00 - 14:13:3
3,143,710,368 4,793,731,004 26,388,230,484

436,626 1,309,047 3,665,032
196,456 248,080 29,408
27.286 67.744 4.084
195,334 248,080 29,287
- - 44
% Std. 90th % Std.
Dev % le Dev
61600 0 0 0.0 0.1 3.2 0.1 0.1 116269 0 0 N/A N/A N/A N/A
39009 0 0 0.1 0.1 3.2 0.1 0.1 44272 0 0 N/A N/A N/A N/A
38980 0 0 0.1 0.1 3.7 0.1 0.1 44272 0 0 N/A N/A N/A N/A
9544 0 0 0.1 0.3 3.4 0.1 0.4 10525 0 0 N/A N/A N/A N/A
10341 0 0 0.1 0.3 3.5 0.1 0.4 10822 0 0 N/A N/A N/A N/A
18555 0 0 0.2 0.4 3.5 0.1 0.5 8634 0 0 N/A N/A N/A N/A
17125 0 0 0.2 0.4 3.5 0.1 0.5 7965 0 0 N/A N/A N/A N/A
90 0 0 0.8 1.3 3.9 0.3 1.6 2696 0 0 2.6 17.3 58.1 8.5
N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
90 0 0 0.8 1.3 2.9 0.2 1.7 2625 0 0 2.5 13.6 61.2 7.7
Test3 Test1 Test2
Policies ONLY + Incremental Load

[MCV-PHL] Average + Large Policies [MCV-PHL] Average + La
TT & Pacing] [MCV x3 PHL x2]
22 Users 22 Users
100 Users
04/10/2017 (11:55:00 - 12:55:54) 04/10/2017 (13:50:00 -
08/2017 (12:10:00 - 14:13:30)
26,388,230,484 1,002,396,571 993,614,513

3,665,032 278,443 276,004
29,408 12,684 12,667
4.084 3.523 3.519
29,287 12,684 12,666
44 - -
onse Time No. of Response Time No. of Response Time
Seconds) Iterations Error (In Seconds) Iterations Error (In Seconds)
90th % Std. 90th %
% le Dev % le
N/A N/A N/A N/A - - - - - - - - - - -
N/A N/A N/A N/A - - - - - - - - - - -
N/A N/A N/A N/A - - - - - - - - - - -
N/A N/A N/A N/A 0.1 0.2 1.1 0.1 0.4 2304 0 0 0.1 0.2 1.1
N/A N/A N/A N/A 0.1 0.2 1.0 0.1 0.3 2111 0 0 0.1 0.2 1.3
N/A N/A N/A N/A 0.1 0.3 1.4 0.1 0.4 3156 0 0 0.1 0.3 2.1
N/A N/A N/A N/A 0.2 0.3 4.2 0.2 0.5 3157 0 0 0.2 0.3 3.3
28.2 12808 15 0 0.8 1.1 1.8 0.2 1.4 490 0 0 0.8 1.1 1.8
N/A N/A N/A N/A 0.8 1.1 1.8 0.2 1.4 489 0 0 1.0 1.4 4.2
23.6 16479 29 0 0.8 1.2 2.1 0.2 1.4 489 0 0 0.9 1.2 2.3
N/A N/A N/A N/A 0.8 1.1 2.4 0.2 1.3 488 0 0 0.8 1.1 2.2
Test2 Test1 Te
[MCV-PHL] Average + Large Policies [CCO-MCV-PHL] Average + Large Policies [CCO-MCV-PHL] Ave
22 Users 33 Users 33 U
04/10/2017 (13:50:00 - 14:50:55) 04/10/2017 (16:56:00 - 17:57:24) 05/10/2017 (08:3
993,614,513 1,513,456,997 1,511,3

276,004 420,405 419
12,667 19,670 19,
3.519 5.464 5.4
12,666 19,666 19,
- - -
Response Time No. of Response Time No. of Response Time
(In Seconds) Iterations Error (In Seconds) Iterations Error (In Seconds)
Std. 90th % Std. 90th %
Pass Fail Min Avg Max Pass Fail Min Avg
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0.1 0.4 2302 0 0 0.1 0.2 2.8 0.2 0.4 2289 0 0 0.1 0.2
0.1 0.3 2112 0 0 0.1 0.2 3.1 0.1 0.3 2100 0 0 0.1 0.2
0.1 0.4 3165 0 0 0.1 0.3 1.5 0.1 0.4 3144 0 0 0.1 0.3
0.1 0.5 3161 0 0 0.2 0.3 3.1 0.2 0.5 3142 0 0 0.2 0.3
0.2 1.3 473 0 0 0.8 1.1 2.1 0.2 1.4 468 0 0 0.8 1.1
0.3 1.6 472 0 0 1.1 1.4 4.0 0.3 1.7 468 0 0 1.1 1.4
0.2 1.4 491 0 0 0.9 1.2 2.3 0.2 1.4 487 0 0 0.8 1.2
0.2 1.3 490 0 0 0.8 1.1 2.6 0.2 1.3 486 0 0 0.8 1.1
N/A N/A N/A N/A N/A 0.2 0.3 3.3 0.2 0.5 3125 0 0 0.2 0.3
N/A N/A N/A N/A N/A 0.2 0.3 3.7 0.2 0.5 3090 0 0 0.2 0.4
N/A N/A N/A N/A N/A 1.2 1.6 4.7 0.3 1.9 434 0 0 1.2 1.6
N/A N/A N/A N/A N/A - - - - - - - - - -
N/A N/A N/A N/A N/A - - - - - - - - - -
N/A N/A N/A N/A N/A 1.2 1.6 3.0 0.2 1.8 433 0 0 1.2 1.6
N/A N/A N/A N/A N/A - - - - - - - - - -
N/A N/A N/A N/A N/A - - - - - - - - - -
Test2 Test1 - Pacing | TT 5 Test2 - No
[CCO-MCV-PHL] Average + Large Policies [CCO-MCV-PHL] A

[CCO-MCV-PHL] Average + Large Policies
Incremental Load Increm
33 Users
108 Users 10
05/10/2017 (08:37:00 - 09:38:23)
05/10/2017 (11:15:00 - 13:15:37) 09/10/2017 (1
1,511,350,085 6,962,212,166 15,0

419,819 961,897 2,
19,679 84,057 4
5.466 11.613
19,673 84,057 4
- -
Max Pass Fail Min Avg Max Pass Fail Min Avg
Dev % le Dev % le
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
2.0 0.1 0.4 2291 0 0 0.1 0.2 3.6 0.2 0.4 11579 0 0 0.2 0.8
2.2 0.1 0.3 2100 0 0 0.1 0.2 3.9 0.2 0.4 7063 0 0 0.2 0.7
1.3 0.1 0.4 3144 0 0 0.1 0.3 6.0 0.3 0.6 15620 0 0 0.3 1.0
3.0 0.2 0.5 3143 0 0 0.2 0.3 4.1 0.3 0.5 10505 0 0 0.4 1.1
1.9 0.2 1.3 471 0 0 0.7 1.3 7.9 0.5 1.8 2260 0 0 1.7 7.1
3.5 0.2 1.6 470 0 0 1.0 1.6 7.0 0.5 2.1 2260 0 0 2.1 11.6
2.1 0.2 1.5 485 0 0 0.8 1.3 7.1 0.4 1.7 2381 0 0 1.4 8.6
2.5 0.2 1.3 484 0 0 0.7 1.2 5.1 0.4 1.6 2381 0 0 1.4 7.9
3.6 0.2 0.5 3132 0 0 0.2 0.4 5.6 0.4 0.7 10379 0 0 0.3 1.6
3.5 0.2 0.5 3089 0 0 0.2 0.4 5.7 0.4 0.7 15389 0 0 0.2 1.6
4.4 0.3 1.9 432 0 0 1.1 1.7 7.4 0.5 2.2 2120 0 0 2.0 8.9
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
6.0 0.3 1.9 432 0 0 1.1 1.7 9.0 0.6 2.2 2120 0 0 1.8 8.8
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
Test2 - No Pacing | TT 2.5 Test1 - No Pacing | TT 3-5
[CCO-MCV-PHL] Average + Large Policies [CCO-MCV-PHL] [CCO (LB)-M

Incremental Load Very Large Policies + Lar
108 Users 24 Users 3
09/10/2017 (14:48:00 - 16:48:27) 10/10/2017 (16:00:00 - 17:00:59) 13/10/2017 (1
15,054,468,769 9,705,780,728 1,51

2,082,799 2,696,050 4
417,780 12,612
57.8 3.503
417,505 12,617
285 -
Dev % le Dev % le
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
7.1 0.3 1.2 92092 263 0 - - - - - - - - 0.1 0.2
6.7 0.3 1.0 98640 2 0 - - - - - - - - 0.1 0.2
8.4 0.5 1.5 72915 4 0 - - - - - - - - 0.1 0.3
10.9 0.5 1.6 62479 11 0 - - - - - - - - 0.2 0.3
46.8 4.2 11.8 840 0 0 - - - - - - - - 0.7 1.0
54.8 6.2 18.3 837 3 0 - - - - - - - - 1.0 1.3
46.6 5.1 14.2 941 1 0 - - - - - - - - 0.8 1.1
45.6 5.2 13.8 941 0 0 - - - - - - - - 0.8 1.0
13.0 1.1 3.2 42894 0 0 - - - - - - - - 0.2 0.3
N/A N/A N/A N/A N/A N/A - - - - - - - - - -
N/A N/A N/A N/A N/A N/A - - - - - - - - - -
11.8 1.1 3.3 43152 1 0 - - - - - - - - 0.2 0.3
N/A N/A N/A N/A N/A N/A - - - - - - - - - -
N/A N/A N/A N/A N/A N/A - - - - - - - - - -
50.6 4.6 13.5 887 0 0 - - - - - - - - 1.1 1.5
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
53.7 4.7 13.2 887 0 0 - - - - - - - - 1.1 1.5
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
2.4 5.1 10.6 1.3 6.7 1980 0 0 - -
2.4 5.4 13.3 1.3 7.1 1981 0 0 - -
2.5 5.4 14.0 1.4 7.1 1972 0 0 - -
2.2 5.1 10.4 1.3 6.8 1972 0 0 - -
1.5 3.4 9.8 1.0 4.7 2355 0 0 - -
2.1 4.7 13.8 1.4 6.3 2357 0 0 - -

[CCO-MCV-PHL]
Test1 Test1 - No Pacing | TT 3-5
[CCO (LB)-MCV-PHL] Average [CCO (LB) -M

[CCO (LB) -MCV-PHL] Large Policies
+ Large Policies Larg
24 Users
33 Users 2
20/10/2017 (11:28:40 - 12:29:38)
13/10/2017 (13:31:00 - 14:32:24) 20/10/2017 (1
1,510,541,245 5,803,688,272 1,41

426,707 1,612,136 3
19,455 17,576
5.496 4.882
1,945 17,587
- -
Dev % le Dev % le
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
1.5 0.1 0.3 2260 0 0 - - - - - - - - 0.1 0.2
1.7 0.1 0.3 2071 0 0 - - - - - - - - 0.1 0.2
2.0 0.2 0.4 3091 0 0 - - - - - - - - 0.1 0.3
2.7 0.2 0.4 3092 0 0 - - - - - - - - 0.2 0.3
1.8 0.2 1.3 473 0 0 0.8 2.5 47.8 3.3 3.3 2737 0 0 0.8 1.1
4.3 0.3 1.5 472 0 0 1.1 3.9 58.3 4.3 6.6 2730 0 0 1.1 1.4
2.6 0.2 1.3 489 0 0 0.8 3.0 50.4 3.7 4.0 3011 0 0 0.8 1.2
2.9 0.2 1.2 489 0 0 0.8 2.5 42.5 3.2 3.4 3007 0 0 0.8 1.1
1.5 0.1 0.5 3092 0 0 - - - - - - - - 0.2 0.3
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
1.6 0.2 0.5 3050 0 0 - - - - - - - - 0.2 0.3
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
3.3 0.2 1.8 436 0 0 1.1 2.7 41.5 3.2 3.8 3054 0 0 1.2 1.6
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
2.7 0.2 1.8 436 0 0 1.1 2.6 38.7 3.0 3.8 3048 0 0 1.2 1.6
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
Test1 Test1 - No Pacing | TT 3-5
[CCO (LB) -MCV-PHL] Average + [CCO (LB )-MCV-PHL] [CCO

Large Policies V Large Policies Incremental Load Ver
27 Users 96 Users
20/10/2017 (13:25:00 - 14:26:09) 24/10/2017 (09:30:00 - 11:51:47) 02/11/201
1,410,882,607 10,055,860,141
391,912 1,396,647
16,930 82,204
4.703 11.417
16,929 13,628
- 69,092
Response Time No. of Response Time No. of Response T
(In Seconds) Iterations Error (In Seconds) Iterations Error (In Second
Max Pass Fail Min Avg Max Pass Fail Min
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
1.5 0.1 0.4 2300 0 0 - - - - - - - - -
2.0 0.1 0.4 1403 0 0 - - - - - - - - -
1.6 0.2 0.4 3148 0 0 - - - - - - - - -
2.5 0.2 0.5 2093 0 0 - - - - - - - - -
1.9 0.2 1.3 470 0 0 - - - - - - - - -
7.6 0.4 1.6 470 0 0 - - - - - - - - -
2.7 0.2 1.4 489 0 0 - - - - - - - - -
2.7 0.2 1.3 489 0 0 - - - - - - - - -
1.3 0.2 0.5 2095 0 0 - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
3.2 0.2 0.5 3108 0 0 - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
2.5 0.3 2.0 432 0 0 - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
2.7 0.3 2.0 432 0 0 - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - 2.3 11.9 63.2 10.2 26.4 2231 38888 95 2.6
- - - - - - 2.3 11.5 87.9 10.2 26.5 2080 148 7 2.5
- - - - - - 2.5 21.7 65.6 15.5 47.6 1877 24585 93 2.8
- - - - - - 2.2 21.0 108.5 16.3 48.2 1551 323 17 2.8
- - - - - - 1.6 15.1 62.3 14.0 38.6 3705 3632 50 1.4
- - - - - - 2.2 20.1 114.3 15.5 45.0 2184 1516 41 2.2
Test1 Test1 - Pacing | TT 5 Te
[CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL] Average [CCO

Very Large Policies + Large Policies Incremental Load + Larg
24 Users 108 Users
02/11/2017 (13:12:00 - 14:12:55) 07/11/2017 (13:32:00 - 15:32:31) 08/11
7,626,025,870 6,694,860,264
2,118,341 925,727
10,305 82,225
2.863 11.37
10,203 82,225
103 -
Response Time No. of Response Time No. of Response
(In Seconds) Iterations Error (In Seconds) Iterations Error (In Seco
Avg Max Pass Fail Min Avg Max Pass Fail Min
Dev % le Dev % le
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - 0.1 0.3 4.3 0.3 0.7 11325 0 0 0.1
- - - - - - - 0.1 0.3 3.6 0.3 0.6 6970 0 0 0.1
- - - - - - - 0.1 0.5 4.3 0.4 0.9 15200 0 0 0.1
- - - - - - - 0.2 0.5 5.9 0.5 1.0 10213 0 0 0.2
- - - - - - - 0.7 1.4 5.3 0.5 2.2 2139 0 0 1.7
- - - - - - - 1.0 1.9 6.8 0.8 2.9 2139 0 0 3.2
- - - - - - - 0.7 1.5 5.4 0.6 2.3 2251 0 0 2.2
- - - - - - - 0.7 1.4 4.9 0.6 2.1 2251 0 0 2.3
- - - - - - - 0.2 0.4 3.7 0.3 0.8 10357 0 0 0.2
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - 0.2 0.4 4.2 0.3 0.8 15254 0 0 0.2
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - 1.1 1.9 6.3 0.5 2.5 2063 0 0 1.9
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
- - - - - - - 1.1 1.8 4.6 0.5 2.4 2063 0 0 3.0
- - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - -
5.9 15.8 2.1 8.9 1809 0 0 - - - - - - - - -
5.9 16.8 2.1 8.9 1802 1 0 - - - - - - - - -
8.2 20.7 2.7 11.6 1420 0 0 - - - - - - - - -
7.8 24.0 2.7 11.4 1416 0 0 - - - - - - - - -
3.3 11.9 1.4 5.2 1933 0 0 - - - - - - - - -
7.6 21.6 2.8 11.4 1823 102 5 - - - - - - - - -
Test2 - No Pacing | TT 2.5 Test2 - No Pacing | TT 3-5
[CCO (LB )-MCV-PHL] Average [CCO (LB )-MCV-PHL]

+ Large Policies Incremental Load Large Policies Only Incremental Load
108 Users 96 Users
08/11/2017 (14:15:01 - 16:15:27) 08/11/2017 (09:16:00 - 11:16:22)
8,419,682,134 8,808,603,882
1,165,031 1,219,522
738,287 287,334
102.157 39.78
213,549 26,106
524,803 261,228
Response Time Response Time
No. of Iterations No. of Iterations
(In Seconds) Error (In Seconds)
Std. 90th % Std. 90th
Avg Max Pass Fail Min Avg Max Pass Fail
Dev % le Dev % le
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
1.5 14.2 1.3 3.3 47652 8 0 - - - - - - -
1.0 14.0 0.9 2.2 34244 367604 91 - - - - - - -
1.7 15.8 1.2 3.4 37935 45357 54 - - - - - - -
2.1 15.4 1.6 4.3 28113 104076 79 - - - - - - -
8.8 30.6 4.3 15.1 704 5952 89 0.8 4.9 54.0 5.3 11.8 6825 29217
18.4 42.4 6.8 27.0 433 271 38 1.1 8.2 58.3 8.5 20.3 6479 346
11.9 31.9 5.4 19.3 981 1 0 0.8 4.9 55.6 5.2 9.7 5336 88926
11.9 25.3 5.5 19.0 276 705 72 0.7 4.1 55.3 4.8 7.7 5027 309
2.2 16.4 1.7 4.3 31806 333 1 - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
2.3 15.5 1.8 4.8 30118 414 1 - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
12.3 45.3 5.8 19.6 658 53 7 1.2 7.5 43.2 6.3 16.6 1338 142193
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
11.4 27.7 5.4 18.4 629 29 4 1.2 6.0 42.2 5.9 14.9 1101 237
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
T 3-5 Test2 - No Pacing | TT 2.5 Test1 - Pacing | TT 5
L] [CCO (LB )-MCV-PHL] Average [CCO (LB )-MCV-PHL] Average + Large Policies
ental Load + Large Policies Incremental Load Re Baseline Test
108 Users 27 Users
1:16:22) 27/11/2017 (14:51:00 - 16:51:29) 12/02/2018(14:50:00 - 15:51:10)
12,947,663,295 1,437,077,735
1,790,825 399,188
496,910 16,841
68.729 4.678
292,314 16,840
204,596 -
Error (In Seconds) Error (In Seconds)
Min Avg Max Pass Fail Min Avg Max Pass
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- 0.1 1.5 10.8 1.4 3.4 40079 8112 17 0.1 0.2 0.8 0.1 0.3 2270
- 0.1 1.2 8.7 1.0 2.6 48162 0 0 0.1 0.2 0.8 0.1 0.3 1389
- 0.1 1.5 12.3 1.3 3.1 34407 93431 73 0.1 0.2 0.9 0.1 0.4 3111
- 0.2 1.7 12.2 1.5 3.6 30596 88579 74 0.1 0.3 2.2 0.1 0.4 2077
81 1.0 4.0 13.3 1.9 6.7 1383 13599 91 0.7 0.9 1.7 0.1 1.0 484
5 1.2 5.0 15.4 2.5 8.3 1021 362 26 1.0 1.2 2.7 0.2 1.3 483
94 1.2 4.8 14.0 2.2 7.9 1475 513 26 0.8 1.0 2.1 0.1 1.1 498
6 0.9 3.8 12.1 1.7 6.0 1475 0 0 0.8 0.9 1.9 0.1 1.0 497
- 0.2 0.8 9.8 0.6 1.7 66415 0 0 0.1 0.3 1.3 0.2 0.5 2064
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- 0.2 0.9 6.9 0.7 1.8 63621 0 0 0.1 0.3 1.8 0.2 0.5 3058
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
99 1.3 3.3 11.6 1.6 5.7 1840 0 0 1.0 1.3 3.8 0.2 1.5 455
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
18 1.3 3.1 12.2 1.4 5.1 1840 0 0 1.0 1.3 2.2 0.2 1.4 454
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
IFaces PIP R 1711 - Broker Service Rating Call

[CCO(LB)-MCV-PHL]
acing | TT 5 Test1 Rerun - Pacing | TT 5 Test2 - Pacing | TT 5
Average + Large Policies [CCO (LB )-MCV-PHL] Average + Large Policies [CCO (LB )-MCV-PHL] Avg + Large Po
eline Test Re Baseline due to load change CCO New IFC XML
Users 28 Users 28 Users
50:00 - 15:51:10) 13/02/2018 (11:35:00 - 12:36:16) 13/02/2018 (10:05:00 - 11:06:19)
077,735 1,731,889,327 1,775,845,937

9,188 481,080 493,291
,841 17,771 17,710
678 4.936 4.919
,840 17,769 17,709
- - -
Fail Min Avg Max Pass Fail Min Avg Max
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0 0.1 0.2 1.0 0.1 0.3 2270 0 0 0.1 0.2 1.1 0.1 0.3
0 0 0.1 0.2 1.6 0.1 0.3 1389 0 0 0.1 0.2 1.0 0.1 0.3
0 0 0.1 0.2 3.3 0.1 0.4 3108 0 0 0.1 0.2 1.1 0.1 0.4
0 0 0.1 0.3 1.7 0.1 0.4 2076 0 0 0.1 0.3 1.9 0.2 0.4
0 0 0.6 0.9 1.7 0.1 1.1 482 0 0 0.8 0.9 1.7 0.1 1.1
0 0 1.1 1.2 2.8 0.2 1.3 481 0 0 1.1 1.2 3.2 0.2 1.3
0 0 0.8 1.0 1.7 0.1 1.1 495 0 0 0.8 1.0 2.1 0.1 1.1
0 0 0.7 1.0 1.9 0.1 1.1 494 0 0 0.8 1.0 2.0 0.1 1.1
0 0 0.2 0.3 1.7 0.2 0.5 2061 0 0 - - - - -
- - - - - - - - - - 0.2 0.3 1.4 0.2 0.6
- - - - - - - - - - - - - - -
0 0 0.1 0.3 1.2 0.2 0.5 3049 0 0 - - - - -
- - - - - - - - - - 0.2 0.3 1.4 0.1 0.5
- - - - - - - - - - - - - - -
0 0 0.9 1.2 1.9 0.2 1.4 933 0 0 - - - - -
- - - - - - - - - - 0.9 1.2 2.3 0.2 1.4
- - - - - - - - - - - - - - -
0 0 0.9 1.2 2.4 0.2 1.4 931 0 0 - - - - -
- - - - - - - - - - 0.9 1.2 2.3 0.2 1.4
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
IFac
est2 - Pacing | TT 5 Test3 - Pacing | TT 5 Test4 - Pacing | TT
CV-PHL] Avg + Large Policies [CCO (LB )-MCV-PHL] Avg + Large Policies [CCO (LB )-MCV-PHL] Avg + L
CCO New IFC XML CCO New IFC_FRED_ModelID CCO New PIP_FRED_M
018 (10:05:00 - 11:06:19) 14/02/2018 (13:52:00 - 14:53:11) 14/02/2018 (16:00:00 - 1
1,775,845,937 1,768,422,439 1,721,108,597

493,291 491,228 478,086
17,710 16,348 16,220
4.919 4.541 4.506
17,709 16,350 16,221
- - -
% Std. 90th % Std.
Dev % le Dev
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
2263 0 0 0.1 0.2 3.3 0.1 0.3 2266 0 0 0.1 0.2 1.3 0.1
1385 0 0 0.1 0.2 1.3 0.1 0.3 1389 0 0 0.1 0.2 1.1 0.1
3103 0 0 0.1 0.2 1.3 0.1 0.4 3103 0 0 0.1 0.2 3.2 0.1
2069 0 0 0.1 0.3 2.0 0.1 0.4 2072 0 0 0.2 0.3 1.6 0.1
481 0 0 0.6 1.0 2.3 0.2 1.2 471 0 0 0.7 1.0 2.3 0.2
480 0 0 0.9 1.3 3.5 0.3 1.6 471 0 0 1.0 1.5 3.3 0.4
494 0 0 0.6 1.1 3.1 0.3 1.3 485 0 0 0.7 1.2 3.5 0.4
494 0 0 0.7 1.0 2.4 0.2 1.2 485 0 0 0.7 1.1 3.1 0.3
- - - - - - - - - - - - - - -
2048 0 0 0.6 0.9 2.7 0.3 1.2 1897 0 0 - - - -
- - - - - - - - - - - 0.5 0.9 4.1 0.3
- - - - - - - - - - - - - - -
3030 0 0 0.5 0.9 3.2 0.3 1.2 2709 0 0 - - - -
- - - - - - - - - - - 0.5 0.9 4.3 0.3
- - - - - - - - - - - - - - -
932 0 0 3.7 4.5 8.8 0.7 5.1 502 0 0 - - - -
- - - - - - - - - - - 3.8 5.0 10.0 1.3
- - - - - - - - - - - - - - -
930 0 0 3.7 4.5 8.7 0.6 5.0 500 0 0 - - - -
- - - - - - - - - - - 3.6 5.0 9.4 1.2
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
IFaces PIP R 1803 - Broker Service Rating Call

[CCO(LB)-MCV-PHL]
Test4 - Pacing | TT 5 Test5 - Pacing | TT 5 Test6 - Paci
LB )-MCV-PHL] Avg + Large Policies [CCO (LB )-MCV-PHL] Avg + Large Policies [CCO (LB )-MCV-PHL] A
CCO New PIP_FRED_ModelID CCO New IFC_PIP_FRED_ModelID CCO New IFC_PIP_
28 Users 28 Users Incremental Loa
4/02/2018 (16:00:00 - 17:01:17) 15/02/2018 (06:26:00 - 07:27:16) 15/02/2018 (10:17
1,721,108,597 1,676,479,345 7,020,44

478,086 465,689 970,3
16,220 16,052 70,93
4.506 4.459 9.80
16,221 16,049 70,93
- - -
onse Time Response Time Response Time
econds) Error (In Seconds) Error (In Seconds)
90th % Std. 90th %
% le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0.3 2264 0 0 0.1 0.2 1.2 0.1 0.3 2259 0 0 0.1 0.2 3.5
0.3 1386 0 0 0.1 0.2 0.9 0.1 0.3 1382 0 0 0.1 0.2 3.2
0.4 3101 0 0 0.1 0.2 1.3 0.1 0.4 3096 0 0 0.1 0.3 4.9
0.4 2071 0 0 0.2 0.3 2.2 0.1 0.4 2065 0 0 0.1 0.4 3.2
1.3 460 0 0 0.7 1.1 2.8 0.3 1.6 447 0 0 0.6 1.2 4.8
2.0 459 0 0 0.9 1.6 3.7 0.5 2.2 446 0 0 0.9 1.8 8.1
1.8 475 0 0 0.8 1.2 2.7 0.3 1.7 470 0 0 0.7 1.3 4.9
1.5 474 0 0 0.7 1.2 2.8 0.4 1.7 469 0 0 0.6 1.2 7.2
- - - - - - - - - - - - - - -
- - - - 0.6 1.0 2.6 0.3 1.3 935 0 0 0.6 4.1 16.4
1.2 1892 0 0 0.6 1.0 4.2 0.3 1.3 935 0 0 0.6 4.1 15.5
- - - - - - - - - - - - - - -
- - - - 0.6 1.0 4.3 0.3 1.3 1333 0 0 0.6 4.0 16.3
1.2 2705 0 0 0.6 1.0 4.2 0.3 1.3 1330 0 0 0.6 4.0 15.8
- - - - - - - - - - - - - - -
- - - - 3.9 5.5 8.9 1.3 7.6 219 0 0 4.1 9.5 24.4
7.3 468 0 0 4.1 5.4 9.4 1.3 7.8 222 0 0 4.0 9.6 24.3
- - - - - - - - - - - - - - -
- - - - 3.8 5.6 9.6 1.4 7.8 219 0 0 4.0 9.7 21.3
7.2 466 0 0 3.9 5.3 9.2 1.3 7.6 222 0 0 4.0 9.5 23.0
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
IFaces PIP R 1803.1 Post Changes_CC team - Broker Servi

[CCO (LB)-MCV-PHL]
Test6 - Pacing | TT 5 Test1 - Pacing | TT 5 Test2
[CCO (LB )-MCV-PHL] Avg + Large Policies [CCO (LB )-MCV-PHL] Avg + Large Policies [CCO (LB )-MCV
CCO New IFC_PIP_FRED_ModelID CCO New IFC_PIP_All New Model ID's CCO New IFC_
Incremental Load - 112 Users 28 Users Incremen
15/02/2018 (10:17:00 - 12:17:34) 27/04/2018 (16:27:00 - 17:28:16) 30/04/2018
7,020,447,493 1,659,139,497 7,
970,345 460,872
70,934 15,957
9.804 4.433
70,934 15,957
- -
Response Time Response Time Response Time
(In Seconds) Error (In Seconds) Error (In Seconds)
Pass Fail Min Avg Max Pass Fail Min Avg
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0.2 0.4 11273 0 0 0.1 0.2 3.2 0.1 0.4 2233 0 0 0.1 0.2
0.2 0.4 6936 0 0 0.1 0.2 1.1 0.1 0.3 1374 0 0 0.1 0.2
0.2 0.5 15301 0 0 0.1 0.2 3.2 0.1 0.4 3052 0 0 0.1 0.3
0.3 0.6 10273 0 0 0.1 0.2 1.8 0.1 0.4 2054 0 0 0.1 0.3
0.4 1.8 2164 0 0 0.7 1.0 2.7 0.3 1.3 477 0 0 0.6 1.1
0.7 2.7 2164 0 0 0.7 1.1 3.1 0.4 1.4 476 0 0 0.6 1.1
0.5 1.9 2297 0 0 0.7 1.2 3.0 0.3 1.5 468 0 0 0.7 1.2
0.5 1.9 2297 0 0 0.7 1.1 3.1 0.3 1.3 467 0 0 0.7 1.2
- - - - - - - - - - - - - - -
2.7 7.4 3344 0 0 0.3 1.0 14.8 1.4 1.3 932 0 0 0.3 2.9
2.6 7.4 3345 0 0 0.6 1.3 15.2 1.3 1.6 897 0 0 0.6 3.2
- - - - - - - - - - - - - - -
2.6 7.3 4305 0 0 0.6 1.2 13.9 1.2 1.5 1271 0 0 0.6 3.1
2.7 7.4 4295 0 0 0.6 1.2 14.6 1.3 1.5 1267 0 0 0.6 3.1
- - - - - - - - - - - - - - -
3.8 14.8 734 0 0 3.9 5.0 14.5 1.4 6.1 263 0 0 4.0 7.9
3.8 15.1 736 0 0 4.0 5.0 17.2 1.6 6.0 232 0 0 3.9 8.0
- - - - - - - - - - - - - - -
3.7 15.2 734 0 0 2.2 3.2 17.1 1.6 4.1 262 0 0 2.2 5.3
3.7 14.7 736 0 0 3.8 5.0 18.4 1.5 5.9 232 0 0 3.9 8.0
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
C team - Broker Service Rating Call IFaces PIP R 1803.1 Radar Config Change - Broker
MCV-PHL] [CCO (LB)-MCV-PHL]
Test2 - Pacing | TT 5 Test1 - Pacing | TT 5
[CCO (LB )-MCV-PHL] Avg + Large Policies [CCO (LB )-MCV-PHL] Avg + Large Policies [CCO (LB )
CCO New IFC_PIP_All New Model ID's CCO New IFC_PIP_All Existing Model ID's CCO New
Incremental Load - 112 Users 28 Users Incr
30/04/2018 (14:15:15 - 16:16:25) 10/05/2018 (14:01:00 - 15:02:32) 10/05
7,269,581,162 1,569,534,958
999,805 435,982
73,077 15,713
10.05 4.365
73,077 15,711
- -
Response Time Response Time Response
(In Seconds) Error (In Seconds) Error (In Seco
Max Pass Fail Min Avg Max Pass Fail Min
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
3.4 0.2 0.4 11156 0 0 0.1 0.2 1.0 0.1 0.3 2215 0 0 0.1
3.1 0.2 0.4 6894 0 0 0.1 0.2 1.2 0.1 0.4 1361 0 0 0.1
3.1 0.2 0.5 15143 0 0 0.1 0.2 3.2 0.2 0.4 3025 0 0 0.1
3 0.2 0.5 10253 0 0 0.1 0.3 2.0 0.2 0.4 2033 0 0 0.1
4.6 0.4 1.6 2339 0 0 0.7 1.1 2.8 0.3 1.6 464 0 0 0.6
4.2 0.4 1.6 2339 0 0 0.7 1.1 3.0 0.3 1.5 463 0 0 0.6
3.8 0.4 1.7 2278 0 0 0.8 1.3 3.1 0.4 1.8 448 0 0 0.7
3.7 0.4 1.7 2278 0 0 0.8 1.3 2.7 0.3 1.7 447 0 0 0.7
- - - - - - - - - - - - - - -
13.5 2.0 5.5 3722 0 0 0.3 0.8 2.9 0.4 1.2 944 0 0 0.4
13.2 2.1 5.8 3626 0 0 0.6 1.1 3.8 0.4 1.6 907 0 0 0.6
- - - - - - - - - - - - - - -
13.6 2.0 5.7 4717 0 0 0.6 1.1 3.7 0.4 1.5 1281 0 0 0.6
13.4 2.0 5.7 4734 0 0 0.6 1.1 3.8 0.4 1.6 1275 0 0 0.6
- - - - - - - - - - - - - - -
18.8 2.7 11.3 960 0 0 4.1 6.6 12.2 1.7 8.8 232 0 0 4.3
20.3 2.9 11.6 839 0 0 4.0 6.5 11.4 1.7 8.6 193 0 0 4.2
- - - - - - - - - - - - - - -
15.6 2.2 8.2 960 0 0 2.4 3.3 6.3 0.7 4.4 231 0 0 2.3
19.7 2.9 11.4 839 0 0 4.2 6.5 12.5 1.8 8.7 192 0 0 4.1
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
nfig Change - Broker Service Rating Call

O (LB)-MCV-PHL]
[CCO (LB )-MCV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + Large Policies
CCO New IFC_PIP_All Existing Model ID's CCO PIP_All Existing Model ID's
Incremental Load - 112 Users 28 Users
10/05/2018 (15:30:00 - 17:30:40) 19/12/2018 (14:45:00 - 15:46:30)
7,030,925,750 2,533,828,334
970,988 686,488
71,180 16,994
9.83 4.604
71,180 16,994
- -
(In Seconds) Error (In Seconds)
Std. 90th % Std. 90th
Avg Max Pass Fail Min Avg Max Pass Fail
Dev % le Dev % le
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
0.2 2.0 0.2 0.4 11191 0 0 0.1 0.3 2.0 0.2 0.5 2295 0
0.2 3.1 0.2 0.4 6903 0 0 0.1 0.3 1.5 0.2 0.5 1403 0
0.3 9.2 0.2 0.5 15155 0 0 0.2 0.3 2.6 0.2 0.4 1568 0
0.3 3 0.2 0.5 10260 0 0 0.2 0.3 2.7 0.2 0.4 2107 0
1.1 3.2 0.3 1.5 2367 0 0 0.8 1.0 2.5 0.2 1.3 502 0
1.1 3.1 0.3 1.6 2367 0 0 0.8 1.1 3.9 0.3 1.4 502 0
1.2 3.2 0.3 1.6 2315 0 0 0.7 1.1 5.2 0.3 1.6 1975 0
1.1 3.2 0.3 1.5 2315 0 0 0.8 1.1 3.5 0.3 1.6 1975 0
- - - - - - - - - - - - - -
3.9 27.7 3.1 7.3 3372 0 0 - - - - - - -
4.3 27.9 3.1 7.7 3276 0 0 0.8 1.6 21.4 1.1 2.2 1787 0
- - - - - - - - - - - - - -
4.0 29.7 3.0 7.6 4217 0 0 - - - - - - -
4.0 26.3 3.0 7.6 4218 0 0 0.7 1.6 19.8 1.0 2.2 2484 0
- - - - - - - - - - - - - -
9.2 32.7 3.6 13.3 856 0 0 - - - - - - -
9.3 30.3 3.7 13.8 756 0 0 4.7 6.5 18.5 1.9 8.8 198 0
- - - - - - - - - - - - - -
6.3 28.5 3.4 10.5 856 0 0 - - - - - - -
9.0 32.5 3.7 13.1 756 0 0 4.7 6.6 16.5 2.0 9.8 198 0
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
- - - - - - - - - - - - - -
5 Test2 - Pacing | TT 5 Test3 - Pacing | TT 5
arge Policies [CCO (LB)-MCV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + Large Policies
odel ID's CCO PIP_All Existing Model ID's CCO PIP_All Existing Model ID's
28 Users 28 Users
5:46:30) 20/12/2018 (09:30:00 - 10:31:30) 20/12/2018 (12:30:00 - 13:31:30)
2,513,409,296 2,489,538,065
683,921 678,348
16,982 16,955
4.621 4.62
16,982 16,955
- -
Min Avg Max Pass Fail Min Avg Max Pass
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0.1 0.3 1.3 0.1 0.4 2301 0 0 0.1 0.3 2.0 0.2 0.4 2292
0 0.1 0.3 3.2 0.2 0.4 1403 0 0 0.1 0.3 1.7 0.2 0.4 1403
0 0.2 0.3 3.3 0.2 0.4 1566 0 0 0.2 0.3 2.0 0.1 0.4 1566
0 0.2 0.3 2.6 0.2 0.4 2109 0 0 0.2 0.3 2.2 0.1 0.4 2107
0 0.8 1.1 3.3 0.3 1.3 504 0 0 0.8 1.1 3.1 0.3 1.4 500
0 0.8 1.0 3.3 0.2 1.2 504 0 0 0.8 1.1 2.8 0.2 1.3 500
0 0.8 1.1 6.2 0.3 1.5 1988 0 0 0.8 1.1 6.5 0.3 1.6 1971
0 0.8 1.1 3.1 0.3 1.4 1988 0 0 0.8 1.1 4.0 0.3 1.6 1971
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0.8 1.5 11.2 0.9 2.2 1790 0 0 0.8 1.5 5.7 0.6 2.1 1808
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0.7 1.5 11.8 0.8 2.1 2495 0 0 0.7 1.4 5.9 0.6 2.1 2525
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 4.8 8.3 16.5 2.8 12.3 167 0 0 4.8 8.9 16.6 3.1 13.0 156
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 4.6 8.1 15.2 2.5 11.4 167 0 0 5.0 9.0 17.2 3.1 13.1 156
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
IFaces PRPM Release 1812 Broker Service Rating call with
acing | TT 5 Test4 - Pacing | TT 5 Test5 - Pacing | TT 5 - Invalid Tes
] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + Large Po
isting Model ID's CCO PIP_All Existing Model ID's CCO PIP_All Existing Model ID's
Users Incremental Load - 112 Users Incremental Load - 112 Users
30:00 - 13:31:30) 20/12/2018 (14:45:00 - 16:46:02) 21/12/2018 (10:00:00 - 12:01:06)
538,065 7,922,064,552 5,848,965,926

8,348 1,090,743 804,867
,955 70,599 85,769
.62 9.72 11.803
,955 70,597 54,660
- 152 31,113
Fail Min Avg Max Pass Fail Min Avg Max
Dev % le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0 0.1 0.6 17.1 0.8 1.2 10806 25 0 0.1 0.6 9.3 0.7 1.3
0 0 0.1 0.6 18.6 0.8 1.2 6761 15 0 0.1 0.6 10.2 0.7 1.3
0 0 0.2 0.7 20.5 0.8 1.3 14475 26 0 0.2 0.7 16.8 0.8 1.3
0 0 0.2 0.7 16.3 0.8 1.4 9945 20 0 0.2 0.7 14.1 0.7 1.5
0 0 0.8 1.8 26.3 1.3 3.2 2067 0 0 0.8 2.0 16.2 1.3 3.6
0 0 0.8 1.9 15.5 1.3 3.3 2065 2 0 0.7 2.0 11.2 1.3 3.5
0 0 0.8 1.8 19.3 1.2 3.2 4863 5 0 0.8 2.2 15.3 1.4 3.9
0 0 0.8 1.9 21.2 1.3 3.2 4861 2 0 0.8 2.2 19.9 1.4 3.8
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0 0.8 5.6 36.9 4.4 10.9 5906 22 0 0.8 6.6 39.8 4.3 11.2
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0 0.8 5.4 34.1 4.3 10.6 7448 24 0 0.8 6.3 33.7 4.2 11.0
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0 5.2 23.3 64.4 12.6 41.8 703 5 1 4.6 19.9 58.8 9.3 32.4
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
0 0 5.0 22.8 78.3 12.5 39.9 697 6 1 4.9 19.9 57.7 9.1 31.8
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
Service Rating call with New infrastructure of Broker Servers and Configuration changes in Radar Servers
[CCO (LB)-MCV-PHL]
acing | TT 5 - Invalid Test Test5 Re-Run - Pacing | TT 5 Test6 - Pacing | TT
CV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + L
P_All Existing Model ID's CCO PIP_All Existing Model ID's CCO PIP_All Existing M
mental Load - 112 Users Incremental Load - 112 Users Incremental Load - 112
018 (10:00:00 - 12:01:06) 24/12/2018 (09:45:00 - 11:46:13) 24/12/2018 (13:50:00 - 1
5,848,965,926 6,459,720,221 7,004,938,607

804,867 888,056 966,865
85,769 64,501 66,415
11.803 8.867 9.167
54,660 62,597 64,492
31,113 1,909 1,924
% Std. 90th % Std.
Dev % le Dev
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
7526 3424 31 0.1 0.9 11.8 1.0 2.0 10384 1 0 0.1 0.8 10.4 0.7
4697 2128 31 0.1 1.0 19.9 1.2 2.2 5572 1038 16 0.1 0.8 9.8 0.7
11646 3026 21 0.2 1.1 15.0 1.2 2.5 13442 2 0 0.2 1.1 12.0 1.2
7951 2082 21 0.2 1.2 24.9 1.3 2.7 9397 0 0 0.2 1.2 12.9 1.1
1602 6504 80 0.8 2.5 21.8 1.7 4.5 1760 0 0 0.8 2.4 10.0 1.4
1586 16 1 0.9 2.7 26.0 2.0 4.7 1760 0 0 0.8 2.5 9.8 1.5
2845 13916 83 0.9 2.6 19.6 1.7 4.7 3735 0 0 0.9 2.2 13.2 1.2
2835 10 0 0.9 2.7 17.8 1.6 4.7 2873 862 23 0.9 2.2 14.5 1.2
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
5519 1 0 0.8 6.8 38.2 4.9 11.6 5419 1 0 0.8 6.6 47.3 4.4
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
6854 1 0 0.8 6.5 43.8 4.8 11.3 6684 0 0 0.8 5.9 48.4 4.3
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
801 2 0 5.2 20.7 58.0 9.8 33.9 786 4 1 5.0 17.9 61.3 8.5
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
798 3 0 5.1 20.0 66.4 9.4 31.9 785 1 0 5.3 17.6 58.1 8.3
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
ers
Test6 - Pacing | TT 5 Test7 - Pacing | TT 5 Test8 - Paci
LB)-MCV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] A
CO PIP_All Existing Model ID's CCO PIP_All Existing Model ID's CCO PIP_All Exis
Incremental Load - 112 Users Incremental Load - 112 Users 28 Use
4/12/2018 (13:50:00 - 15:50:44) 27/12/2018 (13:00:00 - 15:00:49) 28/12/2018 (09:30
7,004,938,607 7,827,910,602 2,281,23

966,865 1,079,712 621,0
66,415 69,166 16,30
9.167 9.54 4.43
64,492 69,166 16,30
1,924 5 -
onse Time Response Time Response Time
econds) Error (In Seconds) Error (In Seconds)
90th % Std. 90th %
% le Dev % le
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
1.7 10649 0 0 0.1 0.7 11.1 0.6 1.4 10822 0 0 0.1 0.3 5.7
1.7 6700 0 0 0.1 0.7 9.6 0.6 1.4 6766 0 0 0.1 0.3 5.5
2.9 13336 1 0 0.2 0.8 13.9 0.8 1.5 14316 1 0 0.2 0.4 6.3
2.9 9358 0 0 0.2 0.8 11.2 0.8 1.6 9851 2 0 0.2 0.4 6.5
4.5 1819 0 0 0.8 2.1 9.9 1.2 3.8 1957 0 0 0.8 1.4 5.1
4.8 1819 0 0 0.8 2.1 11.0 1.3 3.8 1957 0 0 0.9 1.4 7.9
3.8 4123 0 0 0.8 2.0 12.4 1.2 3.5 4430 0 0 0.8 1.5 7.6
3.8 4123 0 0 0.8 2.0 13.1 1.2 3.5 4430 0 0 0.8 1.5 7.7
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
11.3 5485 0 0 0.8 6.4 34.5 3.9 10.8 5584 1 0 0.7 1.5 10.3
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
10.9 5656 1219 18 0.7 6.1 31.7 3.8 10.5 6961 1 0 0.7 1.5 11.7
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
28.5 712 704 50 4.8 14.7 52.9 7.8 24.9 1046 0 0 5.0 12.5 31.3
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
27.9 712 0 0 4.6 14.8 57.6 7.7 25.1 1046 0 0 4.4 12.9 27.3
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
- - - - - - - - - - - - - - -
[CCO (LB)-MCV-PHL] Avg + Large Policies [CCO (LB)-MCV-PHL] Avg + Large Policies
CCO PIP_All Existing Model ID's CCO PIP_All Existing Model ID's
28 Users Incremental Load - 112 Users
28/12/2018 (09:30:00 - 10:30:12) 28/12/2018 (11:15:00 - 13:15:52)
2,281,234,543 7,500,749,725
621,082 1,034,158
16,305 78,604
4.439 10.837
16,305 65,512
- 13,092
(In Seconds) Error (In Seconds) Error
Pass Fail Min Avg Max Pass Fail
Dev % le Dev % le
- - - - - - - - - - - - -
- - - - - - - - - - - - -
- - - - - - - - - - - - -
0.3 0.5 2268 0 0 0.1 0.6 10.8 0.6 1.3 10853 0 0
0.3 0.5 1393 0 0 0.1 0.6 11.3 0.6 1.4 6774 0 0
0.4 0.6 1531 0 0 0.2 0.9 9.3 0.9 2.1 11234 3089 0
0.4 0.6 2073 0 0 0.2 0.9 11.6 0.9 2.1 8267 1590 0
0.6 1.9 457 0 0 0.9 2.0 10.1 1.2 3.7 1657 8041 0
0.8 2.1 457 0 0 0.9 2.1 13.6 1.3 3.9 1288 369 0
0.8 2.5 1790 0 0 0.9 1.9 15.0 1.1 3.2 4589 0 0
0.8 2.3 1790 0 0 0.9 2.0 16.6 1.1 3.3 4589 0 0
- - - - - - - - - - - - -
- - - - - - - - - - - - -
1.3 2.1 1800 0 0 0.8 4.9 26.3 3.3 9.4 6330 1 0
- - - - - - - - - - - - -
- - - - - - - - - - - - -
1.3 1.9 2510 0 0 0.7 4.7 20.2 3.2 9.2 8089 0 0
- - - - - - - - - - - - -
- - - - - - - - - - - - -
5.3 20.3 118 0 0 4.7 17.0 66.3 9.7 29.8 921 2 0
- - - - - - - - - - - - -
- - - - - - - - - - - - -
4.9 19.1 118 0 0 4.8 17.0 63.3 9.7 30.6 921 0 0
- - - - - - - - - - - - -
- - - - - - - - - - - - -
- - - - - - - - - - - - -
- - - - - - - - - - - - -
- - - - - - - - - - - - -
- - - - - - - - - - - - -
IFaces - Broker Service Rating Call: PIP Phase-2 IFaces - Broker Servic
[Trials] [New
Test4
Top Transactions 7/7/2017 Top Transact
(with high response time) (with high respon
[Day-1] 10 users [6 Months + Large
ART (sec)
05_PHL_PolicyLevel_Average_DQ 0.42 07_PHL_PolicyLevel_Large_Averag
06_PHL_PolicyLevel_Average_MQ 0.40 08_MCV_PolicyLevel_Large_Averag
03_MCV_PolicyLevel_Average_DQ 0.36 05_PHL_PolicyLevel_Average_DQ
04_MCV_PolicyLevel_Average_MQ 0.35 06_PHL_PolicyLevel_Average_MQ
02_Get_Price_CoverLevel_PHL_P01_MQ 0.11 03_MCV_PolicyLevel_Average_DQ
02_Get_Price_CoverLevel_PHL_P03_MQ 0.10 04_MCV_PolicyLevel_Average_MQ
01_Get_Price_CoverLevel_MCV_MC0_MQ 0.10 02_Get_Price_CoverLevel_PHL_P0
02_Get_Price_CoverLevel_PHL_P0
01_Get_Price_CoverLevel_MCV_MC
Test1
Top Transactions 7/7/2017
(with high response time)
[6 Months] 10 users
ART (sec) Top Transact
(with high respon
05_PHL_PolicyLevel_Average_DQ 0.38 [12 Months + Large
06_PHL_PolicyLevel_Average_MQ 0.36
03_MCV_PolicyLevel_Average_DQ 0.33 07_PHL_PolicyLevel_Large_Averag
04_MCV_PolicyLevel_Average_MQ 0.31 08_MCV_PolicyLevel_Large_Averag
02_Get_Price_CoverLevel_PHL_P03_MQ 0.10 05_PHL_PolicyLevel_Average_DQ
02_Get_Price_CoverLevel_PHL_P01_MQ 0.09 06_PHL_PolicyLevel_Average_MQ
01_Get_Price_CoverLevel_MCV_MC0_MQ 0.08 03_MCV_PolicyLevel_Average_DQ
04_MCV_PolicyLevel_Average_MQ
Test2
(with high response time) Top Transact
[12 Months] 10 users
(with high respon
ART (sec) [Day-1]
05_PHL_PolicyLevel_Average_DQ 0.28
06_PHL_PolicyLevel_Average_MQ 0.26 05_PHL_PolicyLevel_Average_DQ
03_MCV_PolicyLevel_Average_DQ 0.23 06_PHL_PolicyLevel_Average_MQ
04_MCV_PolicyLevel_Average_MQ 0.22 03_MCV_PolicyLevel_Average_DQ
Test1 02_Get_Price_CoverLevel_PHL_P0
Top Transactions 10/7/2017 01_Get_Price_CoverLevel_MCV_MC
[Day-1 Incremental Load] 100 users
ART (sec)
06_PHL_PolicyLevel_Average_MQ 0.24 Top Transact
(with high respon
03_MCV_PolicyLevel_Average_DQ 0.17 [6 Months
04_MCV_PolicyLevel_Average_MQ 0.14
02_Get_Price_CoverLevel_PHL_P03_MQ 0.09 05_PHL_PolicyLevel_Average_DQ
02_Get_Price_CoverLevel_PHL_P01_MQ 0.08 06_PHL_PolicyLevel_Average_MQ
01_Get_Price_CoverLevel_MCV_MC0_MQ 0.06 03_MCV_PolicyLevel_Average_DQ
Top Transact
(with high respon
[12 Month
05_PHL_PolicyLevel_Average_DQ
06_PHL_PolicyLevel_Average_MQ
03_MCV_PolicyLevel_Average_DQ
Top Transact
(with high respon
[Day-1 Increment
Top Transact
(with high respon
[Day-1 Incremental Load
07_PHL_PolicyLevel_Large_Averag
08_MCV_PolicyLevel_Large_Averag
Top Transact
(with high respon
[Day-1 + Large P
07_PHL_PolicyLevel_Large_Averag
08_MCV_PolicyLevel_Large_Averag
IFaces - Broker Service Rating Call: PIP Phase-2 IFaces - Broker Service Rating Call: PIP Pha
[New Model ID] [New Model ID]
Test1
Top Transactions 11/7/2017 Top Transactions
(with high response time) (with high response time)
[6 Months + Large Policies] 12 users [Day-1 Incremental Load + Large Policies]
ART (sec)
07_PHL_PolicyLevel_Large_Average_DQ 1.44 07_PHL_PolicyLevel_Large_Average_DQ
08_MCV_PolicyLevel_Large_Average_DQ 1.15 08_MCV_PolicyLevel_Large_Average_DQ
05_PHL_PolicyLevel_Average_DQ 0.44 06_PHL_PolicyLevel_Average_MQ
03_MCV_PolicyLevel_Average_DQ 0.34 03_MCV_PolicyLevel_Average_DQ
04_MCV_PolicyLevel_Average_MQ 0.31 04_MCV_PolicyLevel_Average_MQ
02_Get_Price_CoverLevel_PHL_P03_MQ 0.10 02_Get_Price_CoverLevel_PHL_P03_MQ
02_Get_Price_CoverLevel_PHL_P01_MQ 0.09 02_Get_Price_CoverLevel_PHL_P01_MQ
01_Get_Price_CoverLevel_MCV_MC0_MQ 0.08 01_Get_Price_CoverLevel_MCV_MC0_MQ
Test2
Top Transactions 12/7/2017 Top Transactions
(with high response time) (with high response time)
[12 Months + Large Policies] 12 users [Day-1 + Large Policies] [NO TT & Pacing]
ART (sec)
07_PHL_PolicyLevel_Large_Average_DQ 1.50 08_MCV_PolicyLevel_Large_Average_DQ
08_MCV_PolicyLevel_Large_Average_DQ 1.19 07_PHL_PolicyLevel_Large_Average_DQ
05_PHL_PolicyLevel_Average_DQ 0.36 06_PHL_PolicyLevel_Average_MQ
02_Get_Price_CoverLevel_PHL_P03_MQ
02_Get_Price_CoverLevel_PHL_P01_MQ
Test3 01_Get_Price_CoverLevel_MCV_MC0_MQ
[Day-1] 10 users
ART (sec)
Top Transactions
05_PHL_PolicyLevel_Average_DQ 0.45 (with high response time)
06_PHL_PolicyLevel_Average_MQ 0.41 [Large Policies ONLY + Incremental Load]
[NO TT & Pacing]
03_MCV_PolicyLevel_Average_DQ 0.36
04_MCV_PolicyLevel_Average_MQ 0.31 07_PHL_PolicyLevel_Large_Average_DQ
02_Get_Price_CoverLevel_PHL_P03_MQ 0.10 08_MCV_PolicyLevel_Large_Average_DQ
02_Get_Price_CoverLevel_PHL_P01_MQ 0.08
01_Get_Price_CoverLevel_MCV_MC0_MQ 0.07
Test4
[6 Months] 10 users
ART (sec)
Test5
[12 Months] 10 users
ART (sec)
Test6
[Day-1 Incremental Load] 100 users
ART (sec)
Test7
[Day-1 Incremental Load + Large Policies] 102 users
ART (sec)
07_PHL_PolicyLevel_Large_Average_DQ 1.77
08_MCV_PolicyLevel_Large_Average_DQ 1.32
Test8
[Day-1 + Large Policies] 12 users
ART (sec)
07_PHL_PolicyLevel_Large_Average_DQ 1.49
08_MCV_PolicyLevel_Large_Average_DQ 1.16
roker Service Rating Call: PIP Phase-2 IFaces - Broker Service Rating Call: PIP Phase-2
[New Model ID] [CCO-MCV-PHL]
Test1
op Transactions 8/8/2017 Top Transactions
high response time) (with high response time)
ental Load + Large Policies] 102 users [MCV-PHL] Average + Large Policies
ART (sec)
arge_Average_DQ 1.25 08a_MCV_PolicyLevel_Large_Average_DQ
Large_Average_DQ 1.24 07b_PHL_PolicyLevel_Large_Average_MQ
Average_MQ 0.27 07a_PHL_PolicyLevel_Large_Average_DQ
Average_DQ 0.25 08b_MCV_PolicyLevel_Large_Average_MQ
Average_DQ 0.19 06_PHL_PolicyLevel_Average_MQ
Average_MQ 0.16 05_PHL_PolicyLevel_Average_DQ
evel_PHL_P03_MQ 0.10 03_MCV_PolicyLevel_Average_DQ
evel_PHL_P01_MQ 0.08 04_MCV_PolicyLevel_Average_MQ
evel_MCV_MC0_MQ 0.06
Test2 Top Transactions

op Transactions (with high response time)
10/8/2017 [MCV-PHL] Average + Large Policies
high response time)
e Policies] [NO TT & Pacing] 12 users
ART (sec) 07b_PHL_PolicyLevel_Large_Average_MQ
Large_Average_DQ 1.34 08a_MCV_PolicyLevel_Large_Average_DQ
arge_Average_DQ 1.31 07a_PHL_PolicyLevel_Large_Average_DQ
Average_MQ 0.42 08b_MCV_PolicyLevel_Large_Average_MQ
Average_DQ 0.39 06_PHL_PolicyLevel_Average_MQ
Average_DQ 0.31 05_PHL_PolicyLevel_Average_DQ
Average_MQ 0.31 03_MCV_PolicyLevel_Average_DQ
evel_PHL_P03_MQ 0.10 04_MCV_PolicyLevel_Average_MQ
evel_PHL_P01_MQ 0.09
evel_MCV_MC0_MQ 0.07
Top Transactions
Test3 [CCO-MCV-PHL] Average + Large Policies
op Transactions
high response time) 11/8/2017
s ONLY + Incremental Load] 100 users 12a_CCO_PolicyLevel_Large_Average_DQ
NO TT & Pacing]
ART (sec) 12b_CCO_PolicyLevel_Large_Average_RQ
arge_Average_DQ 17.27 07b_PHL_PolicyLevel_Large_Average_MQ
Large_Average_DQ 13.57 08a_MCV_PolicyLevel_Large_Average_DQ
07a_PHL_PolicyLevel_Large_Average_DQ
08b_MCV_PolicyLevel_Large_Average_MQ
10_CCO_PolicyLevel_Average_DQ
09_CCO_PolicyLevel_Average_RQ
Top Transactions
[CCO-MCV-PHL] Average + Large Policies
12a_CCO_PolicyLevel_Large_Average_DQ
12b_CCO_PolicyLevel_Large_Average_RQ
07b_PHL_PolicyLevel_Large_Average_MQ
08a_MCV_PolicyLevel_Large_Average_DQ
Top Transactions
[CCO-MCV-PHL] Average
+ Large Policies Incremental Load
Pacing | TT 5
Top Transactions
[CCO-MCV-PHL] Average
+ Large Policies Incremental Load
No Pacing | TT 2.5
Top Transactions
[CCO-MCV-PHL]
Very Large Policies
No Pacing | TT 3-5
16a_MCV_PolicyLevel_Large_x3_Average_DQ
15b_CCO_PolicyLevel_Large_x2_Average_RQ
16b_MCV_PolicyLevel_Large_x3_Average_MQ
15a_CCO_PolicyLevel_Large_x2_Average_DQ
17b_PHL_PolicyLevel_Large_x2_Average_MQ
17a_PHL_PolicyLevel_Large_x2_Average_DQ
l: PIP Phase-2 IFaces - Broker Service Rating Call: PIP Phase-2

[CCO (LB)-MCV-PHL]
Test1 Top Transactions Test1

4/10/2017 (with high response time) 13/10/2017
22 users [CCO (LB)-MCV-PHL] Average 33users
ART (sec) + Large Policies ART (sec)
1.15 12a_CCO_PolicyLevel_Large_Average_DQ 1.50
1.14 12b_CCO_PolicyLevel_Large_Average_RQ 1.47
1.11 07b_PHL_PolicyLevel_Large_Average_MQ 1.33
1.09 08a_MCV_PolicyLevel_Large_Average_DQ 1.08
0.29 07a_PHL_PolicyLevel_Large_Average_DQ 1.02
0.26 08b_MCV_PolicyLevel_Large_Average_MQ 1.01
0.20 10_CCO_PolicyLevel_Average_DQ 0.33
0.17 09_CCO_PolicyLevel_Average_RQ 0.30
Test2 03_MCV_PolicyLevel_Average_DQ 0.20
4/10/2017 04_MCV_PolicyLevel_Average_MQ 0.18
22 users
ART (sec)
1.40 Test1
Top Transactions
1.16 (with high response time) 20/10/2017
1.11 [CCO (LB)-MCV-PHL] Large Policies 24 users
No Pacing | TT 3-5 ART (sec)
1.09
08b_MCV_PolicyLevel_Large_Average_MQ 2.55
07a_PHL_PolicyLevel_Large_Average_DQ 2.54
Test1
4/10/2017
33 users Test1
Top Transactions
ART (sec) (with high response time) 20/10/2017
1.60 [CCO (LB)-MCV-PHL] Average + 27 users
Large Policies
1.56 ART (sec)
0.34 07a_PHL_PolicyLevel_Large_Average_DQ 1.11
0.29 10_CCO_PolicyLevel_Average_DQ 0.34
0.26 06_PHL_PolicyLevel_Average_MQ 0.33
0.21 09_CCO_PolicyLevel_Average_RQ 0.33
0.17 05_PHL_PolicyLevel_Average_DQ 0.28
Test2
5/10/2017
33 users Test1
Top Transactions
ART (sec) (with high response time) 24/10/2017
[CCO (LB )-MCV-PHL]
V Large Policies Incremental Load - No Pacing | TT 3-5
Top Transactions
1.63 [CCO (LB )-MCV-PHL] 96 users
V Large Policies Incremental Load - No Pacing | TT 3-5
1.57 ART (sec)
1.41 16a_MCV_PolicyLevel_Large_x3_Average_DQ 21.73
1.19 16b_MCV_PolicyLevel_Large_x3_Average_MQ 20.97
1.12 17b_PHL_PolicyLevel_Large_x2_Average_MQ 20.08
1.10 17a_PHL_PolicyLevel_Large_x2_Average_DQ 15.06
0.35 15a_CCO_PolicyLevel_Large_x2_Average_DQ 11.92
0.33 15b_CCO_PolicyLevel_Large_x2_Average_RQ 11.54
0.29
0.26
0.21 Test1
Top Transactions
[CCO (LB )-MCV-PHL] 24 users
Very Large Policies
ART (sec)
Test1 16a_MCV_PolicyLevel_Large_x3_Average_DQ 8.21
5/10/2017 16b_MCV_PolicyLevel_Large_x3_Average_MQ 7.82
108 users 17b_PHL_PolicyLevel_Large_x2_Average_MQ 7.64
ART (sec) 15b_CCO_PolicyLevel_Large_x2_Average_RQ 5.88
1.72 15a_CCO_PolicyLevel_Large_x2_Average_DQ 5.87
1.71 17a_PHL_PolicyLevel_Large_x2_Average_DQ 3.31
1.59
1.32
1.30 Test1
Top Transactions
0.43 [CCO (LB )-MCV-PHL] Average 108 users
+ Large Policies Incremental Load - Pacing | TT5 ART (sec)
0.41
Test2 06_PHL_PolicyLevel_Average_MQ 0.52
9/10/2017 05_PHL_PolicyLevel_Average_DQ 0.45
108 users 10_CCO_PolicyLevel_Average_DQ 0.44
ART (sec) 09_CCO_PolicyLevel_Average_RQ 0.43
11.57 03_MCV_PolicyLevel_Average_DQ 0.33
8.94 04_MCV_PolicyLevel_Average_MQ 0.32
8.76
8.56
7.89 Top Transactions Test2
1.65 [CCO (LB )-MCV-PHL] Average 108 users
+ Large Policies Incremental Load - NoPacing | TT2.5 ART (sec)
1.64
12b_CCO_PolicyLevel_Large_Average_RQ 11.44
Test1 10_CCO_PolicyLevel_Average_DQ 2.30
10/10/2017 09_CCO_PolicyLevel_Average_RQ 2.19
24 users 06_PHL_PolicyLevel_Average_MQ 2.14
ART (sec) 05_PHL_PolicyLevel_Average_DQ 1.66
5.41 03_MCV_PolicyLevel_Average_DQ 1.48

5.09
5.08
4.70 Test1
Top Transactions
[CCO (LB )-MCV-PHL] 96 users
Large Policies Only Incremental Load - No Pacing | TT3-5 ART (sec)
07b_PHL_PolicyLevel_Large_Average_MQ 8.16
12a_CCO_PolicyLevel_Large_Average_DQ 7.51
08a_MCV_PolicyLevel_Large_Average_DQ 4.87
Top Transactions Test2

(with high response time) 27/11/2017
[CCO (LB )-MCV-PHL] Average 108 users
+ Large Policies Incremental Load - NoPacing | TT2.5 ART (sec)
12a_CCO_PolicyLevel_Large_Average_DQ 3.29
10_CCO_PolicyLevel_Average_DQ 0.87
09_CCO_PolicyLevel_Average_RQ 0.83
Ifaces PIP R 1711 - Broker Service Rating Call Ifaces PIP R 1803 - Broker Service
Top Transactions Test1 Top Transactions

(with high response time) 12/2/2018 (with high response time)
[CCO (LB)-MCV-PHL] Average + Large Policies 27users [CCO (LB)-MCV-PHL] Average + Large P
Re Baseline Test ART (sec) CCO New IFC_FRED_ModelID
12a_CCO_PolicyLevel_Large_Average_DQ 1.32 12a_CCO_PolicyLevel_Large_New_IFC_DQ
12b_CCO_PolicyLevel_Large_Average_RQ 1.28 12b_CCO_PolicyLevel_Large_New_IFC_RQ
07b_PHL_PolicyLevel_Large_Average_MQ 1.20 07b_PHL_PolicyLevel_Large_Average_MQ
08a_MCV_PolicyLevel_Large_Average_DQ 0.97 08a_MCV_PolicyLevel_Large_Average_DQ
08b_MCV_PolicyLevel_Large_Average_MQ 0.94 08b_MCV_PolicyLevel_Large_Average_MQ
07a_PHL_PolicyLevel_Large_Average_DQ 0.93 07a_PHL_PolicyLevel_Large_Average_DQ
09_CCO_PolicyLevel_Average_RQ 0.30 09_CCO_PolicyLevel_Average_New_IFC_RQ
10_CCO_PolicyLevel_Average_DQ 0.30 10_CCO_PolicyLevel_Average_New_IFC_DQ
06_PHL_PolicyLevel_Average_MQ 0.25 06_PHL_PolicyLevel_Average_MQ
05_PHL_PolicyLevel_Average_DQ 0.21 05_PHL_PolicyLevel_Average_DQ
04_MCV_PolicyLevel_Average_MQ 0.17 03_MCV_PolicyLevel_Average_DQ
03_MCV_PolicyLevel_Average_DQ 0.17 04_MCV_PolicyLevel_Average_MQ
Test1 Rerun
Top Transactions Top Transactions
Re Baseline due to load change ART (sec) CCO New PIP_FRED_ModelID
12a_CCO_PolicyLevel_Large_Average_DQ 1.22 12a_CCO_PolicyLevel_Large_New_PIP_DQ
07b_PHL_PolicyLevel_Large_Average_MQ 1.21 12b_CCO_PolicyLevel_Large_New_PIP_RQ
12b_CCO_PolicyLevel_Large_Average_RQ 1.20 07b_PHL_PolicyLevel_Large_Average_MQ
08a_MCV_PolicyLevel_Large_Average_DQ 1.00 08a_MCV_PolicyLevel_Large_Average_DQ
08b_MCV_PolicyLevel_Large_Average_MQ 0.96 08b_MCV_PolicyLevel_Large_Average_MQ
07a_PHL_PolicyLevel_Large_Average_DQ 0.94 07a_PHL_PolicyLevel_Large_Average_DQ
09_CCO_PolicyLevel_Average_RQ 0.32 09_CCO_PolicyLevel_Average_New_PIP_RQ
10_CCO_PolicyLevel_Average_DQ 0.32 10_CCO_PolicyLevel_Average_New_PIP_DQ
06_PHL_PolicyLevel_Average_MQ 0.26 06_PHL_PolicyLevel_Average_MQ
05_PHL_PolicyLevel_Average_DQ 0.22 05_PHL_PolicyLevel_Average_DQ

CCO New IFC XML ART (sec) CCO New IFC_PIP_FRED_ModelID
07b_PHL_PolicyLevel_Large_Average_MQ 1.22 12b_CCO_PolicyLevel_Large_New_IFC_RQ
12a_CCO_PolicyLevel_Large_New_IFC_DQ 1.21 12a_CCO_PolicyLevel_Large_New_IFC_DQ
12b_CCO_PolicyLevel_Large_New_IFC_RQ 1.20 12a_CCO_PolicyLevel_Large_New_PIP_DQ
08a_MCV_PolicyLevel_Large_Average_DQ 0.99 12b_CCO_PolicyLevel_Large_New_PIP_RQ
08b_MCV_PolicyLevel_Large_Average_MQ 0.96 07b_PHL_PolicyLevel_Large_Average_MQ
07a_PHL_PolicyLevel_Large_Average_DQ 0.94 08a_MCV_PolicyLevel_Large_Average_DQ
09_CCO_PolicyLevel_Average_New_IFC_RQ 0.34 08b_MCV_PolicyLevel_Large_Average_MQ
10_CCO_PolicyLevel_Average_New_IFC_DQ 0.34 07a_PHL_PolicyLevel_Large_Average_DQ
06_PHL_PolicyLevel_Average_MQ 0.27 09_CCO_PolicyLevel_Average_New_IFC_RQ
05_PHL_PolicyLevel_Average_DQ 0.22 09_CCO_PolicyLevel_Average_New_PIP_RQ
04_MCV_PolicyLevel_Average_MQ 0.18 10_CCO_PolicyLevel_Average_New_PIP_DQ

03_MCV_PolicyLevel_Average_DQ 0.18 10_CCO_PolicyLevel_Average_New_IFC_DQ
Top Transactions
[CCO (LB)-MCV-PHL] Average + Large P
CCO New IFC_PIP_FRED_ModelID
12b_CCO_PolicyLevel_Large_New_IFC_RQ
12a_CCO_PolicyLevel_Large_New_PIP_DQ
12a_CCO_PolicyLevel_Large_New_IFC_DQ
12b_CCO_PolicyLevel_Large_New_PIP_RQ
09_CCO_PolicyLevel_Average_New_PIP_RQ
09_CCO_PolicyLevel_Average_New_IFC_RQ
10_CCO_PolicyLevel_Average_New_PIP_DQ
10_CCO_PolicyLevel_Average_New_IFC_DQ
Ifaces PIP R 1803 - Broker Service Rating Call IF PIP R 1803.1 Post Changes_CC team - BS Rating Call

(LB)-MCV-PHL] Average + Large Policies 28users [CCO (LB)-MCV-PHL] Average + Large Policies
CCO New IFC_FRED_ModelID ART (sec) CCO New IFC_PIP_All New Model ID's
_PolicyLevel_Large_New_IFC_DQ 4.55 12a_CCO_PolicyLevel_Large_New_IFC_DQ
_PolicyLevel_Large_New_IFC_RQ 4.48 12a_CCO_PolicyLevel_Large_New_PIP_DQ
PolicyLevel_Large_Average_MQ 1.31 12b_CCO_PolicyLevel_Large_New_PIP_RQ
_PolicyLevel_Large_Average_DQ 1.08 12b_CCO_PolicyLevel_Large_New_IFC_RQ
_PolicyLevel_Large_Average_MQ 1.02 09_CCO_PolicyLevel_Average_New_PIP_RQ
PolicyLevel_Large_Average_DQ 1.01 10_CCO_PolicyLevel_Average_New_PIP_DQ
PolicyLevel_Average_New_IFC_RQ 0.93 10_CCO_PolicyLevel_Average_New_IFC_DQ
PolicyLevel_Average_New_IFC_DQ 0.91 08a_MCV_PolicyLevel_Large_Average_DQ
olicyLevel_Average_MQ 0.28 08b_MCV_PolicyLevel_Large_Average_MQ
olicyLevel_Average_DQ 0.24 07b_PHL_PolicyLevel_Large_Average_MQ
PolicyLevel_Average_DQ 0.20 07a_PHL_PolicyLevel_Large_Average_DQ
PolicyLevel_Average_MQ 0.19 09_CCO_PolicyLevel_Average_New_IFC_RQ
Test4 03_MCV_PolicyLevel_Average_DQ
Top Transactions
(with high response time) 14/2/2018 04_MCV_PolicyLevel_Average_MQ
(LB)-MCV-PHL] Average + Large Policies 28users
CCO New PIP_FRED_ModelID ART (sec)
_PolicyLevel_Large_New_PIP_DQ 5.04 Top Transactions
_PolicyLevel_Large_New_PIP_RQ 5.01 (with high response time)
PolicyLevel_Large_Average_MQ 1.47 [CCO (LB)-MCV-PHL] Average + Large Policies
CCO New IFC_PIP_All New Model ID's
_PolicyLevel_Large_Average_DQ 1.17
_PolicyLevel_Large_Average_MQ 1.10 12a_CCO_PolicyLevel_Large_New_PIP_DQ
PolicyLevel_Large_Average_DQ 1.04 12b_CCO_PolicyLevel_Large_New_PIP_RQ
PolicyLevel_Average_New_PIP_RQ 0.94 12a_CCO_PolicyLevel_Large_New_IFC_DQ
PolicyLevel_Average_New_PIP_DQ 0.92 12b_CCO_PolicyLevel_Large_New_IFC_RQ
olicyLevel_Average_MQ 0.28 09_CCO_PolicyLevel_Average_New_PIP_RQ
olicyLevel_Average_DQ 0.23 10_CCO_PolicyLevel_Average_New_IFC_DQ
PolicyLevel_Average_MQ 0.19 10_CCO_PolicyLevel_Average_New_PIP_DQ
PolicyLevel_Average_DQ 0.19 09_CCO_PolicyLevel_Average_New_IFC_RQ
Top Transactions Test5 07b_PHL_PolicyLevel_Large_Average_MQ
(with high response time) 15/2/2018 07a_PHL_PolicyLevel_Large_Average_DQ
(LB)-MCV-PHL] Average + Large Policies 28users 06_PHL_PolicyLevel_Average_MQ
CCO New IFC_PIP_FRED_ModelID ART (sec) 05_PHL_PolicyLevel_Average_DQ
_PolicyLevel_Large_New_IFC_RQ 5.55 03_MCV_PolicyLevel_Average_DQ
_PolicyLevel_Large_New_IFC_DQ 5.45 04_MCV_PolicyLevel_Average_MQ
_PolicyLevel_Large_New_PIP_DQ 5.43
_PolicyLevel_Large_New_PIP_RQ 5.35
PolicyLevel_Large_Average_MQ 1.62
_PolicyLevel_Large_Average_MQ 1.15
PolicyLevel_Large_Average_DQ 1.10
PolicyLevel_Average_New_IFC_RQ 1.01
PolicyLevel_Average_New_PIP_RQ 1.00
PolicyLevel_Average_New_PIP_DQ 0.99
PolicyLevel_Average_New_IFC_DQ 0.98
PolicyLevel_Average_MQ 0.28
PolicyLevel_Average_DQ 0.23
Test6
Top Transactions
(with high response time) 15/2/2018
(LB)-MCV-PHL] Average + Large Policies 112 users
CCO New IFC_PIP_FRED_ModelID
ART (sec)
_PolicyLevel_Large_New_IFC_RQ 9.66
_PolicyLevel_Large_New_PIP_DQ 9.60
_PolicyLevel_Large_New_IFC_DQ 9.53
_PolicyLevel_Large_New_PIP_RQ 9.52
PolicyLevel_Average_New_PIP_RQ 4.10
PolicyLevel_Average_New_IFC_RQ 4.10
PolicyLevel_Average_New_PIP_DQ 3.97
PolicyLevel_Average_New_IFC_DQ 3.95
PolicyLevel_Large_Average_MQ 1.81
_PolicyLevel_Large_Average_MQ 1.22
PolicyLevel_Large_Average_DQ 1.17
IFaces PRPM Release 1

m - BS Rating Call IF PIP R 1803.1 Radar Config Change - BS Rating Call
of Broker Server
[CCO (LB)-MCV-PHL]
Test1 Top Transactions Test1

27/4/2018 10/5/2018 Top T
(with high
28users [CCO (LB)-MCV-PHL] Average + Large Policies 28users [CCO (LB)-MCV-PHL
ART (sec) CCO New IFC_PIP_All Existing Model ID's ART (sec) CCO PIP_All
5.05 12a_CCO_PolicyLevel_Large_New_IFC_DQ 6.61 12b_CCO_PolicyLevel_La
5.01 12b_CCO_PolicyLevel_Large_New_PIP_RQ 6.46 12a_CCO_PolicyLevel_La
4.96 12a_CCO_PolicyLevel_Large_New_PIP_DQ 6.45 09_CCO_PolicyLevel_Ave
3.15 12b_CCO_PolicyLevel_Large_New_IFC_RQ 3.28 10_CCO_PolicyLevel_Ave
1.26 08a_MCV_PolicyLevel_Large_Average_DQ 1.26 08a_MCV_PolicyLevel_La
1.19 08b_MCV_PolicyLevel_Large_Average_MQ 1.25 08b_MCV_PolicyLevel_La
1.18 07b_PHL_PolicyLevel_Large_Average_MQ 1.13 07b_PHL_PolicyLevel_La
1.16 09_CCO_PolicyLevel_Average_New_PIP_RQ 1.12 07a_PHL_PolicyLevel_La
1.09 10_CCO_PolicyLevel_Average_New_PIP_DQ 1.12 05_PHL_PolicyLevel_Ave
1.08 07a_PHL_PolicyLevel_Large_Average_DQ 1.11 06_PHL_PolicyLevel_Ave
1.04 10_CCO_PolicyLevel_Average_New_IFC_DQ 1.10 04_MCV_PolicyLevel_Ave
0.97 09_CCO_PolicyLevel_Average_New_IFC_RQ 0.81 03_MCV_PolicyLevel_Ave
0.25 06_PHL_PolicyLevel_Average_MQ 0.26
0.24 05_PHL_PolicyLevel_Average_DQ 0.25
0.19 03_MCV_PolicyLevel_Average_DQ 0.20 Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
Test2 Test2 12a_CCO_PolicyLevel_La
Top Transactions
30/4/2018 (with high response time) 10/5/2018 12b_CCO_PolicyLevel_La
112 users [CCO (LB)-MCV-PHL] Average + Large Policies 112 users 09_CCO_PolicyLevel_Ave
ART (sec) CCO New IFC_PIP_All Existing Model ID's ART (sec) 10_CCO_PolicyLevel_Ave
8.01 12a_CCO_PolicyLevel_Large_New_PIP_DQ 9.29 08a_MCV_PolicyLevel_La
7.96 12a_CCO_PolicyLevel_Large_New_IFC_DQ 9.20 08b_MCV_PolicyLevel_La
7.94 12b_CCO_PolicyLevel_Large_New_PIP_RQ 9.02 07a_PHL_PolicyLevel_La
5.32 12b_CCO_PolicyLevel_Large_New_IFC_RQ 6.32 07b_PHL_PolicyLevel_La
3.20 09_CCO_PolicyLevel_Average_New_PIP_RQ 4.26 05_PHL_PolicyLevel_Ave
3.15 10_CCO_PolicyLevel_Average_New_IFC_DQ 4.05 06_PHL_PolicyLevel_Ave
3.12 10_CCO_PolicyLevel_Average_New_PIP_DQ 4.04 04_MCV_PolicyLevel_Ave
2.94 09_CCO_PolicyLevel_Average_New_IFC_RQ 3.93 03_MCV_PolicyLevel_Ave
1.09 07a_PHL_PolicyLevel_Large_Average_DQ 1.05 Top T
(with high
0.30 06_PHL_PolicyLevel_Average_MQ 0.31 [CCO (LB)-MCV-PHL
0.29 05_PHL_PolicyLevel_Average_DQ 0.29 CCO PIP_All
0.22 03_MCV_PolicyLevel_Average_DQ 0.21 12b_CCO_PolicyLevel_La
0.22 04_MCV_PolicyLevel_Average_MQ 0.21 12a_CCO_PolicyLevel_La
09_CCO_PolicyLevel_Ave
08b_MCV_PolicyLevel_La
08a_MCV_PolicyLevel_La
07a_PHL_PolicyLevel_La
07b_PHL_PolicyLevel_La
05_PHL_PolicyLevel_Ave
03_MCV_PolicyLevel_Ave
Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
12a_CCO_PolicyLevel_La
12b_CCO_PolicyLevel_La
Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
Top T
(with high
[CCO (LB)-MCV-PHL
CCO PIP_All
IFaces PRPM Release 1812 Broker Service Rating call with New infrastructure
of Broker Servers and Configuration changes in Radar Servers
[CCO-MCV-PHL]
Test1
[CCO (LB)-MCV-PHL] Average + Large Policies 28users
CCO PIP_All Existing Model ID's ART (sec)
12b_CCO_PolicyLevel_Large_New_PIP_RQ 6.63
12a_CCO_PolicyLevel_Large_New_PIP_DQ 6.53
09_CCO_PolicyLevel_Average_New_PIP_RQ 1.57
10_CCO_PolicyLevel_Average_New_PIP_DQ 1.55
Test2
Test3
Test4
Test5 - Invalid Test

Test5 Re-Run
Test6
Test7
Test8
Test9

Ifaces - Broker Service Rating Call: Pip Phase-2 (Trials) : Day-1 6 Months 12 Months

Caricato da

Informazioni sul documento

Titolo originale

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

Ifaces - Broker Service Rating Call: Pip Phase-2 (Trials) : Day-1 6 Months 12 Months

Caricato da

Copyright:

Formati disponibili

Classification: Internal #

IFaces - Broker Service Rating Call: PIP Phase-2

Day-1 6 Months 12 Months

Test 4 Test 1 Test 2

No of Txns % No of Txns % No of Txns

Rating Call: PIP Phase-2

Test 2 Test 1 Test 1

IFaces - Broker Service Rating Call: PIP Phase-2

Test 2 Test 3 Test 4 Test 5 Test 6

No of Txns % No of Txns % No of Txns % No of Txns % No of Txns

No of Txns % No of Txns % No of Txns % No of Txns % No of Txns

Avg Max Avg Max Avg Max Avg Max Avg

2 IFaces PIP R 1709 -

Day-1 Day-1 Day-1

Test 6 Test 7 Test 8 Test 1

% No of Txns % No of Txns % No of Txns

100 u 102 u 12 u 102 u

100 u 102 u 12 u 102 u

IFaces PIP R 1709 - Broker Service Rating Call: PIP Phase-2

Day-1 Day-1 + Large Policies ONLY +

Test 1 Test 2 Test 3

Test 1 Test 2 Test 1 Test 2 Test 1

No of Txns % No of Txns % No of Txns % No of Txns % No of Txns

No of Txns % No of Txns % No of Txns % No of Txns % No of Txns

Avg Max Avg Max Avg Max Avg Max Avg

IFaces PIP R 1711 - Broker Service Rating Call: PIP Phase-2

Test 1 Test 2 Test 1 Test 1 Test 1

% No of Txns % No of Txns % No of Txns % No of Txns %

% No of Txns % No of Txns % No of Txns % No of Txns %

Max Avg Max Avg Max Avg Max Avg Max

Call: PIP Phase-2

[CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL]

Test 1 Test 1 Test 1 Test 1 Test 2

No of Txns % No of Txns % No of Txns % No of Txns % No of Txns

No of Txns % No of Txns % No of Txns % No of Txns % No of Txns

Avg Max Avg Max Avg Max Avg Max Avg

[CCO (LB )-MCV-PHL] [CCO (LB )-MCV-PHL]

Test 2 Test 1 Test 2

Test 1 Test 1 Rerun Test 2 Test 3

No of Txns % No of Txns % No of Txns % No of Txns %

No of Txns % No of Txns % No of Txns % No of Txns %

Avg Max Avg Max Avg Max Avg Max

Test4 Test 5 Test 6 Test 1

28 u 28 u Incremental Load - 112 u 28 u

No of Txns % No of Txns % No of Txns % No of Txns

28 u 28 u Incremental Load - 112 u 28 u

No of Txns % No of Txns % No of Txns % No of Txns

28 u 28 u Incremental Load - 112 u 28 u

Avg Max Avg Max Avg Max Avg

Test 1 Test 2 Test 1 Test 2

28 u Incremental Load - 112 u 28 u Incremental Load - 112 u

% No of Txns % No of Txns % No of Txns %

28 u Incremental Load - 112 u 28 u Incremental Load - 112 u

% No of Txns % No of Txns % No of Txns %

28 u Incremental Load - 112 u 28 u Incremental Load - 112 u

Max Avg Max Avg Max Avg Max

[CCO (LB)-MCV-PHL] [CCO (LB)-MCV-PHL]

Test 3 Test 4 Test 5 - Invalid Test Test 5 Re-Run

28 u Incremental Load - 112 u Incremental Load - 112 u Incremental Load - 112 u

No of Txns % No of Txns % No of Txns % No of Txns

28 u Incremental Load - 112 u Incremental Load - 112 u Incremental Load - 112 u

No of Txns % No of Txns % No of Txns % No of Txns

28 u Incremental Load - 112 u Incremental Load - 112 u Incremental Load - 112 u