Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Scorecard (BMS)
GB935
Concepts & Principles
Version 7.0
April, 2013
Notice
Copyright TeleManagement Forum 2013. All Rights Reserved.
This document and translations of it may be copied and furnished to others, and derivative
works that comment on or otherwise explain it or assist in its implementation may be prepared,
copied, published, and distributed, in whole or in part, without restriction of any kind, provided
that the above copyright notice and this section are included on all such copies and derivative
works. However, this document itself may not be modified in any way, including by removing the
copyright notice or references to TM FORUM, except as needed for the purpose of developing
any document or deliverable produced by a TM FORUM Collaboration Project Team (in which
case the rules applicable to copyrights, as set forth in the TM FORUM IPR Policy, must be
followed) or as required to translate it into languages other than English.
The limited permissions granted above are perpetual and will not be revoked by TM FORUM or
its successors or assigns.
This document and the information contained herein is provided on an "AS IS" basis and TM
FORUM DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT
LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT
INFRINGE ANY OWNERSHIP RIGHTS OR ANY IMPLIED WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
Direct inquiries to the TM Forum office:
240 Headquarters Plaza,
East Tower 10th Floor,
Morristown, NJ 07960 USA
Tel No. +1 973 944 5100
Fax No. +1 973 944 5110
TM Forum Web Page: www.tmforum.org
Page 2 of 40
Table of Contents
Notice 2
Table of Contents..........................................................................................................................................................3
List of Figures................................................................................................................................................................4
Executive Summary......................................................................................................................................................5
1. Introduction...............................................................................................................................................................6
Page 3 of 40
List of Figures
Figure 1 - The Balanced Scorecard
13
14
17
19
19
20
20
29
32
Figure 10 - F-CE-2a
34
35
Page 4 of 40
Executive Summary
Service providers are striving to achieve business excellence and are increasingly looking to the
TM Forum for guidance and understanding: What does business excellence mean? How far
away from business excellence are we? What initiatives should we develop in order to obtain
the benefits of achieving business excellence?
For these purposes the industry requires quantitative as well as qualitative information to
support its evolution in the increasingly complex market that is developing. Service providers
need measures that will focus attention on aspects of their operation and areas of their business
where improvement will bring the most benefit. They also need a way to compare themselves
with their peers and to promote areas in which they are able to offer uniquely superior
performance.
The TM Forum is addressing this situation with the Business Metrics Scorecard. The objective
of this team is to create a set of business metrics aimed specifically at business performance at
the service level. These are living metrics developed and maintained by a project team and will
evolve over time to continually reflect the interests of the service provider community. This is a
real example of work done for the industry by the industry.
Further information on the measures and the benchmarking data associated with them is
provided in other output from this team and TM Forum (see www.tmforum.org or email
benchmark@tmforum.org for more information).
Page 5 of 40
1. Introduction
1.1. Document Overview
The GB935 document family describes the TM Forum output related to business metrics. The
document family consists of several documents, including a Concepts & Principles document,
an addendum A that lists out the business metric specifications, and an addendum B that
describes the process for contributing new business metrics.
This Concepts & Principles document provides an overview of the business metrics that have
been developed in collaboration with service providers via the Business Metrics Scorecard
team. This includes definitions of key terms, taxonomy, naming conventions, and how the
metrics are structurally composed into a business metrics scorecard.
The Business Metric Specifications Addendum A lists the definitions of the 100+ business
metrics that are currently active with the BMS team. This includes key attributes like naming,
codes, categories, formula, description, units, etc. The Business Metrics Development Guide
Addendum B describes how contributors can submit new metric proposals to the BMS team,
and includes the process to follow and the definition detail they should fill out in a provided form.
Additional information concerning each metric and its corresponding benchmarking data is
available by contacting the business benchmarking team (benchmark@tmforum.org), and/or
subscribing to its reports and services.
Page 6 of 40
The benefits will be attained on the basis of analyzed and raw benchmarking data that will be
available in two forms:
A secure current database that can be queried the Business Benchmarking Secure
Web-Portal.
Page 7 of 40
According to the US National Institute of Standards and Technology, a measure is for more concrete
or objective attributes and metric for more abstract, higher-level, or somewhat subjective attributes.1
A measure is a more general concept than a metric. Any quantity can be measured, but a good
business metric also has a clearly understood preferred progression, a numerical directionality which
indicates how wed like to see the metric change as the business improves. Preferred progression
can come in many different flavors, like:
A metric is more likely to be some sort of comparison between two values, often expressed as a ratio,
less frequently as a difference. But still, not all metrics need be comparisons. So for example, one
can have a metric which is the number of days it takes to go from bill cycle close to bills issued.
However, even this simple count does have directionality -- since the shorter this delay, the better.
A metric begins with the thing being measured. The measurand is the "entity quantified by the
measure"2. Important kinds of measurands in the BMS work include:
Page 8 of 40
A benchmark generally suggests that a number or set of numbers is available for the metric
that is indicative of either an average or a target for the industry. While the BMS team is
responsible for defining business metrics, the Benchmarking team is responsible for running
benchmarking studies using these metrics, which generates reports containing benchmark
numbers, both average and 80-percentile values, among others.
A dimension is a breakdown scheme for a metric. For example, a metric like "Revenue" can be
dimensioned by region, by service, by market segment, etc. or indeed by any combination of
these. Ideally, a dimension should not be part of a metric name, since one can instantiate many
metrics from one metric by running through all combinations of dimensions -- and that just leads
to clutter.
Note that Frameworx business metrics are service offering (SO) agnostic, and as such can be
dimensioned by any appropriate service. That means that the same metric (F-CE-2a Mean
Duration to Fulfill ) would be used to study service fulfillment time for residential broadband,
mobile services, or IP VPNs. Obviously, the data collected would be quite different. Thus, it is
generally not appropriate, for example, to compare a fulfillment metric for mobile service against
a fulfillment benchmark for DSL service.
Page 9 of 40
Format: # <business-objects>
Example: # Bills
Format: # <business-objects> <qualification>
Example: # Bills Issued
3 http://office.microsoft.com/en-ca/excel-help/define-and-use-names-in-formulasHA102749565.aspx#_Toc312073993
GB935, Version 7.0
Page 10 of 40
Note: It is important to follow the metric format exactly. Thus it is "# Bills", not "# of Bills",
not "# Bills Total", not "Number of Bills", etc.
Type: Valuation
Since currency is a count of dollars, it is similar to a count, except that the business
object is not countable, but rather a financial concept that can be "evaluated".
Format: $ <financial-object>
Example: $ Revenue
Note: A native financial concept (like cost or revenue) is easily understood to be
"evaluatable". But if the item being evaluated is not a native financial concept, like the
money value of bills issued, we precede the object with "value of". Thus bills, which can
either be counted or evaluated, need require the expression "$ Value of Bills" to clearly
indicate we mean the dollar value and not the count of bills.
Description: There are some BMS ratios that are really not ratios, but needed to be
expressed as a numerator over denominator of 1 for historical modeling reasons.
Description: Some of the metric names do not follow the above canonical rules. This
occurs when a common industry name is preferred. Thus, rather than saying "%
Customer Requests Resolved on First Call", we prefer to use the common industry
name "First Call Resolution (FCR)". Since industry names exist independently of our
naming convention, we denote these as Special Names.
Example: First Call Resolution (FCR)
Page 11 of 40
Description: A few metrics are explicitly dimensioned by just one dimension value. For
example, rather than metric by "Service Type", it is a metric "By Voice Services" only.
The construction is similar to the preceding, except there is no "Type" at the end.
Format: <metric-name-type> , by <dimension-value>
Example: % Revenue, by Voice Services
Other Patterns
Note that other patterns also recur within the metric names:
If a business object's time between two states is being measured, expressions like "from
<state1> to <state2>" appear, as in "# Hours for all Orders, from Ordering to Activation".
Generic metric words that can be used everywhere (like Average, Mean or Total) are
avoided. The word Mean is actually reserved for the benchmarking reports -- as in the
mean of a metric given that the sample data has come from many CSPs. Otherwise,
without these conventions, we would end up having a "Mean of a Mean", which is a bit
unwieldy.
To distinguish the time for one instance of a business object versus the aggregate time
for all instances, the word "All" is used, as in "# Hours for All Orders" (an aggregate)
versus "#Hours per Order" (an average or mean).
Page 12 of 40
Assess business health, identify problem areas and drive focused improvement
Support business case, budgeting and investment decisions and
Track business performance against best-in-class peers based on geography, size
and service offering.
The BMS Business Metrics are based on a scaffold that targets business performance based on
a balanced scorecard. The balanced scorecard looks at financial, customer-oriented and
process oriented measures.
2.3.1. Domain
Comparing performance indicators in each of the 3 areas of the balanced scorecard are
required for a 360-degree view (Figure 1)
The metrics have been developed to be service agnostic and to be applicable across existing
and future service offerings. A service change or an addition of a new service will not have an
impact on the definition of the metric.
GB935, Version 7.0
Page 13 of 40
2.3.3. Topic
In addition to the process detail, topic areas are used to ensure that the metrics are organized in
a clear fashion. The topic areas are defined by Balanced Scorecard Domain as;
Page 14 of 40
1. Preferred Access
2. Customer Time Spent
3. Usability
4. Accuracy
5. Contact Availability
6. Ease of Doing Business
7. Pricing Flexibility
8. Security
Operational Efficiency
1. Unit Cost
2. Time
3. Rework
4. Simplicity
5. Process Flexibility
6. Utilization
Each metric has a domain, process focus, and topic. The decomposition of domains according
to process is applied to Customer Experience and Operational Efficiency. Revenue and Margin
maintains an overall, general view of the service offering, and is not broken down further.
Metrics have been defined for combinations of domain, process focus and topic. The resultant
high-level scaffold is described further in The Business Metrics Scaffold.
In some cases, it has been appropriate to position the metrics with a lower level of granularity.
For this purpose, modifying details have been defined for certain metrics. An example of
modifying detail is addressing specific customer segments, i.e. Consumer & SME vs. Large
Enterprise & Government. Appendix A contains some of the modifying details (possible
options) that are available for selected metrics.
Page 15 of 40
And Topic Number is a number representing the topics as covered in the Topics section
earlier.
As an example lets assume that we are looking at measuring the performance of the order to a
process for a particular service offering. The order to cash process includes accepting and
validating the customer order, procuring the service, activating the service, billing for the service
and receiving payment for the service. Three metrics that are critical to do this are
Mean Duration to Fulfill the Service Order this represents the time mean time from
customer calling in to and ordering a service until the service is active.
Mean Time from Service Activation to Bill Dispatch
Mean Duration form Bill Dispatch to Cash Received
We will look at each in turn starting with Mean Duration to Fulfill the Service Order.
Fulfilling a Service order is part of the Fulfillment process (Process Focus = F). A service
request initiated by a customer is in the Customer Experience Domain (Domain=CE). The
measurement topic is duration which is time related (Topic = 2) and it happens to be the first
measure developed with this combination. The resulting metric name is
<Process Focus>- <Domain> -<Topic Number>-<a-z>
F-CE-2a
GB935, Version 7.0
Page 16 of 40
The figure below illustrates the metric code structure for F-CE-2a (Mean Duration to Fulfill
Service Order).
Page 17 of 40
Fulfillment
o Selling
o Order Handling (Ordering)
o Service Configuration
o Resource Provisioning
o Service Activation (Activation)
Assurance
o Resource Data Collection & Processing
o Resource Trouble Detection/Handling
o Service Problem Management
o Customer QoS/SLA Management
Billing
o
o
o
o
o
The following figures illustrate the sequence of the stages of the TM Forum Business Metrics
meta-processes.
Page 18 of 40
Page 19 of 40
Page 20 of 40
Page 21 of 40
Definition Section
19. Metric Type: indicates whether direct, ratio, formula, etc. (mandatory)
20. Prose Formula: prose expression of formula, may not be as precise as the XLS Formula
(optional)
21. XLS Formula: precise XLS-compatible formula using XLS named ranges (from XLS
Name field) (mandatory)
22. Prose Ratio: if Metric Type = Ratio, then this is automatically generated as Numerator
Name / Denominator Name (optional)
23. XLS Ratio: if Metric Type = Ratio, then this is automatically generated as Numerator XLS
Name / Denominator XLSName (mandatory if formula with XLS formula = blank)
24. Numerator Metric ID: if Metric Type = Ratio, then this should be a unique identifier
(FxMetric UUID, ID, etc.) for the record in this table that is the Numerator of the ratio
(mandatory if formula with XLS formula = blank)
25. Numerator Name: if Metric Type = Ratio, then this should be the Name field associated
with the Numerator ID, used to automatically generate Prose Ratio (optional and derived
from Numerator FxMetric ID)
26. Numerator XLS Name: if Metric Type = Ratio, then this should be the Name field
associated with the Numerator ID, used to automatically generate XLS Ratio (optional
and derived from Numerator FxMetric ID)
27. Numerator Includes: items included from numerator; this is obtained from the same table
(optional and derived from Numerator FxMetric ID)
28. Numerator Excludes: items excluded from numerator; this is obtained from the same
table (optional and derived from Numerator FxMetric ID)
29. Numerator Units: units for numerator; this is obtained from the same table (optional and
derived from Numerator FxMetric ID)
30. Denominator Metric ID: if Metric Type = Ratio, then this should be a unique identifier
(FxMetric UUID, ID, etc.) for the record in this table that is the Denominator of the ratio
(mandatory if formula with XLS formula = blank)
31. Denominator Name: if Metric Type = Ratio, then this should be the Name field
associated with the Numerator ID, used to automatically generate Prose Ratio (optional
and derived from Denominator FxMetric ID)
32. Denominator XLS Name: if Metric Type = Ratio, then this should be the Name field
associated with the Numerator ID, used to automatically generate XLS Ratio (optional
and derived from Denominator FxMetric ID)
33. Denominator Includes: items included from denominator; this is obtained from the same
table (optional and derived from Denominator FxMetric ID)
34. Denominator Excludes: items excluded from denominator; this is obtained from the
same table (optional and derived from Denominator FxMetric ID)
35. Denominator Units: units for denominator; this is obtained from the same table (optional
and derived from Denominator FxMetric ID)
36. Dependent Metrics: list of metrics that use this metric in calculation (optional)
Description Section
37. Description: text description of the metric (recommended)
38. Comments: general remarks about the metric, including how to measure, common
pitfalls, etc. (optional)
39. Includes: business rules for what is included in metric definition (mandatory if formula
with XLS formula = blank)
40. Excludes: business rules for is excluded in metric definition (mandatory if formula with
XLS formula = blank)
GB935, Version 7.0
Page 22 of 40
Page 23 of 40
66. TAM Linkages: list of Names from TAM, that are relevant in the metric definition (future
use)
67. Actor Linkage: list of comma-delimited Actor Names related to metric (future use)
68. Other Linkages: related actors, stakeholders, capabilities, ecosystem components, etc.
(future use)
69. XLS Fields: list of comma-delimited XLS fields extracted from XLS formula, if applicable
(future use)
Legacy Section
70. Legacy Name: old metric prose name, for data quality tracking (optional)
71. Legacy Prose Formula: old metric prose formula, for data quality tracking (optional)
72. Legacy Prose Ratio: old metric prose ratio, for data quality tracking (optional)
73. Legacy Numerator FxMetric ID: old metric numerator ID, for data quality tracking
(optional)
74. Legacy Numerator Name: old metric numerator name associated with ID, for data quality
tracking (optional)
75. Legacy Denominator FxMetric ID: old metric denominator ID, for data quality tracking
(optional)
76. Legacy Denominator Name: old metric denominator name associated with ID, for data
quality tracking (optional)
77. Legacy Factor: old metric includes and excludes, if measure/factor (optional)
78. Legacy Links: old metric linkages (optional)
Page 24 of 40
Capability
Stakeholder
Money
Artifact (a document, information record, or other business object, like a bill, a payment,
a problem report, etc.)
Occurrence (an initiative, process, behavior or event, that takes place in time)
Resource (a tangible or intangible material used to deliver products/services to
customers)
The list of measurands used in this release of the BMS metrics is as follows:
Capability
o assurance
o repair (a subset of assurance)
o repair and maintenance (a subset of assurance)
o billing
o channel (may overlap Marketing & Sales and CRM)
o collections (a subset of billing)
Page 25 of 40
Page 26 of 40
Resource
o future infrastructure build
o revenue system
o customer service
Using this taxonomy, for example, the metric "Average Handle Time" has a measurand of
"occurrence.customer_request", since it represents the time to handle a customer request,
which is a kind of business occurrence. The list of measurands will help keep the list of nouns
used in metrics to a manageable level.
Page 27 of 40
distinguish between atomic and derived benefits. Atomic benefit statements are benefit statements
that represent the most elemental forms of value (or "anti-value" in the case of cost). Atomic benefits
are the benefits that are necessary for a balanced view of performance. While one can try to reduce
everything to money, a mature business understanding appreciates that customer and market
benefits may not always be easily correlated to financial performance. Here is a running list of BMS
benefit statements to date that we consider to be atomic, grouped by topic.
Revenue
o increase revenue
o decrease time to revenue
o decrease revenue loss
Cost
o decrease operating cost
o increase margin
Customer
o increase customer satisfaction
Market
o decrease time to market
o increase marketshare
Value Drivers
We define a value driver as an atomic benefit statement, or a sequence of benefit statements that
causally lead to an atomic benefit. A sequence of benefit statements can be chained using the "->"
(leads to) symbol. Below are the benefit statements used as value drivers in the current list of BMS
metrics. Only metrics with a non-blank "Preferred" value (meaning we prefer them to tend higher or
lower), are canonical metrics, and as such will have an associated value driver.
Revenue
o increase revenue
o decrease revenue loss
o decrease information loss -> decrease revenue loss
o decrease process time -> decrease time to revenue
Cost
o decrease operating cost
o decrease excessive contacts -> decrease operating cost
o decrease problems -> decrease operating cost
o decrease process time -> decrease operating cost
o increase productivity -> decrease operating cost
o increase margin
Customer
o increase customer satisfaction
o decrease customer risk -> increase customer satisfaction
o decrease excessive contacts -> increase customer satisfaction
o decrease problems -> increase customer satisfaction
o decrease waiting time -> increase customer satisfaction
o increase productivity -> increase customer satisfaction
Market
Page 28 of 40
o
o
Page 29 of 40
Awareness/Acquisition: This is the stage during which the service provider attempts
to reach a prospective customer and/or the customer becomes aware of the service
provider. The provider can position messages which the customer observes and
reacts to. The customer can learn about offerings the provider informs the market
about.
Page 30 of 40
Interaction/CRM: Unlike the other stages, interaction can occur at any point in the
lifecycle although it is a natural consequence of Awareness/Acquisition. The provider
persuades the customer about their value proposition and engages in further
dialogue with the customer. Perhaps the customer contacts the providers call center,
visits the providers store or goes to the providers website. The provider responds to
the customers queries about products and prices. The customer may request
marketing literature or a demonstration to which the service provider responds.
o
Agreement/Fulfillment: This is the stage when the customer and provider enter into a
commitment ranging from a simple one-time transaction to a complex multi-year
relationship. The customer can specify their needs and the provider proposes a
solution, whether consumer or enterprise. Here is where the purchase occurs and
orders are placed. By the end of this phase the provider has provisioned the offering
and the customer has received the product.
o
The second group consists of three stages relating to the customer Using the service, while
the provider is Operating it.
Consumption/Operation: This is the stage when the customer is using the purchased
product and the provider is operating the service. It also encompasses the scenario
where things no longer work. This is to say the customer can no longer use the
product or the provider cannot deliver the service. It also includes terminating the
service.
o
Support Need/Assurance: This is the stage when there is a problem with the service
and the customer reports the problem while the provider resolves it. In the extreme
case the customer returns the product and the provider replaces it. This stage also
covers customer training and education by the provider on how to use the products.
o
Payment/Billing: This stage begins with the provider billing the customer by way of
an invoice. The customer verifies the invoice and may make inquiries to which the
provider gives explanations. Ultimately the customer pays the provider or the
provider initiates collections procedures.
Page 31 of 40
The last group consists of two stages that describe what happens after the transaction is
completed. Will CSP end up Satisfying the customer, who will hopefully end up Advocating
the CSP or service? Does the customer continue, augment or diminish its relationship with the
provider?
Loyalty/Retention: At this stage the transaction comes to a close and the customer
must decide whether to renew the agreement with the provider. The provider is not
only interested in retaining the customer but wants the customer to upgrade their
commitment yielding greater ARPU. If the service provider succeeds in truly inspiring
its customers they will advocate the providers services to family and friends.
o
Page 32 of 40
Page 33 of 40
In order to provide a holistic business-oriented benchmarking and metrics framework, the BMF
has been structured to look like the scorecard first introduced in Basic Structure of the
Business Metrics. Referring to figure 5, the three largest areas of the BMF model correspond to
the three main domains:
Revenue and Margin (in burgundy, running along the top of model)
In the Revenue and Margin domain, the BMF parses out rows based on key groupings of
metrics: Revenue, Profitability (including Margin and Revenue Assurance), Cost (including
OpEx and CapEx), and Churn.
Both the Customer Experience and Operational Efficiency domains consist of columns that
reference the topics described in Basic Structure of the Business Metrics. Due to the number
of topics, they are grouped in the BMF as consolidated topics for simplicity.
Thus in the Customer Experience domain, the consolidated topics (columns) are Access, Time
and Quality. (The Quality grouping consolidates the topics of Usability, Accuracy and
Availability.) Note that the row names are extracted from the Customer Experience Lifecycle.
In the Operational Efficiency domain, the consolidated topics (columns) are Cost, Time, Quality
and Effectiveness. (The Quality grouping consolidates the topics of Defects and Simplicity, while
the Effectiveness grouping consolidates the topics of Process Flexibility & Automation, and
Utilization.) Most of the row names are extracted from eTOM.
Thus the BMF leverages several important model components to build a holistic view of
business benchmarking:
Process categories from eTOM, to ensure we are using standard process naming
conventions
Customer experience categories from the CxLC, to leverage a rich view of the
customer experience.
Page 34 of 40
Figure 10 - F-CE-2a
Using similar logic, the Mean Duration from Service Activation to Bill Dispatch and the Mean
Duration from Bill Dispatch to Cash Received, are both part of the Billing process (Process
Focus = B), they are both part of the service providers internal operational domain (Domain =
OE), and as with the Fulfillment measure both are time related (Topic = 2), The resulting
measure names are B-OE-2c, and B-OE-2d respectively. The last letter is different to indicate a
unique measure in the same Process-Domain-Topic tuple.
Page 35 of 40
Page 36 of 40
Definition
Possible Options
1 Access Media
2 Channel
3 Customer Confirmed
Date
4 Customer Density
5 Customer Request
Complaint
Inquiry
Change
6 Customer Required
Date
7 Defect Type
8 End-Customer
Segment
Consumer, Small/Medium
Business
Large Enterprise,
Government
9 Maintenance Type
customer caused
technology caused
workforce caused
system caused (data
mismatch problems)
other
Page 37 of 40
Term
Definition
Possible Options
10 Market Position
11 Payment Timing
12 Request Category
13 Service Component
Prepaid,
Postpaid
Page 38 of 40
Date Modified
Modified by:
Description of changes
1.1.0
15 June 2005
Mike Kelly
2.1.0
12 June 2006
Alpna Doshi
Paul Winder
Rudi Jetzelsperger
3.0.0
5 May 2008
6 June 2009
Robert Bratulic
5.0.0
18 April 2010
Robert Bratulic
6.0.0
8 August 2010
Beryl Graham
6.1.0
31 August 2010
Alicja Kawecki
6.2.0
19 January 2011
Alicja Kawecki
7.0
31 March 2013
Robert Bratulic
Page 39 of 40
Date Modified
Modified by:
Description of changes
1.0
15 June 2005
Mike Kelly
2.0
12 June 2006
Alpna Doshi
3.0
14 April 2008
Rudi Jetzelsperger
4.0
16 June 2009
Robert Bratulic
5.0
18 April 2010
Robert Bratulic
6.0
01 August 2010
Beryl Graham
7.0
31 March 2013
Robert Bratulic
Revision / Date
Page 40 of 40