Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Access to this document was granted through an Emerald subscription provided by emerald-srm:602779 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald for
Authors service information about how to choose which publication to write for and submission guidelines
are available for all. Please visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company
manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as well as
providing an extensive range of online products and additional customer resources and services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the Committee
on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for digital archive
preservation.
IJPSM
25,3 Using the balanced scorecard to
manage performance in public
sector organizations
166
Issues and challenges
Received 3 March 2010
Revised 12 May 2011
Deryl Northcott
Accepted 25 May 2011 Department of Accounting, AUT Business School,
The Auckland University of Technology, Auckland, New Zealand, and
Tuivaiti Maamora Taulapapa
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
Abstract
Purpose This paper aims to examine the use of the balanced scorecard (BSC) as a performance
management tool in the public sector. Drawing on a New Zealand study of local government organzations
(LGOs), it seeks to identify issues and challenges in implementing the BSC in public sector contexts.
Design/methodology/approach A postal questionnaire was used to solicit public sector
managers views on the usefulness of the BSC and the factors that support or impede its
implementation in practice. Follow-up interviews with selected respondents allowed for more in-depth
exploration of managers experiences of BSC use and outcomes.
Findings The findings reveal low rates of BSC adoption amongst the studied LGOs. Further,
perceived BSC utility is dominated by performance measurement and reporting, while the
performance management role of the BSC remains relatively under-exploited. This study identifies
users perceptions of the key challenges impeding BSC implementation in the public sector, and
highlights their significance for both practice and theory.
Research limitations/implications This paper highlights the need for improved theorisation on
several issues that present particular challenges in public sector BSC practice: modifying the BSC
dimensions, designing measures that capture important qualitative outcomes, identifying the
customer and/or achieving a genuine multi-stakeholder approach, and mapping BSC causality
relationships.
Practical implications Improved awareness of the factors perceived to lead to successful and
unsuccessful BSC implementation may enhance the uptake and utility of the BSC for measuring and
managing performance in public sector organisations.
Originality/value This study examines BSC use in local government, where it has been relatively
under-researched. It adds to prior studies by specifically examining the factors that support and
impede the effective implementation of the BSC in public sector contexts.
Keywords Public sector, Balanced scorecard, Performance management, Local government,
New Zealand, Public sector organizations
Paper type Research paper
causal relationships with desired outcomes. Yet, despite this apparent match between
the BSC and public sector performance management aims, very little of the growing
body of empirical literature on the use and outcomes of the BSC concerns public sector
applications. In particular, there have been few studies to examine the issues and
challenges that exist in public sector BSC implementation.
This paper reports an empirical study of BSC use in a public sector context. It has
dual aims, the first being to extend the examination of BSC use into a relatively
under-researched area of the public sector, local government. Local government
organisations (LGOs) are responsible for achieving multiple goals on behalf of diverse
local stakeholder groups and have, like other public sector organisations, been under
pressure to improve performance outcomes and accountability (Poister and Streib,
1999; Wisniewski and Olafsson, 2004). Since the BSC is potentially well-placed to
support these performance management aims, it is appropriate to examine the use and
outcomes of the BSC in local government contexts. A second aim of this study is to
examine the factors that support and impede the effective implementation of the BSC in
public sector contexts.
The remainder of this paper is structured as follows. First, we review the literature
addressing the perceived benefits, issues and challenges of implementing BSCs in
public sector organisations. The knowledge gaps revealed by this review provide a
basis for developing the motivation for this paper and the key research questions. We
then outline our New Zealand study, providing a contextual background to the
performance management expectations placed on LGOs and describing the research
methods employed. The subsequent section presents findings drawn from both the
postal questionnaire and follow-up interviews and discusses them in relation to the key
research questions. Implications for practice and theory are then discussed, with a
focus on the new insights to emerge from this study. Conclusions and suggestions for
further research are then presented.
BSCs performance management aims, which appears inconsistent with the aims of
most public sector organisations. However, Kaplan and Norton (2001b, p. 98) suggest
that, while originally conceived for profit making firms, the BSC can be readily adapted
for use in public sector organisations simply by rearrang[ing] the scorecard to place
customers or constituents at the top of the hierarchy (Kaplan and Norton, 2001b, p. 98;
see also Niven, 2006). Suitably restructured, they argued the BSC can serve a dual role
in public sector contexts as a measurement instrument to guide performance, and a
means of enhancing democratic accountability and responsibility (Kaplan and Norton,
1992). This view is supported by others who suggest the BSC has utility in the public
sector due to its multi-dimensionality in capturing the non-financial aspects of
performance (Forgione, 1997; Aidemark, 2001; Bilkhu-Thompson, 2003) and its
identification of a limited number of KPIs that provide a clear focus for achieving
organisational strategy in spite of a complex operating environment (Chow et al., 1998;
Modell, 2004).
However, other researchers have expressed reservations about the efficacy of
transplanting management tools like the BSC into complex public sector contexts
(e.g. Arnaboldi and Lapsley, 2004; Pidd, 2005). Notably, Griffiths (2003) identified
problems with demonstrating causal relationships in public sector BSCs, suggesting
that the necessary rearranging of the BSC may not be straightforward in practice and
may impair its performance management potential. However, few studies have
examined how the rearrangement of the standard BSC model works in practice, and
whether the absence of clear financial goals presents a challenge for applying the BSC
Figure 1.
The standard BSC model
and its assumed causal
relationships
to public sector performance management. This paper considers that issue, along with Using the BSC
others that impact BSC implementation in public sector contexts. As background, we to manage
first turn to a brief review of what is known about public sector BSC practice from the
findings of prior research. performance
2.2 The BSC in practice: evidence from the public sector 169
Much of the empirical BSC literature concerns its private sector adoption (e.g. McCunn,
1998; Hoque and James, 2000; Ahn, 2001; Williams, 2001; Lipe and Salterio, 2002; Davis
and Albright, 2004). While there have been far fewer studies of BSC applications in the
public sector (Yeung and Connell, 2006; Greatbanks and Tapp, 2007), recent evidence
suggests that public sector use of the BSC has met with varying degree of success
(Niven, 2005, 2006). Yet the reasons for BSC success or failure in the public sector have
not been well examined. Only a few studies have identified factors that practitioners
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
This literature review has identifed several under-developed areas of the literature
regarding BSC implementation in public sector contexts. First, few studies have
examined how the BSC is modified in practice to suit public sector contexts.
Associated with this is the question of whether reorientating public sector BSCs
away from financial goals complicates the understanding of causality between KPIs
within its four dimensions, thus reducing its utility as a performance management
tool. Second, there has been relatively little attention to practitioners views on the
factors leading to the successful, unsuccessful or non-implementation of public
sector BSCs. In particular, few of the suggested success (or failure) factors seem to
reflect issues and challenges specific to the BSCs use in public sector contexts.
Third, the local government sector is under-represented in studies of BSC practice.
This is despite the fact that LGOs might be expected to benefit from BSC use
because they are obliged to specify strategic goals that balance multiple aims and
stakeholders, and to be accountable for achieving related KPIs. Finally, despite New
Zealand being at the forefront of public sector reform since the 1980s, there have
been few studies of public sector BSC use in that country, and none examining
LGOs.
These knowledge gaps motivated the development of four key research questions
that underpinned our study of BSC use:
(1) Do New Zealand LGOs use the BSC as a performance management tool?
(2) What benefits do managers perceive the BSC to have as a performance
management tool?
(3) What factors contribute to successful BSC implementation?
(4) What are the barriers to successful BSC implementation?
The next section outlines the context for this study and the methods used to explore
these research questions.
indicated their willingness to be contacted for interview[1]. Three of these LGOs were
current BSC users and one was a non-user. Attempts were made to interview the one
survey respondent who indicated their LGO was a previous BSC user, but the request was
declined. The questions used to guide these semi-structured interviews were constructed
after preliminary analysis of the questionnaire responses. The interviews lasted
half-an-hour to one hour and were tape recorded for later transcription. During the
interviews, the interviewer took notes and asked questions about relevant matters arising
from interviewees replies. Analysis of the interview transcripts was via thematic
analysis, i.e. identifying and coding the main themes evident from the interviews.
4. Findings
The findings from the questionnaire and follow-up interviews are presented below in
relation to the four key research questions that guided this study.
4.1 Do New Zealand LGOs use the BSC as a performance management tool?
General awareness of the BSC amongst LGO managers is very high at 91.67 per cent,
with slightly more awareness amongst district councils (94.60 per cent) compared to
city councils (81.81 per cent). However, amongst the 48 responding councils, only eight
(16.67 per cent) are current BSC users. One council no longer uses the BSC, while 39
councils have never used it. Of the four LGOs who participated in follow-up interviews,
two have used the BSC for more than four years while one had implemented it within
the past year (the fourth was a non-user). Two used the BSC throughout the LGO while
one used it within selected business units only.
Table II shows that current BSC use is dominated by city councils (27.3 per cent
usage compared to 13.5 per cent for district councils). One reason for this may be the
increased resources available to undertake such initiatives in the (generally larger) city
Responded Usable
Surveyed n % n %
Table I.
Questionnaire City councils 16 13 81.3 11 68.8
respondents by council District councils 57 37 64.9 37 64.9
type Total 73 50 68.5 48 65.8
councils. This is consistent with Chan (2004), who found that over two-thirds of USA Using the BSC
respondents using the BSC were relatively large municipalities, which were better to manage
resourced for the adoption of new management tools. However, open-ended
questionnaire responses from district council respondents also suggested that performance
smaller LGOs may be less likely to perceive themselves as needing a strategic
approach to performance management. For example:
We never looked at it as an option because we are not a leading edge type of organisation 173
(District Council).
We are a small organisation (60 staff) and tend to focus on day to day operations. There has
not been much, if any, focus on strategic direction (District Council).
The requirements of the Local Government Act have increased our responsibilities, so our
time is spent on meeting these requirements rather than on strategy as such (District Council).
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
4.2 What benefits do managers perceive the BSC to have as a performance management
tool?
Only eight of the 48 surveyed LGOs indicated current use of the BSC, so their views
form the basis for identifying its perceived benefits. When asked to rate the overall
usefulness of the BSC to their organisations (with 1 being not useful and 5 being
very useful) these eight respondents varied somewhat in their ratings (see Table III).
The mean rating of 4 provides a strong indication that current BSC users perceived
the BSC to be highly useful in their organisations. Open-ended survey responses and
interview comments support this view:
The BSC provides focus and clear lines of accountability . . . [and an] ability to measure the
achievement of agreed outcomes (District Council).
The BSC gives management a concise set of information to gauge performance and direct
improvements. It enables more comprehensive reporting to our stakeholders [and] informs
staff as to how successful the organisation has been (City Council).
Current Previous
users users Non-users
Usable responses n % n % n %
It is designed to fit i.e. local government does not try to produce a return on investment as
a company. However, there are huge benefits from local government, which while
identifiable, are hard to quantify. BSC as a multiple stakeholder perspective management tool
can help clarify key measures which can tell if a strategy is working (City Council).
Respondents open-ended survey responses also revealed performance measurement to
be the main perceived benefit of BSC use, followed by strategic management and
reporting. The following quotations illustrate:
The main purpose is to track our performance over all critical activities over time (District
Council).
It helps with a more genuine understanding of the different dimensions of strategic decision
making (District Council).
Targets were set that directed our performance towards achieving our organisations
objectives in areas beyond simple financial outcomes (City Council).
In the follow-up interviews, all three BSC users noted its usefulness for measuring the
performance of staff as well as unit/divisional performance. Some questionnaire
responses also indicated that staff performance measures are built into LGO BSCs.
This accords with Greatbanks and Tapp (2007), who found that the introduction of
individual performance scorecards was supported by staff since these scorecards
provided clear goals as to what activities are viewed by management as important and,
where linked to bonus payments, facilitated an understanding of bonus performance
expectations. Chan (2004) also noted that a lack of linkage between the BSC and the
employee reward system contributed to BSC failure. The use of staff performance
scorecards by some LGOs appears to be a positive step in securing the BSCs
successful implementation, therefore.
The dominant use of the BSC as a performance measurement tool its most simple
form is in line with the use of the first generation BSC (Cobbold and Lawrie, 2002).
However, the intended evolution of the BSC from performance measurement to
performance management is evident in the literature (e.g. Birchard, 1996; Epstein and
Manzoni, 1997; Kaplan and Norton, 1996b; Kaplan and Norton, 1996c; Cobbold and
Lawrie, 2002). This evolution comes with experience in BSC application over time
(Griffiths, 2003) and the maturity of the organisations strategy. The findings of these Using the BSC
prior studies suggest that the longer an organisation has used the BSC, the more to manage
experienced it becomes and the more comprehensively it can utilise the BSC. Of the
three city councils using the BSC, two have used it for more than four years and one performance
implemented it less than one year ago. Of the five district council users, three indicated
they had used it for more than four years, one had used it between three and four years
and one had used it for one to two years. The varying experience of these organisations 175
with the BSC may account for their different focuses on performance measurement and
management.
Using the BSC to facilitate reporting requirements was another implementation
reason cited by current users. According to Griffiths (2003), as an external reporting
tool, the BSC has greater applicability to local government organisations that often
operate in the absence of competitive markets. The BSC has the potential to improve
transparency and accountability, and Wallace (1998) noted that it could be used as the
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
The LGO that had implemented the BSC within the past year, on the other hand,
was better placed at the outset of their implementation to learn from prior cases of BSC
use in public sector settings. This included looking at local adoptions as well as
overseas examples such as the City of Charlotte (USA) and the City of Melbourne
(Australia), which are well documented. The initial decision to implement the BSC in
this LGO was the result of an organisational review to look at what framework to
adopt to give a robust basis for reporting and monitoring (Interviewee, City Council).
The interviewee referred to a circuit breaker team that was set up to research the BSC
and to benchmark best practice to see what approaches other LGOs were using. In
addition to this pre-implementation learning, a post-implementation review was
conducted. It appears that this council took a careful approach to its BSC
implementation, with strong support from top management.
This incremental, learning-based approach by both the early adopter and the recent
adopter LGOs appears to have contributed to successful BSC implementations. This
suggests that learning strategies such as researching previous BSC implementations,
benchmarking against best practice, attending seminars, holding training meetings,
and seeking assistance from consultants could be usefully employed by other councils
who are contemplating BSC use.
4.4.1 Problems with adapting the BSC to suit public sector organisations. The need to
modify the structure and terminology of the BSC to suit public sector organisations has
been noted in the literature (Griffiths, 2003; Kaplan, 2001; Niven, 2006), but the
practical challenges of achieving this are rarely noted. The findings of this study
revealed that, although all the BSC-using LGOs had modified the BSC to fit their
organisations, significant difficulties had been encountered in doing so. At one level,
this problem manifested itself in regard to adapting to the managerial philosophy
behind the BSC:
It required a move from an inputs focus to an outcomes focus, which brought into effect
advanced management ideas and the removing of traditional management philosophies
(Questionnaire response: District Council).
The shift from in-theory thinking to in-practice implementation was difficult
(Questionnaire response: City Council).
The development of strategy maps at an organisational and business group level was a
valuable exercise for considering how we undertake delivery of our products and services.
However, the BSC does not lend itself to describing the what as well as the how, which is a
requirement of comprehensive business planning . . . [so] it sort of breaks down at that point
(Interview: City Council).
At another level, managers struggled with how to construct a BSC with dimensions
and measures suited to the aims and activities of their organisations:
In our game [local government], what is a measure, objective, KPI, input, output, outcome,
leading measure, lagging measure? Working this out is a problem for the overall use of the
tool as an improvement mechanism (Questionnaire response: City Council).
The breadth of the perspectives is limiting. For example, product and service outputs are
addressed, but not leadership and governance, which are just as important to local
government (Interview: City Council).
We found difficulties in applying it [the BSC] in the local government sector. Its just not the
same as a business (Questionnaire response: District Council).
In particular, the definition of the customer and the identification of appropriate
customer-related KPIs proved challenging in practice:
IJPSM Who are our customers? Our revenue is from ratepayers, so we have to convince them we are
doing the right things. But, some of our services are targeted at subsets of the community, so I
25,3 guess you could say that different activities have different customers . . .? Im not sure
(Interview: City Council).
The councils approach to performance in [the pre-BSC] days was very much of a financial
nature, so it was difficult to suddenly define and focus on customers. Deciding what
178 performance indicators to use was a nightmare! (Interview: City Council).
Like these managers, several others noted the challenge of identifying appropriate
performance indicators for inclusion in a BSC designed to meet the organisations
needs. Kaplan and Norton, (1992, 1993) suggested that the selection of measures is a
key activity that should focus on information relevant to the implementation of
strategic plans. The number of measures should be limited, therefore. In the public
sector context often characterised, as it is in LGOs, by a multiplicity of activities,
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
outputs and objectives a particular concern is how to keep the number of KPIs down
to an appropriate level while still representing the diversity of organisational aims:
Because our operations are very broad and diverse, it was difficult to agree a concise set of
measure that covered all our key objectives (Questionnaire response: City Council).
We have too many measures. We are not picking up measures that track performance as
others see us (Questionnaire response: District Council).
You could have brilliant identical objectives for staff, but the services the staff are working on
might be parks, libraries, [or] resource consents, so these services have different attributes
that need to be measured. How can you include all of that? (Interview: City Council).
The findings of this study reveal that modifying the BSC to suit the public sector is far
from straightforward in practice. Local government managers struggled to adapt to the
BSCs outcomes-based philosophy, define their customer, identify appropriate BSC
dimensions, and select a workable number of useful KPIs all necessary steps in
translating the BSC to suit their organisations needs. Many of these challenges are
specific to the public sector, created by its lack of defined customers and clear financial
goals. Others, such as selecting appropriate KPIs, are a concern for any organisation
implementing a BSC, but are made more problematic by the complexities of the public
sector context. The challenge of adapting the BSC framework needs special
consideration in public sector organisations, therefore.
4.4.2 Problems with mapping causality. The second key practical challenge revealed
by this study is how to identify and incorporate causal relationships within a public
sector BSC. Cause-and-effect links amongst performance measures are central to the
performance management role of the BSC, allowing managers to focus on leading
indicators which facilitate prediction, learning and innovation (Kaplan and Norton,
1992; Malina and Selto, 2004). Some comments from LGO managers confirmed that
they recognised the importance of BSC causality for directing managerial attention to
key activities that drive desired outcomes. For example:
[Using the BSC], management can focus on performance improvement of specific target areas
that contribute to achieving strategic objectives . . . and on being proactive rather than
reactive (Questionnaire response: District Council).
However, identifying these causal relationships and building them into the BSC were Using the BSC
seen as significant challenges in practice, as the following quotations illustrate: to manage
The alignment of measures to strategic direction was not an easy task (Questionnaire performance
response: City Council).
It was difficult to create causal connections between outcomes, outputs and inputs
(Questionnaire response: District Council). 179
What causes something else? How can we tell? Theres so much going on so many
influences on our outcomes, including some we cant control that the cause and effect is just
a guess, really (Interview: City Council).
This problem is not unique to the public sector. Indeed, previous research has revealed
that many organizations, both public and private, implement the BSC without due
consideration of causal effects (e.g. Malmi, 2001; Griffiths, 2003; Speckbacher et al.,
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
2003; Ittner et al., 2003; Othman, 2006). However, the previously described challenges in
constructing BSCs to suit public sector environments undoubtedly exacerbate this
problem. While empirical studies have pointed to the existence of at least some causal
links in implemented BSCs (e.g. Hoque and James, 2000; Davis and Albright, 2004;
Malina et al., 2007), none have done so in public sector contexts. The findings of this
study suggest that BSC causality remains especially opaque to public sector managers,
and point to the need for further research into this barrier to successful BSC
implementation.
.
post-implementation review.
Some of the BSC implementation issues faced by public sector managers appear to be
universal in nature, therefore. However, this study has also highlighted three
implementation challenges of particular importance within the public sector.
First, the findings of this study suggest that a lack of a perceived strategic
orientation within public sector organisations may be a barrier to BSC adoption. Since
BSC design must flow from strategy, its effective use is predicated on an assumption
that the organisation is strategy driven. Some participants in this study did not
perceive this to be the case in their organisations. This points to a need for public sector
organisations to communicate strategy clearly to managers, so they see their roles and
activities as linked to key strategic outcomes and are therefore better placed to exploit
the potential benefits of the BSC as a performance management tool.
A second issue concerns the necessary modification of the BSC to suit an
organisations context. Adapting the BSC was considered particularly challenging
amongst the public sector organisations examined in this study. In particular,
managers cited problems with deciding on the appropriate dimensions to include in the
BSC, defining the customer, and identifying a manageable number of appropriate KPIs
given the range and complexity of organisational activities. In light of these concerns,
it would be useful for public organisations to start with a BSC template that has been
adapted for the characteristics of their sector (e.g. Niven, 2006, p. 12), rather than taking
the standard Kaplan and Norton (1992) model as a departure point. In this way,
potential BSC users are better guided in recognising that the BSC needs to look
different in the public sector, rather than trying to emulate business-like
management tools at the expense of organisational fit. Also, public sector managers
should seek to learn from other organisations that have developed (and perhaps
modified with experience) suitable BSC frameworks. This benchmarking needs to
concentrate on public sector exemplars, since concerns about BSC architecture will
differ in the private sector.
Third, a key finding of this study is that BSC causality may be particularly poorly
understood and under-developed in the public sector. While causal links between its
dimensions are considered crucial to the BSCs performance management role, Bukh
and Malmi (2005, p. 93) point to Kaplan and Nortons argument that performance
measures should be derived from assumed cause-and-effect relationships, and note
that these assumptions may ultimately prove to be wrong. In order to correct any Using the BSC
flawed assumptions, some researchers advise that organisations attempt to validate to manage
assumed causal relationships when performance data becomes available over time
(Stemsrudhagen, 2004; Bukh and Malmi, 2005; Chenhall, 2009). Others suggest that, in performance
practice, BSC users may simply believe in the assumed causal relationships without
ever testing them (Nrreklit and Mitchell, 2007), and that this belief alone may be
sufficient to underpin the BSCs motivational and attention-directing roles (Sundin 181
et al., 2010).
The findings of this study suggest that a simple belief in BSC causal relationships
may be harder to sustain in public sector contexts where managers feel their
organisation lacks a clear strategic direction and see organisational outcomes as
shaped by external forces beyond their control (e.g. legislation, policy and politics).
Without such belief, the power of the BSC as an attention-directing performance
management tool is undermined. Empirical testing of causal relationships may
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
These suggestions for practice also point to some implications for BSC theory. First,
the literature is largely silent on the challenges of modifying the BSC to suit public
sector use. It is assumed in adaptations such as Nivens (2006, p. 12) that the BSC can
be readily re-orientated to locate customer-related measures as the ultimate, lagging
indicators of performance in place of financial outcomes. Yet, problems with executing
this reorientation in practice are perceived as a barrier to BSC implementation in the
public sector. Further, the findings of this study support prior observations that
practical difficulties exist in measuring intangible public sector outcomes
IJPSM (e.g. Cavalluzzo and Ittner, 2004; Wisniewski and Olafsson, 2004). Further empirical
25,3 studies and theoretical development are therefore needed in the area of BSC design if
useful guidance is to be offered to public sector managers seeking to harness the BSCs
performance management potential. In particular, BSC theory is currently weak on the
issues of when (and what) additional (or substitute) BSC dimensions might be
appropriate in public sector contexts, designing measures that capture important
182 qualitative outcomes, and steps for identifying the customer and/or achieving a
genuine multi-stakeholder approach.
Second, since mapping BSC causality is recognised as a particular challenge in
public sector practice, there is a need to develop empirical research and theorising in
this area. While concerns about the existence, nature and testing of BSC
cause-and-effect relationships is a matter of ongoing debate in the general BSC
literature (e.g. Brignall, 2002; Nrreklit, 2000, 2003; Davis and Albright, 2004; Bukh and
Malmi, 2005; Malina et al., 2007), it has not been examined in public sector practice,
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
despite the BSC being advocated as a useful performance management tool in this
context. Further research and theoretical development is required to inform this aspect
of BSC implementation in the public sector, therefore.
Note
1. No district council respondents were willing to be interviewed.
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
References
Ahn, H. (2001), Applying the balanced scorecard concept: an experience report, Long Range
Planning, Vol. 34, pp. 441-61.
Aidemark, L. (2001), The meaning of balanced scorecards in the health care organisation,
Financial Accountability and Management, Vol. 17 No. 1, pp. 23-40.
Aidemark, L. and Funck, E.K. (2009), Measurement and health care management, Financial
Accountability & Management, Vol. 25 No. 2, pp. 253-76.
Arnaboldi, M. and Lapsley, I. (2004), Modern costing innovations and legitimation: a health care
study, Abacus, Vol. 40 No. 1, pp. 1-20.
Basset, M. (1988), Statement on Reforms of Local and Regional Government, New Zealand
Government, Wellington.
Beechey, J. and Garlick, D. (1999), Using the balanced scorecard in banking, Australian Banker,
Vol. 113 No. 1, pp. 28-35.
Beechey, J.A. (2005), Performance measurement and management: concept and practice in local
government in New Zealand, unpublished MPhil thesis, University of Waikato, Hamilton.
Bilkhu-Thompson, M.K. (2003), A process evaluation of a health care balanced scorecard,
Journal of Health Care Finance, Vol. 30 No. 2, pp. 37-64.
Birchard, B. (1996), Cigna P & C: a balanced scorecard, CFO: The Magazine for Chief Financial
Officers, Vol. 12 No. 10, pp. 30-4.
Blundell, B., Sayers, H. and Shanahan, Y. (2003), The adoption and use of the balanced scorecard
in New Zealand: a survey of the top 40 companies, Pacific Accounting Review, Vol. 15
No. 1, pp. 49-74.
Boston, J., Martin, J., Pallot, J. and Walsh, P. (Eds) (1996), Public Management: The New Zealand
Model, Oxford University Press, Auckland.
Brignall, T.J.S. (2002), The unbalanced scorecard: a social and environmental critique, in Neely, A.,
Walters, A. and Austin, R. (Eds), Performance Measurement and Management: Research and
Action, Cranfield School of Management, Cranfield.
Bukh, P.N. and Malmi, T. (2005), Re-examining the cause-and-effect principle of the balanced
scorecard, in Jonsson, S. and Mouritsen, J. (Eds), Accounting in Scandinavia: The Northern
Lights, Liber, Stockholm/Copenhagen Business School Press, Copenhagen.
Cavalluzzo, K.S. and Ittner, C.D. (2004), Implementing performance measurement innovations:
evidence from government, Accounting, Organizations and Society, Vol. 29 Nos 3/4,
pp. 243-67.
IJPSM Chan, Y.C.L. (2004), Performance measurement and adoption of balanced scorecards: a survey of
municipal governments in the USA and Canada, The International Journal of Public
25,3 Sector Management, Vol. 17 No. 3, pp. 204-21.
Chang, L., Lin, S.W. and Northcott, D.N. (2002), The NHS performance assessment framework:
a balanced scorecard approach?, Journal of Management in Medicine, Vol. 16 No. 5,
pp. 345-58.
184 Chenhall, R.H. (2009), Developing integrative performance management systems, in Baxter, J.
and Poullaos, C. (Eds), Practices, Profession and Pedagogy in Accounting: Essays in
Honour of Bill Birkett, Sydney University Press, Sydney.
Chow, C.W., Ganulin, D., Haddad, K. and Williamson, J. (1998), The balanced scorecard: a potent
tool for energizing and focusing healthcare organization management, Journal of
Healthcare Management, Vol. 43 No. 3, pp. 263-80.
Chow-Chua, C. and Goh, M. (2002), Framework for evaluating performance and quality
improvement in hospitals, Managing Service Quarterly, Vol. 12 No. 1, pp. 54-66.
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
Cobbold, I. and Lawrie, G. (2002), The development of the balanced scorecard as a strategic
management tool, paper presented at the PMA Conference, Boston, MA.
Davis, S. and Albright, T. (2004), An investigation of the effect of the balanced scorecard
implementation on financial performance, Management Accounting Research, Vol. 15
No. 2, pp. 135-53.
Epstein, M.J. and Manzoni, J. (1997), The balanced scorecard and tableau de bord: translating
strategy into action, Management Accounting, Vol. 79 No. 2.
Forgione, D.A. (1997), Health care financial and quality measures: international call for a
balanced scorecard approach, Journal of Health Care Finance, Vol. 24 No. 1, pp. 55-8.
Greatbanks, R. and Tapp, D. (2007), The impact of balanced scorecards in a public sector
environment, International Journal of Operations and Production Management, Vol. 27
No. 8, pp. 846-73.
Griffiths, J. (2003), Balanced scorecard use in New Zealand government departments and crown
entities, Australian Journal of Public Administration, Vol. 62 No. 4, pp. 70-9.
Hallman, P. (2005), The role of causality in the balanced scorecard framework, Masters thesis,
Department of Industrial Economics and Management, Royal Institute of Technology,
Stockholm.
Hood, C. (1995), The new public management in the 1980s: variations on a theme, Accounting
Organizations and Society, Vol. 20 Nos 2/3, pp. 93-100.
Hoque, Z. and James, W. (2000), Linking balanced scorecard measures to size and market
factors: impact on organisational performance, Journal of Management Accounting
Research, Vol. 12, pp. 1-17.
Inamdar, N. and Kaplan, R.S. (2002), Applying the balanced scorecard in healthcare provider
organizations, Journal of Healthcare Management, Vol. 47 No. 3, pp. 179-96.
IPART (2003), Inspirit management services review using information to drive change in
NSW public hospitals, attachment to NSW health: focusing on patient care: independent
pricing and regulatory tribunal (IPART) report, August, available at: www.health.nsw.
gov.au/ipart/attachments/att_8.pdf
Ittner, C. and Larcker, D. (2003), Coming up short on nonfinancial performance measurement,
Harvard Business Review, November, pp. 88-95.
Ittner, C., Larcker, D. and Randall, T. (2003), Performance implications of strategic performance
measurement in financial firms, Accounting, Organizations and Society, Vol. 28 Nos 7/8,
pp. 715-41.
Jackson, A. and Lapsley, I. (2003), The diffusion of accounting practices in the new managerial Using the BSC
public sector, The International Journal of Public Sector Management, Vol. 16 Nos 4/5,
pp. 359-72. to manage
Kald, M. and Nilsson, F. (2000), Performance measurement at Nordic companies, European performance
Management Journal, Vol. 18 No. 1, pp. 113-27.
Kaplan, R.S. (2001), Strategic performance measurement and management in nonprofit
organisations, Nonprofit Management and Leadership, Vol. 11 No. 3, pp. 353-70. 185
Kaplan, R.S. and Norton, D.P. (1992), Balanced scorecard measures that drive performance,
Harvard Business Review, Vol. 70 No. 1, pp. 71-9.
Kaplan, R.S. and Norton, D.P. (1993), Putting the balanced scorecard to work, Harvard Business
Review, Vol. 71 No. 51, pp. 134-42.
Kaplan, R.S. and Norton, D.P. (1996a), Linking the balanced scorecard to strategy, California
Management Review, Vol. 39 No. 1, pp. 53-79.
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
Kaplan, R.S. and Norton, D.P. (1996b), Using the balanced scorecard as a strategic management
system, Harvard Business Review, Vol. 74 No. 1, pp. 75-85.
Kaplan, R.S. and Norton, D.P. (1996c), The Balanced Scorecard: Translating Strategy into Action,
Harvard Business School Press, Boston, MA.
Kaplan, R. and Norton, D.P. (2001a), The Strategy-focused Organization: How Balanced Scorecard
Companies Thrive in the New Business Environment, Harvard Business School Press,
Boston, MA.
Kaplan, R.S. and Norton, D.P. (2001b), Transforming the balanced scorecard from performance
measurement to strategic management: part 1, Accounting Horizons, Vol. 15 No. 1,
pp. 87-104.
Kloot, L. and Martin, J. (2000), Strategic performance measurement: a balanced approach to
performance management issues in local government, Management Accounting Research,
Vol. 11 No. 2, pp. 231-51.
Lapsley, I. and Wright, E. (2004), The diffusion of management accounting innovations in the
public sector: a research agenda, Management Accounting Research, Vol. 15 No. 3,
pp. 355-74.
Lipe, M.G. and Salterio, S. (2002), A note on the judgement effects of the balanced scorecards
information organisation, Accounting, Organizations and Society, Vol. 27 No. 6, pp. 531-40.
Lord, B.R., Shanahan, Y.P. and Gage, M.J. (2005), The balanced scorecard: a New Zealand
perspective, Pacific Accounting Review, Vol. 17 No. 1, pp. 49-77.
McAdam, R. and Walker, T. (2003), An inquiry into balanced scorecards within best value
implementation in UK local government, Public Administration, Vol. 81 No. 4, pp. 873-92.
McCulloch, B.W. (1993), New Zealand leads in government management reforms,
The Government Accountants Journal, Vol. 42 No. 1, pp. 27-32.
McCunn, P. (1998), The balanced scorecard: the eleventh commandment, Management
Accounting, December, pp. 34-7.
McJarrow, S. and Cook, T. (2000a), Balanced scorecard: the first generation, Chartered
Accountants Journal, Vol. 79 No. 3, pp. 4-8.
McJarrow, S. and Cook, T. (2000b), Balanced scorecard: what happens in real life, Chartered
Accountants Journal, Vol. 79 No. 4, pp. 30-3.
Macdonald, D.J.D. (2002), Local government: looking back and looking forward, Office of the
Auditor General, Wellington, available at: www.oag.govt.nz/2002/looking-back/.
IJPSM Malina, M.A. and Selto, F.H. (2004), Causality in performance measurement model, available at:
www.bibsonomy.org/bibtex/22dee41a95589fb13b89f13eb9f0c4c12/stefan.strecker?
25,3 layoutharvardhtml
Malina, M.A., Nrreklit, H.S.O. and Selto, F.H. (2007), Relations among measures, climate of
control, and performance measurement models, Contemporary Accounting Research,
Vol. 24 No. 3, pp. 935-82.
186 Malmi, T. (2001), Balanced scorecards in Finnish companies: a research note, Management
Accounting Research, Vol. 12 No. 2, pp. 207-20.
Modell, S. (2004), Performance measurement myths in the public sector: a research note,
Financial Accountability & Management, Vol. 21 No. 1, pp. 39-55.
Niven, P.R. (2005), Balanced Scorecard Diagnostics: Maintaining Maximum Performance, John
Wiley & Sons, Hoboken, NJ.
Niven, P.R. (2006), Balanced Scorecard Step-by-step for Government and Nonprofit Agencies,
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
Developing a national performance indicator framework for the Dutch health system,
International Journal for Quality in Health Care, Vol. 16 No. 1, pp. 65-71.
Wallace, B. (1998), Studying the balanced scorecard, New Zealand Management, Vol. 45 No. 7,
pp. 44-5.
Wallis, J. and Dollery, B. (2002), Wolfs model: government failure and public sector reform in
advanced industrial democracies, The Review of Policy Research, Vol. 19 No. 1,
pp. 177-203.
Williams, S. (2001), Drive your business forward with the balanced scorecard, Management
Services, June, pp. 28-30.
Wisniewski, M. and Olafsson, S. (2004), Developing balanced scorecards in local authorities:
a comparison of experience, International Journal of Productivity and Performance
Management, Vol. 53 No. 7, pp. 602-10.
Yeung, A.K. and Connell, J. (2006), The application of Nivens balanced scorecard in a
not-for-profit organization in Hong Kong: what are the factors for success?, Journal of
Asia Business Studies, Vol. 1 No. 1, pp. 26-33.
Zelman, W.N., Pink, G.H. and Matthias, C.B. (2003), Use of the balanced scorecard in health
care, Journal of Health Care Finance, Vol. 29 No. 4, pp. 1-16.
Corresponding author
Deryl Northcott can be contacted at: deryl.northcott@aut.ac.nz
188
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
Figure A1.
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
performance
to manage
Using the BSC
Figure A1.
189
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
25,3
190
IJPSM
Figure A1.
Using the BSC
to manage
performance
191
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
Figure A1.
1. Eungdo Kim, Soyoung Kim, Hongbum Kim. 2017. Development of an evaluation framework for publicly
funded R&D projects: The case of Korea's Next Generation Network. Evaluation and Program Planning
63, 18-28. [CrossRef]
2. MoullinMax Max Moullin m.moullin@shu.ac.uk Max Moullin is the Director of the Public Sector
Scorecard Research Centre and a Visiting Fellow at the Sheffield Business School where he was a Principal
Lecturer for over 25 years. He is a Fellow of the Chartered Quality Institute and the Operational Research
Society and author of the book Delivering Excellence in Health and Social Care. Sheffield Business
School, Sheffield Hallam University, Sheffield, UK . 2017. Improving and evaluating performance with the
Public Sector Scorecard. International Journal of Productivity and Performance Management 66:4, 442-458.
[Abstract] [Full Text] [PDF]
3. PorporatoMarcela Marcela Porporato porpomar@yorku.ca Dr Marcela Porporato is an Associate Professor
of Accounting at the York University. Her research studies how management control systems arise
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
and evolve in turbulent environments such as regional economies of emerging countries. She teaches
management accounting at undergraduate and graduate levels. Her work has been exposed in recognized
conferences and published in peer-reviewed journals both in English and Spanish. TsasisPeter Peter Tsasis
tsasis@yorku.ca Dr Peter Tsasis is an Associate Professor jointly appointed to the Faculty of Health
and the Faculty of Liberal Arts and Professional Studies at the York University. His current research
interests focus on the nature and dynamics of structural conditions and social norms in which patterns
of relationships are developed and enacted in organizations. Dr Tsasis is also a Fellow with the American
College of Healthcare Executives and is Board Certified with the Canadian College of Health Leaders
Marin VinuesaLuz Maria Luz Maria Marin Vinuesa luzmaria.marin@unavarra.es Dr Luz Maria Marin
Vinuesa is an Assistant Professor of Accounting at the Public University of Navarra. She obtained her PhD
in 2008 (extraordinary award of Doctoral Thesis). Her research interests are performance management
systems, and especially studies the usefulness of non-financial performance measures to managing business
strategies. She has published in peer-reviewed journals both in English and Spanish. Faculty of Liberal
Arts and Professional Studies, York University, Toronto, Canada Universidad Publica de Navarra, Navarra,
Spain . 2017. Do hospital balanced scorecard measures reflect cause-effect relationships?. International
Journal of Productivity and Performance Management 66:3, 338-361. [Abstract] [Full Text] [PDF]
4. http://orcid.org/0000-0003-3097-0406 DimitropoulosPanagiotis Panagiotis Dimitropoulos
pdimitrop@yahoo.com KosmasIoannis Ioannis Kosmas johndopapkosmas@gmail.com DouvisIoannis
Ioannis Douvis john_douvis@yahoo.com Department of Sport Management, University of Peloponnese,
Sparta, Greece Division of Sport, Culture and Environment, City of Papagos-Holargos, Athens, Greece .
2017. Implementing the balanced scorecard in a local government sport organization. International Journal
of Productivity and Performance Management 66:3, 362-379. [Abstract] [Full Text] [PDF]
5. NuhuNuraddeen Abubakar Nuraddeen Abubakar Nuhu nuraddeen.nuhu@mq.edu.au BairdKevin Kevin
Baird kevin.baird@mq.edu.au Bala AppuhamilageAppuhami Appuhami Bala Appuhamilage ranjith.bala-
appuhamilage@mq.edu.au Accounting and Corporate Governance, Macquarie University, Sydney,
Australia . 2017. The adoption and success of contemporary management accounting practices in the
public sector. Asian Review of Accounting 25:1, 106-126. [Abstract] [Full Text] [PDF]
6. MalbaiIvan Ivan Malbai Ivan Malbai is an Assistant Professor at the Faculty of Organization
and Informatics, University of Zagreb. He is teaching courses at the undergraduate and graduate
level in Organization, Management, and Organizational Behaviour. His main research and publications
concern the role of organizational values in business, organizational behaviour, public management, and
organizational effectiveness in general. MarimonFrederic Frederic Marimon Frederic Marimon, PhD in
Business Administration, is a Professor in the International University of Catalonia (Spain) and in
the University of Girona (Spain). He did Industrial Engineering from the Polytechnic University of
Catalonia in Barcelona, and Master in Business and Administration from IESE in Barcelona. He is
focussed on production area, mainly in quality, e-quality measurement and in services companies. Mas-
MachucaMarta Marta Mas-Machuca Marta Mas-Machuca is graduated in Business Administration from
the University of Navarra and got her PhD from the Universitat Politcnica de Catalunya (UPC). She
is a PhD Lecturer at the Universitat Internacional de Catalunya (UIC) and a Member of Scientific
Committee of the Chair in Management by Mission and Corporate Governance (UIC). Her main research
focusses on the knowledge management and mission-driven companies. Faculty of Organization and
Informatics, University of Zagreb, Varadin, Croatia Universitat Internacional de Catalunya, Barcelona,
Spain Department of Business Management, Universitat Internacional de Catalunya, Barcelona, Spain .
2016. Is it worth having focused values?. Management Decision 54:10, 2370-2392. [Abstract] [Full Text]
[PDF]
7. SoysaIshani Buddika Ishani Buddika Soysa Ishani Buddika Soysa (BSc Hons, MSc), formerly a
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)
Lecturer in Engineering Mathematics and Statistics, is a Research Scholar pursing her PhD in the
School of Engineering and Advanced Technology, Massey University, New Zealand. Ishanis research
interests include performance measurement, structural equation modelling, and mathematics teaching to
engineering undergraduates. JayamahaNihal Palitha Nihal Palitha Jayamaha Nihal Palitha Jayamaha (PhD,
MEng, MBA) is a Lecturer in Quality Management at the Massey University. Nihal previously worked
in Electrical utilities in South Asia and the Middle East for 20 years as a Project Manager, an Operations
Engineer and an Auditor. Nihal has published several journal articles, book chapters, and conference papers
on TQM and related topics. His research interests include process modelling, performance measurement,
and quality management theory building for process improvement. GriggNigel Peter Nigel Peter Grigg
Nigel Peter Grigg is a Professor in Quality Systems at the Massey University. He leads the taught Master of
Quality Systems Qualification and Coordinates Postgraduate Research in Quality Management, Business
Excellence, and related areas. He is a Chartered Quality Professional and Certified Six Sigma Black
Belt, and a Member of the Chartered Quality Institute, the American Society for Quality, and the New
Zealand Organisation for Quality. School of Engineering and Advanced Technology, Massey University,
Palmerston North, New Zealand . 2016. Operationalising performance measurement dimensions for the
Australasian nonprofit healthcare sector. The TQM Journal 28:6, 954-973. [Abstract] [Full Text] [PDF]
8. Raden Isma Anggraini, Aida Vitayala Hubeis, Radjab Tampubolon. 2016. EVALUASI KINERJA UNIT
BISNIS ASPHALT MIXING PLANT PT PRAYOGA PERTAMBANGAN DAN ENERGI. Jurnal
Aplikasi Bisnis dan Manajemen 2:2, 127-137. [CrossRef]
9. C. Favoreu, D. Carassus, D. Gardey, C. Maurel. 2015. Performance management in the local public sector
in France: an administrative rather than a political model. International Review of Administrative Sciences
81:4, 672-693. [CrossRef]
10. Stefano Baraldi, Antonella Cifalin. 2015. Delivering training strategies: the balanced scorecard at work.
International Journal of Training and Development 19:3, 179-198. [CrossRef]
11. Judith Broady-Preston Department of Information Studies, Aberystwyth University, Aberystwyth, UK .
2014. Measuring and assessing the impact of using volunteers in UK libraries: issues and methods.
Performance Measurement and Metrics 15:3, 112-121. [Abstract] [Full Text] [PDF]
12. Falconer Mitchell Hanne Nrreklit Oana Alexandra Albertsen Department of Economics and Business,
School of Business and Social Sciences, Aarhus University, Aarhus, Denmark Rainer Lueg Department of
Economics and Business, School of Business and Social Sciences, Aarhus University, Aarhus, Denmark .
2014. The balanced scorecards missing link to compensation. Journal of Accounting & Organizational
Change 10:4, 431-465. [Abstract] [Full Text] [PDF]
13. Sangjae Lee, Sung Bum Park, Gyoo Gun Lim. 2013. Using balanced scorecards for the evaluation of
Software-as-a-service. Information & Management 50:7, 553-561. [CrossRef]
14. Andr de WaalStrategic Performance Management in the Public Sector 357-378. [CrossRef]
15. Marek wiklickiApplying Balanced Scorecard in Non-Government Organizations 134-155. [CrossRef]
16. Marek wiklickiApplying Balanced Scorecard in Non-Government Organizations 902-923. [CrossRef]
17. Jos-Rodrigo Crdoba-PachnSystems Thinking to Improve E-Government Evaluation 806-822.
[CrossRef]
Downloaded by Universitas Indonesia At 22:17 30 March 2017 (PT)