Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Dev Sharma
leads the Delivery Practice at WCL, helping clients improve their overall efficiency, the effectiveness of their delivery and how
they use their IT systems to support these objectives.
Merlin Stone
is a leading author and advisor on CRM programme management and implementation. He is Research Director at WCL, one
of the UK’s fastest growing management consultancies, Professor of Marketing at Bristol Business School and Visiting Professor
of Marketing at a number of universities, including Oxford Brookes.
Yuksel Ekinci
is a Reader in Marketing at Business School in Oxford Brookes University. He specialises in quantitative data analysis, customer
satisfaction measurement and user satisfaction with CRM.
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
www.palgrave-journals.com/dbm/
Sharma et al
30 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 31
Sharma et al
32 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
its resources across multiple goods/services Defensive strategy establishes how much
(for example, reducing cost due to the organisation relies on cost-effective,
better synergy). They often arise from uninterrupted, secure, smoothly operating
the sharing of knowledge and distinctive technology systems. It relates more to
managerial competencies. This relates to operational reliability. Offensive strategy
absorptive capacity. establishes how much the organisation
relies on IT to gain competitive advantage
Absorptive capacity through systems that provide new
This refers to the ability to value, assimilate value-added services and products or
and apply new knowledge. It demands high responsiveness to customers. It places
knowledge and communication and partly strategic issues either at or above the
determines innovation performance, same level as reliability. Offensive
aspiration level and organisational learning. IT projects tend to be ambitious and
The theory was first introduced in 1990 risky because they often involve significant
by Cohen and Levinthal.7 Two concepts organisational change. Figure 1 shows the
related to absorptive capacity are as follows: IT Strategic Impact Matrix and the four
involvement modes.
— Receptivity: Awareness of, identification As can be seen from Figure 1,
of and taking effective advantage of organisations’ engagement with IT
technology. governance varies according to four
— Innovative routines: Practised routines strategic modes: factory mode, support
that define a set of competencies an mode, strategic mode and turnaround
organisation can use confidently and that mode. Depending on where organisations
are the focus of its innovation efforts. locate themselves on the matrix, IT
governance may be a routine matter best
Where IT governance is concerned, the key handled by the existing audit committee
issues are how strong and well articulated or a vital asset that requires intense
corporate governance is, how it translates board-level scrutiny and assistance.
into IT governance, how both are deployed What board members need to know
over the whole organisation, and whether about IT activities depends on the firm’s
it knows how to use IT governance to strategic mode, as well as firm size, industry
support innovation. and competition. Both the factory and
According to Nolan and McFarlane, support mode are extensions of defensive
IT governance decisions should be based marketing strategy. Organisations in factory
on four involvement modes, shaped by two mode need highly reliable IT systems to
types of strategies: defensive and offensive.5 run operations smoothly and constantly,
Defensive Offensive
High Factory Mode Strategic Mode
If system fails for a minute or more there is New system promises
Need for an immediate loss of business major cost reductions
reliable IT Support Mode Turnaround Mode
Even with repeated service interruptions of IT is more than 50% of
Low up to 12 hours there are no serious capital spending
consequences
Low High
Need for new IT
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 33
Sharma et al
for example airlines. They do not need also understand and manage the risks
state-of-the-art computing. Those in support associated with implementing new
mode depend less on IT, as they have less technologies. The IT Governance Institute
need for reliability and for strategic IT – suggests that the enterprise’s challenges
they will not suffer terribly if a system and concerns include the following5:
goes down for longer periods. From an
IT project perspective, this means that — aligning IT strategy with the business
it may be better to delay problem projects strategy;
until they can be perfectly or near-perfectly — cascading strategy and goals down into
implemented. the enterprise;
Organisations in turnaround mode — providing organisational structures that
heavily rely on new IT systems that promise facilitate the implementation of strategy
major process and service improvements. and goals;
Here, technology typically accounts for a — insisting that an IT control framework
high percentage of corporate expenditures, be adopted and implemented;
and all the manual systems are transferred — measuring IT performance.
into the new IT system. At the same time,
firms have a comparatively low need for Selig states that effective IT governance
reliability when it comes to existing is built on three critical factors:
business systems, and they can withstand (1) leadership, organisation and decision
repeated service interruptions of up to rights; (2) importance of flexible and
12 hours without serious consequences. scalable processes improvement; and (3)
Organisations in strategic mode favour total the use of enabling technology. The process
innovation as their main business principle. of IT governance starts with setting clear
New technology informs not only how objectives for the organisation’s IT in
they approach the marketplace, but also order to provide the initial directions.
how they carry out daily operations. Like This is followed by strategic planning
turnaround firms, their IT expenditures are and execution of the IT objectives. The
large. According to Nolan and McFarlane, implementation of the IT governance
not every firm wants or needs to be in strategy, policy and action plan will ensure
this mode, but some are forced into it by that IT governance is managed more
competitive pressures, for example if they effectively. A continuous loop is then
fall behind more competitors who use established for measuring performance,
information systems as the cutting edge of comparing it to objectives, leading to
innovation. From an IT project perspective, redirection of activities and changed
this means that it may be better to objectives where appropriate.3 A solid
complete a project even if it is not perfect. foundation for IT governance is published
best practices and guidelines, for example
Organisational responsibility Control Objectives for Information
for IT governance and Related Technology (COBIT) and
IT governance is usually implemented at The Code of Practice for Information
different layers of the organisation. Leaders Security Management (ISO 17799).8
report and receive directions from their
managers, and managers report up to the Our research
executive, and the executive to the board of To explore how IT governance is
directors. Although many organisations implemented in British organisations, we
recognise the potential benefits that decided to do some qualitative research.
technology can achieve, the successful ones We interviewed senior managers in
34 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
10 organisations about a recent large IT 8. What were your main learnings from the
project, in terms of how to manage the
project in which they had been involved. The project and deliver it on time, relating to
respondents were one national retailer, five your people, and your stakeholders and
financial institutions, one regulatory authority, suppliers?
9. What was the role of IT and business consultants
two central government departments and in the project? What was the main contribution
one information services provider. they made? Were there any specific weaknesses,
and what did you learn from this?
The respondents ranged from middle 10. Were you following any particular professional
management to the most senior standards or methods in the definition or
implementation of the project? If so were the
management. Two were Chief Technology standards useful or a hindrance?
Officers/CIOs or equivalents, one was a 11. How if at all were your senior managers involved
in the project? Do you consider that your
Director of IT Transformation, and one board of directors or equivalent was sufficiently
managed relationships with internal engaged? What more could they have done
stakeholder, one with suppliers, while the to ensure success?
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 35
Sharma et al
36 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 37
Sharma et al
on the importance of e-mailing the wider We had to ensure that we devoted adequate
group of stakeholders (which included business resource to support the workload,
a variety of public and third-sector clarifying requirements, testing etc, right across
organisations) when there was something the project lifecycle.
significant to update them on.
We focused on getting the right people to
Process was important:
do the right things; getting buy-in to plans;
We have a joint IT-business planning process, getting the contract right for all parties and
directed from the Board to drive operating ‘putting it in the drawer’; agreeing on the
planning. It requires submissions from all terms of reference for all stakeholders.
departments including IT. This planning
One respondent identified that the informal
group agrees on priorities and develops a
balanced portfolio.
way people would commission work was
a problem.
We use a steering committee approach, with There were too many informal projects going
a Project Review Board (the top sixteen on that were not part of the project tracking
managers in our company). We use audit to and resource management process, and this
identify irregular attendance at this board. caused problems in resource management.
No respondents allocated a separate budget Having an independent viewpoint was
to governance (other than a budget for important:
project communication).
An independent project management
It seems that companies with strong
organisation is key. If an external contractor
awareness of the connection between is used to develop a particular part of the
project management and stakeholder deliverable, it is important to ensure that that
management were more satisfied that their project be managed by another company.
governance approaches were robust.
Stakeholder management is a relatively Methodology was also important:
new management discipline – although it We used a strong project management
has long been part of communications disciplines (based upon PRINCE), from the
management – whether in public relations very earliest days of set-up, particularly where
or human resources. It has recently emerged it came to identifying roles and responsibilities.
as a very important discipline in the
The value of the rigour introduced by such
public sector, which is ahead of the private
methodologies was a common theme, and
sector, where it is conventional to break
the importance of weekly reporting on
it up into the management of different
deliverables was stressed. The difficulty
communities, for example staff, customers,
of managing risk and the difficulty of
owners and other departments.10
embedding learning from managing the
project into the company’s culture were
Project management and also identified.
learnings One respondent mentioned the learning
Some of the main learning points from from another project that had gone less
the projects related to governance and well:
the deployment of resources to achieve
The learning from the clear project
the desired outputs:
management approach adopted for this
Simply recognising the work as a formal project (the subject of the interview) was not
project was key. transferred. However, we now have a change
manager, with the duty of ensuring that all
A strong focus on delivery was essential. projects are well managed.
38 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
Stakeholder relationships were key: including project structure and the people
involved. Others had formal terms of
Our main learning was about the management
of relationships. What made the project work reference for everyone involved in the
was the strong relationship between the project, including stakeholders, delivery
business team and the IT development team. teams and governance.
Focus was generally maintained on
The response was clear-cut across the objectives, rules and rights through constant
respondents – all used structured project engagement of business stakeholders, regular
management methodologies and associated project meetings and frequent sign-off
software, whether PRINCE, another public points. One respondent, however, voiced his
software or one proprietary to their doubts, mentioning that he was not sure
company. Another respondent identified that his business appreciated that there was
the importance of not underestimating a problem that needed fixing. He described
how long it would take to work through his company’s change management process
user acceptance testing, and of accepting as ‘complex’.
that this might delay a project. We have already discussed the issue of
One respondent learnt how to deal with communication above. This section highlights
the offshore supplier. ‘They always said Yes, but the importance of a framework within
this actually often meant ‘No’ or a ‘Yes but….’ which the communication should take place.
So from Mid Development onwards we
added 30 per cent to all of their estimated
timings’. Another respondent pointed to the Gathering project requirements
importance of tracking consultants and other This process seems to have been thorough
external suppliers, to ensure that they for all respondents. Some used their
delivered their plans and promises.
The main conclusion from this part of the tiered governance structure as the channel.
research relates to the importance of broad Several had formal phases in which user
awareness that project management and requirements were gathered and then
project governance are significant worked on by technical teams and with
management disciplines, which are both business users, and signed off by senior
essential to the successful management of managers. One respondent stressed that
large projects. They are helped by the use of getting project participants to map out
standard project management tools, but these requirements, process flows visually and
are the start point, not the end point. compare them with the existing situation
Stakeholder management is key, as we have was critical to success.
already mentioned, but so is a stable We engaged stakeholders, through ‘heavy duty
approach, and a proper balance of incentives. process mapping’ to understand the relevant
processes and how to change them.
Objectives, rules and rights,
project charters In a large organisation like ours, gathering
requirements is very hard – with subject
One respondent mentioned that the project
matter experts and many different stakeholders
did have a project charter. Another had a needing to be consulted, requiring a full time
project delivery method that included person just to book diaries, set workshop dates,
specification of these aspects of the project. book locations all over the country and make
One had this just for the board of directors, travel arrangements, just to make sure right
but not for stakeholders. One respondent people were working together. If people don’t
referred to the way in which his company turn out, they are unhappy about decisions
drew up terms of reference for the project, and want to retake them. However, once the
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 39
Sharma et al
requirements were gathered, we had very clear organisation moves on, requirements change,
version control, including final sign off at every and thus change management (and its
stage by our senior sponsor (CFO), who was governance) becomes particularly important,
supported by a full time project manager. especially in long-duration projects.
Several mentioned the importance of
change control, and one stressed the Project budgeting
importance of tying contractual change In general, the approach followed here was
control to budgets. highly structured.
The software chosen can pose a choice:
There were budgets for each key activity, with
It is critical not to modify the package to fit costings provided for changes, while costings
processes but rather to do it the other way were owned by the project office and reported
round. Many of our processes are ‘commodity’ in to the board. Our finance director was on
and could be changed and improved through the project board.
the package. However, this led to a different
question – where does a company like Costings were governed by business case
ours differentiate itself where it concerns submission based on their business case scope
processes? Some processes must be kept review and driven by priorities. The steering
as differentiators or sources of competitive committee authorised the budget and changes.
advantage.
Formal estimating of costs (including supplier
This area is one of the most critical in all costs) was carried out for all workstreams,
complex projects. Requirements cover a including provision for cost changes during
very wide range of topics, from technical programme life and an overall risk buffer,
which was different for different workstreams.
requirements that concern only IT staff,
to the functional requirements of users, Costs were reported weekly to the programme
through to usability requirements, which board.
determine whether useful functions end
up being used as they should be. Projects This was not, however, always so:
in marketing, sales and service often involve
Costing was more of an art than a science,
two groups of non-specialist users – staff and it was not always clear where the money
who interface with customers and was coming from.
(increasingly, because of self-service) the
customers themselves. Customers are Thus, while organisations may have good
rarely asked about their requirements. formal cost control, this may mask some
Non-specialist staff may be asked about uncertainty as to how much is being spent
them but may not be able to articulate, and where it is coming from. The authors’
still less anticipate, the requirements that experience of major CRM projects
they may have in the future (and as we confirms this. At a high level, budgets may
have seen, it may be between 2 and be reallocated from marketing or customer
5 years before a system for which the service to systems if the project is exceeding
requirements are being gathered is its estimated cost. Project costs may be
implemented). Thus, the term ‘requirements hidden by reallocating staff formally
gathering’ must not be interpreted as working under other budget codes. This
‘gathering objective requirements’ – much should not, however, be regarded as ‘bad
judgement, interpretation and insight is practice’. Few large systems projects have
required to arrive at a set of requirements the luxury of perfect predictability –
that will truly meet the needs of users whether this relates to development
when the system goes live. Similarly, as the activities or costs. It is natural that user
40 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
departments that are anxious to see the separate metrics other than normal project
completion of ‘their’ system do what they progress metrics, or simple box-ticking
can to expedite its completion, even if exercises. There was one star exception:
it means that some other activities suffer.
We applied corporate governance metrics
A user department must make its own along with CMMI (Capability Maturity
judgement about its priorities. Perfect Model Integration).
budgeting and innovation rarely go together.
In one case, the respondent taking up the
Governance role of manager of the project led to the
Where governance to ensure the application introduction of different metrics.
of accountability, processes and criteria This does not necessarily indicate poor
was concerned, some respondents said that practice. Good governance is primarily
this took place through normal project a cultural phenomenon, which cannot
management and board management be measured simply, for example solely
processes. In some cases, however, a tougher by complying with a checklist. This is
approach was needed: similar to our view that good customer
management is the result of the interaction
Our internal audit function was involved, to keep of many factors.11 We would, however,
people ‘honest’ and to ask difficult questions.
certainly argue that an assessment process
The project steering committee provided a
can be developed for governance – our
governance pack for the capital expenditure checklist at the end of this paper indicates
committee and the company Board. When its possible components,
a project was approved, accountabilities and
involvement were reviewed. Project prioritisation
Project prioritisation was handled in all
In one company, however, there were no companies within projects by their project
processes for this, and another had management and/or business planning
difficulties: framework.
This was a tough area, with appointments Priorities between projects are down to
to the governance board being based on individual business units, and then requirements
the organisation or department for which become part of the wider set of business
they worked and their role, rather than their requirements for IT, for which priorities are
capability to be board members, so sometimes discussed and set at the CIO level.
we had a skills mismatch.
Overall prioritisation is a board matter.
Our main learning was the need to shake up
governance regularly. We also needed to get The good news here is that all respondents
the right balance between academic/research indicated that they had a framework for
work and ‘real’ project work that produces prioritising projects. This is a fundamental
deliverables. The mix was wrong at the component of good governance.
beginning of the project, with not enough
delivery, and this hampered the project
manager’s attempts to engage some important Project reviews
stakeholders. We had problems with control Generally, project reviews were weekly,
too – it was frustrating to have project with various techniques used for identifying
managers working for me that did not belong
success and problems, such as RAG
to my organisation.
(red-amber-green) scoring, highlight reports
In some cases, respondents admitted that and slips against milestones identified
they had no metrics for governance, or no in the project management software.
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 41
Sharma et al
The seniority of those involved in weekly would have made things better, and given
reviews varied. us a better capability to respond.
The interesting point here is the Our conclusion here is that the
frequency of reviews – which was high. independence of consultants is valued,
This suggests that companies have learnt although companies are wary of the costs
the risks of infrequent reviews. and the introduction of self-interested
agenda. In our experience over more than
Role of consultancies and 20 years, clients that place everything in the
other externals hands of consultancies and those that place
Most companies did not use consultants. nothing in their hands take large though
Where they were used, the experience dissimilar risks. Refusing to use consultants
of using consultancies was generally shuts the door to the introduction of
positive. experience from similar projects. Some
clients believe that they can overcome this
Consultants introduce experience to the
by hiring people who have implemented
planning process – the consultancy we used
asked each workstream to develop an initial similar systems in other companies, but in
plan and then pulled the plans together, our experience these people may become
challenging inter-dependencies and allowing absorbed in their particular roles in the
cross-workstream challenges. The consultancy project, so that they cannot contribute
also chaired the workstream meetings, and their full experience. In addition, the
developed a matching governance structure. experience of one similar implementation
We had a consulting partner who really is not as valuable as experience of many
did have the required breadth of experience similar implementations. At the other end
and resources to handle the project. of the spectrum, giving consultants too
Many consultancies claim that they have great a role in project implementation and
more experience and capability than they
governance can increase costs – not just
actually have.
because of higher day rates, but also
We used consultants for their specific business because of expansion of the consultants’
expertise and technical knowledge, plus role. A golden mean is of course the ideal
support. approach, but in the fray of a large project,
it is usually hard to know where that
The experience was not, however, always golden mean is.
positive:
We used an IT consultant (expert in our
Change management approach
development environment) to improve
the company’s testing capability, and three Here there were two main approaches.
contractors to work on business acceptance. Some companies had a standard change
These consultants absorbed quite a lot of management approach, with prescribed
time as they were not familiar with either tools, documents and templates covering
us or our systems. configuration and change management.
Others did it through their own efforts
In some cases, the major management and/or through appointing experienced
consultancies were closely involved in the project managers.
governance approach, perhaps sitting on The discipline of change management,
project boards. One respondent, however, which is much wider than project
commented: management, is becoming more widely
Suppliers were not sufficiently open quickly understood, but still has some way to
enough. More transparency and openness go. We look forward to a time where it
42 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
Risk and problem management The key is to get the right people in the
and resolution room together to thrash out a solution.
Most companies covered risk and problem
management and resolution through We identify problems and resolve them in
normal weekly team meetings.
their change management and project
management processes (in particular regular Our three biggest problems are scope creep,
project meetings), though one respondent project management skills, and estimating
identified that it was difficult where business timings for different elements of the
partners were involved. Typical risks project plan. So I have appointed a software
identified were where stakeholders changed, development manager, with whom I work very
where projects were very large, and where closely in estimating timings, or in checking the
system usage was low and affecting timings that the development team proposed.
performance. In fact, as one respondent This does lead to the occasional mistake, but the
stated, usage can be too high or too low key is to ensure that we learn from them (eg
(for given tasks), and thus it was important identifying one particular manager who always
to model this. Another respondent identified said things were on track when they were not).
the importance of planning for mitigating We were pleased to see a relatively high level
risk at project planning stage. Good practice of maturity in risk and problem management.
was exemplified by several respondents: Too often, risk management is given lip
service. Particularly dangerous is weak
We have a standard risk management approach
communication, as we have already identified.
of identifying owners of the risk, planning for
mitigation, identifying the cost of mitigation
actions and of bringing contingencies into CONCLUSION
place. This allows go/no go decisions to be Our research showed that most companies
factored into the plan well ahead of bringing that responded had strong project
in the contingencies. management approaches and strong, well-
qualified project managers, for the major
We keep a risk register throughout each projects that were the subject of the
project, running RAG reports on them. enquiry, and that respondents perceived
that these two factors were very important
We use a risk-based project management in ensuring successful project delivery and
approach, reviewed monthly.
in the successful governance of projects.
In some cases, the project management
We run risk workshops. For each risk
identified, we assign a budget for mitigation, to approach had been long established; in
be included in the overall project budget. The others it had been established as a result
budget is generated by a formula containing an of the efforts of the individual respondent.
estimated impact and likelihood and the costs The project management and governance
required to fix each risk. methods used by the respondents’
organisations helped them to cope with
Where problem analysis and resolution were most of the vagaries of their IT projects.
concerned, experiences and approaches A few problem areas stood out, however,
varied: such as coping with senior management
The key is to identify the issue first. Then we churn and ensuring that consultants and
use consultants for process mapping and skills other suppliers were managed appropriately.
transfer. If consulting resources are insufficient, These are two prime problem areas in
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 43
Sharma et al
44 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
method and is a registered trademark of the Office project management or both, and
of Government Commerce (OGC), an independent
office of HM Treasury of the United Kingdom. scored them (A as critical, B as
10 For more on stakeholder management, seeStone, important, C as nice to have and D as
M. Semmens, A. and Woodcock, N. (2008) not relevant) based on our research
Managing Stakeholders in the Public Sector. Report
for the Public Management and Policy Association,
and experience for their general
September 2007 and Stakeholder Management and importance for each type of governance.
Engagement – Lessons from Public and Private Of course, their importance for a
Sectors, WCL. particular organisation may vary
11 For more on the assessment of customer
management, seeStone, M. Woodcock, N. and Foss, according to the type of organisation,
B. (2003) The Customer Management Scorecard. its general experience with projects
London: Kogan Page. and the particular project. The point
of scoring them is really indicative,
APPENDIX to stimulate readers into considering
how important the factors are for
GOVERNANCE TOPICS their particular situation, rather
In this list, we have classified the topics than to pronounce upon their general
as being important for project governance, importance.
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 45
Sharma et al
IT principles
Outsourcing principles B A
Exception management A C
Ownership of IT change B B
46 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
Quality/issue management
Quality plan B B
Supplier management
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 47
Sharma et al
48 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50
IT governance and project management
© 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50 49
Sharma et al
Testing strategy for new services, systems, and so on, for example, A C
early walk-through and acceptance of documented requirements,
organisational logic, information flows, user requirements, user
acceptance testing for any changed facilities
50 © 2009 Palgrave Macmillan 1741-2439 Database Marketing & Customer Strategy Management Vol. 16, 1, 29–50