Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Correspondence to: Prof E. Moxnes, Dept. of Information Science, University of Bergen, PO Box 7800, N-5020,
Bergen, Norway. E-mail: Erling.Moxnes@i.uib.no
Thanks to the editors and referees for valuable comments and to the students for participating in the experiments
and for ensuing discussions.
System Dynamics Review Vol. 20, No. 2, (Summer 2004): 139162 Received March 2003
Published online in Wiley InterScience Accepted July 2003
(www.interscience.wiley.com). DOI: 10.1002/sdr.289
Copyright 2004 John Wiley & Sons, Ltd.
139
140 System Dynamics Review Volume 20 Number 2 Summer 2004
The subjects in the experiment do not get to see the structure of the problem
as depicted in Figure 1. The stock and ow diagram is one of the tools of
system dynamics and has typically not been available to decision makers thus
far. Consequently, a structuring of the problem by this tool has not been
available either. Therefore, the subjects get verbal descriptions. However, the
descriptions (Appendix 1) are sufcient to construct the model in Figure 1.
Regarding the growth curve, the subjects learn that there will be no growth
when the lichen thickness equals zero (the seed is missing) and when it
equals 60 mm (due to crowding). They are also told that growth reaches a
maximum somewhere between these extremes. They do not get to see the
growth curve in Figure 2 since such growth curves have not been estimated
until recently for lichen ranges (Moxnes et al. 2002). Consequently such growth
curves have not been used in policy discussions. The subjects get exact infor-
mation about the parameter Grazing_per_animal (0.004 mm/year). In addition
142 System Dynamics Review Volume 20 Number 2 Summer 2004
they receive perfect information (gures and tables) about the development of
the herd size and the lichen thickness over the last 15 yearsthe most recent
period before they take over the management of the range. Real decision
makers deal with less precise information, implying that they face a somewhat
more complex problem.
If the structure of the model is known, the time series can be used to estimate
the growth curve from the time-series data. We measure the stock of lichen Lt
by its average thickness (mm) and write the equation:2
L t+1 = L t + gt hNt (1)
where Nt is the herd size, gt is the growth rate for lichen, and h is grazing per
animal. Rearranging the equation with gt on the left-hand side:
gt = L t+1 L t + hNt (2)
we get data points for growth as a function of the lichen thickness; see the open
squares in Figure 2. The data points for the last two years of the historical
period provide data points to the left of the peak of the curve; hence the
location of the maximum growth is found at a lichen thickness of 30 mm. This
is the lichen thickness that gives the maximum sustainable yield (gmax = 5 mm/
year) and that represents the desired sustainable situation. Knowing that h
equals 0.004 mm/year, we nd the maximum sustainable herd size equal to
Nmax = gmax/h = 1,250. If one is able to perform the above calculations, one has a
perfect model to work with after spending just a few minutes on calculations.
In the base treatment, T1, the task faced by the subjects is to reach the
maximum sustainable herd size (and the maximum sustainable growth of
lichen) as quickly as possible. The initial condition is one of overgrazing, with
a lichen thickness L0 = 24.4 mm, i.e. less than the desired 30 mm. Figure 2
shows that initial growth g0 is slightly lower than gmax, while the initial grazing
rate (hN0) is 50 percent higher than g0 (shown by the far left + sign in Figure 2).
The optimal policy is to reduce the herd size to zero in the rst year, increase
the herd to 1,056 in the second year, and then reach the maximum sustainable
herd of 1,250 and the corresponding lichen thickness of 30 mm in the third
year (recall that the subjects are allowed to sell or buy any quantity of reindeer
in the market). Given that Figure 2 has been properly constructed by the
subject, an approximate solution is intuitively simple. First, the gure makes
clear that grazing must be brought below the current growth rate to rebuild
lichen. Second, three years with around 50 percent overgrazing since the growth
peak was passed implies that three years with about 50 percent undergrazing is
needed to return to the growth peak. Third, to reach the desired situation as
quickly as possible, however, the herd should be reduced to zero in the rst
year. Then feedback about the development could be used to ne tune the herd
size to the maximum sustainable state. The optimal policy is consistent with
the constant target escapement policy known from resource economics (e.g.,
Clark 1985).
Erling Moxnes: Misperceptions of Basic Dynamics 143
Since it is possible to get very close to the optimal policy with simple means,
we choose the optimal policy as our benchmark to judge observed subject
behaviour. This is different from earlier, more complex experiments where
underlying simulators have not been fully explained and where there has been
ambiguity about both models and parameters. Hence in our case there is no
need for learning and thus the problem is in principle much simpler than the
previous experiments requiring learning. In practice, the difference may be of
little importance if the subjects are not able to perform the above calculations.
Then they have to rely on learning-by-doing anyway.
Results
Figure 4 shows 95 percent condence intervals for average herd sizes and
lichen thicknesses for trial one in T1. Optimal paths are shown with dashed
lines. Graphs are shown separately for the classes of 20025 and 2003. In the
early years, the average herd size is signicantly higher than the optimal one
and, in later years, it is signicantly lower. Hence, on average the subjects in
T1, the simplest case, are not successful in reaching the maximum sustainable
herd size within 15 years. The lichen thickness is signicantly lower than the
optimal lichen thickness in all years after the initial one. There is no signic-
ant difference between the classes of 2002 and 2003, with respect to neither
herd size nor lichen.
Erling Moxnes: Misperceptions of Basic Dynamics 145
Figure 5 shows 95 percent condence intervals for average herd sizes and
lichen thicknesses for trial one in T2. Graphs are shown separately for the
classes of 2000 and 2001. Optimal paths are shown with dashed lines; it takes
three more years to reach the desired situation in T2 than in T1 because of the
recruitment limitations for the reindeer. When the 95 percent condence
intervals for the average herd sizes and lichen thicknesses are considered,
there are almost perfect overlaps between the experiments in 2000 and 2001.
When the results of T1 and T2 are compared, the patterns are largely the
same. However, the distance from the optimal situation seems larger in the
complex case with two stocks, T2. To see if the differences are statistically
signicant at the 5 percent level, we compare lichen thicknesses relative to
optimal lichen thicknesses for the two treatments. Figure 6 shows condence
intervals for the pooled results of T1 (2002 and 2003) and for T2 (2000 and
2001). T2 appears to produce better results in year one and two, but this is only
because the subjects in T2 cannot inuence lichen in the rst year and hence
cannot deviate from the optimal response. After that, the average relative
lichen thickness is lower in T2 than in T1. Comparing the results year by year,
146 System Dynamics Review Volume 20 Number 2 Summer 2004
Fig. 6. 95 percent
condence intervals
for average lichen
thicknesses for
treatments T1 (thin
lines) and T2 (thick
lines)
Erling Moxnes: Misperceptions of Basic Dynamics 147
we nd the p-values shown by the dashed line in Figure 6.6 The difference is
statistically signicant in the time interval from 4 to 13.
Next we look at how the results improve over repeated trials. Such improve-
ments are at times referred to as learning. However, one should be aware that
improvements over trials could also be the result of trial-and-error with no
deeper learning involved. A probably less biased test of learning is to invest-
igate how new insights are transferred from one case to another (Bakken 1993;
Paich and Sterman 1993; and Jensen 2004). When that is said, lack of improve-
ment over repeated trials with the same case does signal lack of learning.
Hence, what we present here indicates an upper limit for learning. Radical
and sudden shifts in individual strategies may also indicate learning and we
report the frequency of such events. However, before we consider learning,
we have to address another problem: the subjects interpretation of the term
sustainable.
In the introduction to the experiments we say: Note, however, you should
make sure that your operation is sustainable. We took for granted that all
subjects interpreted this to mean that the herd size they ended up with could
be sustained forever, without destroying the food resource lichen. Later dis-
cussions with subjects have revealed that some of them interpreted the term
sustainable otherwise. They seem to have interpreted sustainable to mean that
the lichen resource should last for the 15 years of the experiment, but no longer
than that. This is an interesting nding in itself. Furthermore, it implies that
we have to remove these subjects as outliers when we investigate improve-
ments towards a truly sustainable maximum herd size over trials.
We dene this subgroup to be those who in both of the two last trials
approximately deplete lichen in the last year or those who approximately
deplete lichen in the third trial while not depleting lichen in the second trial.
We nd the following frequencies of misperceived sustainability: T2-2001
none out of 15, T1-2002 four out of 15, T1-2003 four out of 18.
When these subgroups are removed, improvements over trials are as shown
in Figure 7. In T1 the average lichen thickness moves quite rapidly towards the
optimal level from trial one to trial two. Then the improvement is considerably
smaller from trial two to trial three. In the complex case, T2, improvements
are slower. Even after the third trial there is a considerable improvement
potential.
Finally, we show results indicating learning over time during the rst trial.
The example in Figure 8 is from treatment T1-2002. For most subjects the
development of lichen is nearly linear over time. Three major exceptions
are highlighted by thick lines. The subject with a lichen level closest to the
optimal one seems to realise by the second year what is needed to get a
favourable development in lichen. The two others make sudden and large
reductions in the herd size in year 9. In the group T1-2003 one subject is doing
it right from the very beginning, two make sudden and large reductions in the
herd size around year 4 and one makes a strong reduction in year 8. In the
148 System Dynamics Review Volume 20 Number 2 Summer 2004
Fig. 7. Optimal
and average lichen
development over
three trials.
Treatments from
above: T1-2002,
T1-2003, and T2-2001
group T2-2001, one subject does it nearly right from the very beginning and
two make strong reductions in the herd size around year 5. In the T2-2000
group one subject makes a drastic reduction around year 6. To summarise, for
the pooled results (T1 and T2) for trial one, 17 percent either do it quite right
Erling Moxnes: Misperceptions of Basic Dynamics 149
Fig. 8. Indications of
learning during the
rst trial, treatment
T1-2002
from the very beginning or make rather drastic reductions in the herd size after
a while.
Discussion
Observed biases
First we note that the observed mismanagement in both T1 and T2 is largely
consistent with what has been found in experiments with more complex
models and more experienced subjects, see Moxnes (1998b; 2000). This sug-
gests that the simplest design, T1, captures the essence of the problem. People
have difculties in managing a system with one stock and two connected
ows, i.e., the basic building block of all dynamic systems. The results from
our simple design, T1, also seem consistent with the results from the studies
where subjects are simply asked to project consequences over time of certain
actions (Booth Sweeney and Sterman 2000; Kainz and Ossimitz 2002; Ossimitz
2002). Compared to these studies, which typically also deal with one stock and
two connected ows, we nd that precise outcome feedback each and every
period is not sufcient to eliminate mismanagement even in a one-stock-and-
two-ows system.
From all this follows that a priori one may suspect misperceptions to occur
in all dynamic systems and that outcome feedback will not make up for wrong
initial projections of consequences. While we think that is a sound suspicion,
we cannot rule out that certain variants of the basic building block are easier to
manage. Our version of the one-stock-and-two-ows system has a nonlinear
150 System Dynamics Review Volume 20 Number 2 Summer 2004
effects that last for that many simulated years. The desired lichen thickness is
set equal to 20.5 mm, assuming a certain erosion of the goal from the initial
lichen thickness. The value is adjusted slightly from a rst guess to improve
the t between actual and simulated development for the (lower) median
subject in T1-2002; see Figure 10. We have no prior ideas about the value of the
parameter and adjust it to get a good t, = 0.9.
The overall impression is that the simple feedback policy explains the major
tendencies: a gradual decrease in the herd size and then a stabilisation. A
simple statistical test suggests that we cannot reject the proposed model.10 As
always, an apparently good t does not prove that the proposed model is the
correct one. One could for instance augment the model by assumptions about
the relative change in lichen having an impact on the speed of the herd
reductions (Moxnes 1998b), one could add assumptions about variations in
the desired lichen thickness (e.g., a drift towards accepting a low standard);
154 System Dynamics Review Volume 20 Number 2 Summer 2004
and one could add assumptions about implementation delays and about
particular wait-and-see policies in the rst few years to get more data and
to become familiar with the task. Probably, none of these models would be
rejected by the data after calibration of parameters. Thus, with these additional
hypotheses, we could probably obtain ts for most subjects equally good to
that shown in Figure 10. However, the main conclusion would remain, that
behaviour is consistent with the use of some sort of feedback policy, a type of
policy it is hard to imagine that the subjects could do without, given that they
did not possess the perfect mental model.
By variation of the parameter , the feedback policy presented in Eqs 4 and
5 can produce developments that span the main area covered by observed
developments. Figure 11 shows how the lichen thickness develops when is
reduced to 0.4 and increased to 1.6 from its original value of 0.9. That varies
among subjects is to be expected. Different from the appropriate mental model,
the applied mental models are not likely to give precise indications of needed
herd reductions to close the gap between desired and actual lichen levels.
Thus, the value of is likely to vary with personal characteristics such as
aggressiveness and risk aversion. Hence, one should not be very surprised that
the results vary a lot, as shown in Figure 8.
The explanatory power of the feedback policy suggests that the subjects
abandon the static mental model. In fact, the static model predicts that a
desired lichen thickness of around 20 mm is obtained by keeping the herd at a
level slightly higher than the initial one and is therefore rejected by the data.
However, another experiment with professional reindeer herders indicated
that the static mental model is not abandoned for all purposes (Moxnes 2000).
In each time period the subjects were asked to make forecasts of the next years
lichen thickness. All gave projections that were biased in the direction of what
the static model predicted. This suggests that for the analytical problem of
Erling Moxnes: Misperceptions of Basic Dynamics 155
making forecasts, the static mental model is still relied upon, while decisions
are made according to a feedback policy. A similar inconsistency is found in
Broadbent et al. (1986), where an information treatment leads to better answers
in a questionnaire while task performance is largely unaffected.
Does the improved performance over trials in Figure 7 indicate that mental
models also improve? As noted earlier, the improvements denote upper limits
for learning. Furthermore, there exist quite compelling alternative explana-
tions to learning in terms of mental model improvements. According to Figure
11, considerable improvements could be obtained by using a more aggressive
version of the feedback rule; that is by using higher values of . Adjustment of
could simply be motivated by poor results in previous trials and does not
require any change in the mental model. Probably even more important, sub-
jects learning towards the end of the rst trial that the proper long-term herd
size is around 1,250 could set the herd size to a corresponding level in the rst
year of the second and third trials. If so, what is learnt could be the near-to-
optimal herd size for one specic district and not something that is useful for
the management of other reindeer rangelands or other renewable resources.
The difference between T1 and T2 suggests that it is easier to make quick
adjustments of the rst-year herd size when the herd can be varied freely.
administration and the politicians until the mid 1960s, at which point the herd
size had to be reduced to around one third of the maximum sustainable herd
size. This was not a desired development for anyone involved.
For purposes of comparison, data for the (lower) median subject in T1-
2002 is presented in a similar graph in Figure 13. The gure includes both the
historical period and the period managed by the subject. The overall pattern is
the same. In both cases the decision makers spend many years on insufcient
reductions in the herd size.
For subjects who deplete lichen severely, the herd declines more or less in
parallel with the decline in the growth rate. Decision makers do what they
believe is correct, and the result is a steady decline in the lichen level. This
causes frustration both to subjects in the experiment and those involved in real
management.
Policy implications
The above anecdote suggests that experts need better tools for communication.
In other cases of reindeer management experts have been known to give con-
icting advice, indicating that there is also a need for better communication
between experts. Furthermore, disagreements between experts imply an even
greater need for appropriate communication tools such that policy makers can
compare and evaluate the conicting advice.
Figure 14 may help clarify the information problem. On the left-hand side
the client makes decisions. Complexity and uncertainty typically imply that
information feedback is used when decisions are made. Normally the client is
a dictator when it comes to making decisions; the analyst or modeller can only
inuence the client through information. On the right-hand side, the modeller
builds a model of the problem, simulates and arrives at policy insights. The
modeller may present these policies to the client without further explanation.
Erling Moxnes: Misperceptions of Basic Dynamics 157
However, clients responsible for decisions are not likely to substitute black
box formulas for their own judgement. Experience tells them to be somewhat
sceptical of experts, and particularly so if the experts give diverging policy
advice.
For these reasons the best alternative seems to be to present information that
inuence the clients mental model of the problem. For this purpose the
analyst may benet from a model of the clients mental model. In our case it
seems that most subjects (clients) tend to think in terms of a static model (with
some auxiliary assumptions) and to employ feedback strategies. They seem to
lack proper dynamic representations. Depending on the time the client is
willing to set aside, various options are available. The pedagogical tools and
the principles of system dynamics (Sterman 2000) are known to help students
in this discipline. Group model building (Vennix 1996) involves the clients
directly in the model building. The more traditional approach is to present
nal model structures and simulation results. All approaches take consider-
able time.
If only a short time is available, for instance a lecture or a media appearance,
the presentation must be simple and focus on the essentials. Figures 2, 12 and
13 may represent such a simple representation. Once the gure is understood,
it focuses attention on adapting the herd size to the lichen growth. The gure
explains why a small reduction in the herd size can be insufcient to halt the
decline in lichen. Such a result is not surprising with this model in mind;
actually with this model in mind it is surprising that anybody could make the
decisions portrayed in Figures 12 and 13. However, one should not take for
granted that this graphical representation is easily understood. While Moxnes
(1998b) found that the results improved with this graph as an information
treatment, even researchers with considerable experience in formal analysis
happened to misperceived the gure. A large fraction of the subjects did not
consider the stock nature of lichen. More in accordance with a static model,
158 System Dynamics Review Volume 20 Number 2 Summer 2004
they pictured that if the herd size was reduced to the maximum growth rate,
the lichen stock would adjust accordingly and immediately. Hence it is a
challenge to avoid this misperception when using the growth curve in short
appearances.
Conclusions
Notes
1. If the resource stock is greater than the target, the harvest reduces the stock
to the target. If the stock is below the target, the harvest is set equal to zero.
2. Here we use the notation of a discrete time model. However, the model in
Figure 1 can still be thought of as a continuous model, which is simulated
with a time step of 1.0. This is acceptable since the implicit time constants
are much longer than 1.0.
3. T1 is written in Excel 5.0/95 and is available from http://www.i.uib.no/
staff/erling/publications.htm
4. T2 is written in Powersim Constructor and is available from http://
www.i.uib.no/staff/erling/publications.htm
5. One outlier, who increased the herd size to 5,000 in the second year, has
been removed, hence n = 15.
Erling Moxnes: Misperceptions of Basic Dynamics 159
References
Bakken BE. 1993. Learning and Transfer of Understanding in Dynamic Decision Envir-
onments. Ph.D. Dissertation. MIT Sloan School of Management, Cambridge, MA.
Booth Sweeney L, Sterman JD. 2000. Bathtub dynamics: initial results of a systems
thinking inventory. System Dynamics Review 16(4): 249294.
Brehmer B. 1992. Dynamic decision making: human control of complex systems. Acta
Psychologica 81: 211241.
Brekke KA, Moxnes E. 2003. Do numerical simulation and optimization results
improve management? Experimental evidence. Journal of Economic Behavior and
Organization 50(1): 117131.
Broadbent D, FitzGerald P, Broadbent M. 1986. Implicit and explicit knowledge in the
control of complex systems. British Journal of Psychology 77: 3350.
Clark CW. 1985. Bioeconomic Modelling and Fisheries Management. Wiley: New York.
Diehl E, Sterman JD. 1995. Effects of feedback complexity on dynamic decision making.
Organizational Behaviour and Human Decision Processes 62(2): 198215.
Edwards W. 1982. Conservatism in human information processing, in Judgment under
Uncertainty: Heuristics and Biases, Kahneman D, Slovic P, Tversky A (eds). Cam-
bridge University Press: Cambridge, UK, 6983.
Forrester JW. 1961. Industrial Dynamics. MIT Press: Cambridge, MA. (Now available
from Pegasus Communications, Waltham, MA.)
160 System Dynamics Review Volume 20 Number 2 Summer 2004
Appendix 1
sure that your operation is sustainable. This means that you should aim for
the highest possible sustainable slaughtering rate. You should also try to reach
this desired state as quickly as possible. For your information, sustainable
meat production will be maximized when the sustainable herd size is max-
imized. Thus your focus should be on the maximum sustainable herd size.
Each year your only decision is to set the desired number of reindeer for the
next year. You get only 15 years to reach the desired state, and no new trial. Do
the best you can. The subject who gets the best results will receive a symbolic
prize.
You are the sole owner of a given reindeer pasture. Nobody else has reindeer
or other animals in your pasture. In summer, there is plenty of grass and herbs.
The limiting resource is lichen to support the reindeer throughout the winter.
Lichen is a small plant growing on the ground. Biologically it is a combination
of fungus and algae. The lichen plant grows in the summer time, growth stops
in the winter, and then the plant continues to grow on top of itself the next
summer, and so on. When there is very little lichen present, there is only little
growth. When there is a lot of lichen, the net growth of lichen tends towards
zero, what grows up is just compensating for what rots at the bottom of the
plant. In between these extremes, net lichen growth reaches a maximum.
When the reindeer graze, they eat the top of the plant, and the plant continues
to grow on top of what is left. As a way to keep track of how much lichen there
is in the pasture, one can measure the average height of the plants, also referred
to as the thickness of lichen.
The size of the area is indicated by the following piece of information: In one
year, the lichen eaten by 1,000 animals is sufcient to reduce the average lichen
thickness for the entire pasture by 4 mm. We simplify and assume that the
intake of lichen per animal does not depend on the amount of lichen, as long as
there is lichen available. Still, lichen is vital for the survival of reindeer; if
there is no lichen, all the animals will die. You do not have to think about the
sex ratio, the number of calves, losses of animals, the age structure or whether
the reindeer are slaughtered, sold or bought. You can vary the herd size freely.
All measurements of the herd size and the lichen thickness are perfect and
there are no random variations from year to year in the number of animals or
the growth of lichen.
Before you take over the pasture, the previous owner has increased steadily
the number of reindeer from 1150 to 1900. As a consequence, the lichen
thickness (mm) has dropped from 50 to 24.4 mm. This development is shown
in the diagrams and table below. (Not shown here; however, the data can be
inferred from Figures 2 and 13, or they can be seen in the downloadable
version of T1, see Note 3).
162 System Dynamics Review Volume 20 Number 2 Summer 2004
Appendix 2