Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
To cite this article: Erik Baatrup (2009) Measuring Complex Behavior Patterns in FishEffects of
Endocrine Disruptors on the Guppy Reproductive Behavior, Human and Ecological Risk Assessment: An
International Journal, 15:1, 53-62, DOI: 10.1080/10807030802615097
Taylor & Francis makes every effort to ensure the accuracy of all the information (the
Content) contained in the publications on our platform. However, Taylor & Francis,
our agents, and our licensors make no representations or warranties whatsoever as to
the accuracy, completeness, or suitability for any purpose of the Content. Any opinions
and views expressed in this publication are the opinions and views of the authors,
and are not the views of or endorsed by Taylor & Francis. The accuracy of the Content
should not be relied upon and should be independently verified with primary sources
of information. Taylor and Francis shall not be liable for any losses, actions, claims,
proceedings, demands, costs, expenses, damages, and other liabilities whatsoever or
howsoever caused arising directly or indirectly in connection with, in relation to or arising
out of the use of the Content.
This article may be used for research, teaching, and private study purposes. Any
substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,
systematic supply, or distribution in any form to anyone is expressly forbidden. Terms &
Conditions of access and use can be found at http://www.tandfonline.com/page/terms-
and-conditions
Human and Ecological Risk Assessment, 15: 5362, 2009
Copyright C Taylor & Francis Group, LLC
ISSN: 1080-7039 print / 1549-7680 online
DOI: 10.1080/10807030802615097
Erik Baatrup
Institute of Biological Sciences, Zoophysiology, University of Aarhus,
Downloaded by [University of Alberta] at 03:27 31 December 2014
Aarhus, Denmark
ABSTRACT
An obstacle in behavioral research is in obtaining unbiased measurements and
presenting them in numerical terms, independent of human interpretation and
observational endurance. Simple locomotory behavior can be relatively easily quan-
tified with existing computerized vision systems, whereas it is much more difficult to
obtain unbiased measurements of complex behavior patterns. We have developed
a computerized vision system (DISPLAY), which identifies and quantifies complex
behavior patterns and interactions in fish. In short, the fish scenery is viewed from
above by a camera. At a frame-rate of 12 s1 , the fish silhouettes are stored in a
frame file. Subsequently, the position and orientation of each fish relative to the
other(s), the distance between them, and their body curvature are determined in
each frame. Further, frame-to-frame comparisons enable calculation of speed and
direction of fish movements. With these measurements available, composite be-
havior patterns can now be entered graphically by the user as distinct classifiers.
The system has been used for studying the effects of endocrine disruptors on the
reproductive behavior of the male guppy (Poecilia reticulata). Both estrogenic and an-
tiandrogenic substances significantly suppress the number and duration of posturing
behavior and sigmoid displays, two distinct elements in the courtship behavior of the
male guppy.
Key Words: quantification of fish behavior, computerized vision system, automatic
measurements, guppy courtship behavior.
INTRODUCTION
Potentially, behavioral changes are excellent biomarkers of internal and external
stress in animals, given that behavior is the physical manifestation of the animals
internal neuronal, metabolic, and endocrine processes, and at the same time the
53
E. Baatrup
who has manually scored behavioral events will know that 15 minutes is a long time.
Thirdly, and most important, the human brain has a poor capacity for the storage
of numbers and mathematical data analysis. For instance, if watching a small group
of animals in a test arena, it is impossible to deduce and hold precise quantitative
information on their locomotor activity or their pattern of mutual interactions.
Computerized vision systems, on the other hand, are unsurpassed for such data
acquisition. They can record the movements of multiple animals over prolonged
periods and calculate simple behaviors such as walked distance, maximum and av-
erage velocities, distribution of active and resting periods, turning behavior, and
visits to specific locations (Areas Of Interest). A number of University research sys-
tems (e .g., our own MOTIO system, Institute of Biological Sciences, University of
Aarhus, Denmark) and commercial systems (e .g., Ethovision, Noldus, Wargenin-
gen, The Netherlands) have been developed. Most of these vision systems, however,
are confined to quantifying behaviors that relate to the position or movement of
the animal(s), since each animal is represented only by the x,y,(z)-coordinate of its
centroid (geometric center of gravity) in the data handling (Baatrup and Bayley
1993; Jensen et al. 1997). This simple data representation of the animal(s) excludes
the determination of complex behavior patterns that involve the orientation of the
animal in space, its form, and its interactions with other animals. To approach the
need for such a vision system we developed DISPLAY, which quantifies complex be-
havior patterns in fish. The applicability of the DISPLAY vision system in behavioral
and ecotoxicological research has been documented in a number of studies (Bayley
et al. 1999; Toft and Baatrup 2001; Baatrup and Junge 2001; Bayley et al. 2002; Toft
et al. 2003; Toft and Baatrup 2003; Toft et al. 2004). This communication presents in
detail the functionality of the DISPLAY system.
Figure 1. Posturing behavior and the sigmoid display are two key elements in the
guppys courtship behavior. In the posturing behavior (A) the small male
places himself in front of the larger female facing her. From this position
he performs the sigmoid display where his body assumes a C or S shape
while he swims sideways along the length of the female (B and C) to get
into position for copulation, or he moves away enticing her to follow.
In some populations of guppies, this behavior is performed on average
once per minute.
(Houde 1997) almost continuously during the light hours. Briefly, the male places
himself in front of the female and stays within her field of view (posturing behavior).
From this position he performs the sexual display toward the female known as sigmoid
display (Figure 1), where his body assumes the shape of an S or C, and vibrates
while he swims sideways displaying his sexually attractive orange-yellow coloration.
He either moves along the length of the female to come into position for copulation,
or he moves away from the female, remaining in her field of view to entice her to
follow. These behavioral maneuvers are so stereotyped and performed so frequently,
even in a laboratory setting, that the male guppys courtship behavior lends itself
to automatic quantification. In the following description of the DISPLAY system,
the guppy posturing behavior and sigmoid display will serve as examples of quantifying
complex behavior patterns in fish.
video signal from the camera was digitized by a DT3155 frame grabber (Data Trans-
lation, Inc., Marlboro, MA, USA) into a 768 576-pixel digital image, giving a 0.25-
mm spatial resolution of the visual field. The frame grabber was interfaced with a
300-MHZ Pentium II personal computer.
given the value 0. This new binary image was stored in a frame file on disk for
subsequent analysis. During each 10-min recording, an image was captured and
processed approximately every 1/12 s, so each 10-min frame file contained about
7,200 binary frames (occupying less than 6 MB of disk space).
Figure 2. A: The pixel assemblage, representing the fish silhouette in each cap-
tured image, can be resolved into its principal axes by computing the
eigenvectors. These axes can be transformed into an oriented coordi-
nate system by finding the head and tail ends of the fish. This is done by
Downloaded by [University of Alberta] at 03:27 31 December 2014
counting the number of fish pixels inside two circles of equal radius,
placed two standard deviations from the origin of the y-axis in both direc-
tions. The direction with the largest pixel count signifies the direction
of the fishs head. B: A measure of the curvature of the fishs body can be
found by dividing the pixel assemblage into two parts, separated by the
smallest of the principal axes (x-axis). Subsequently, the two pixel masses
are treated as separate objects of which new sets of principal axes can
be computed. The angle between the two y-axes represents a measure
of the fish curvature.
is recognized when all classifiers are fulfilled simultaneously. Thus, before analyzing
the frame files, the appropriate combination of search criteria describing the spe-
cific behavior is set once for all. This is done by repeatedly refining and verifying
the search criteria until the softwares interpretation of the behavior in all situations
agrees with this particular behavior checked by human observer. This manipulation
is easily performed by combining a graphical user interface for entering search crite-
ria (Figure 4) with a real-time replay facility in the DISPLAY program. It is therefore
the human operator with his/her superior integrative capability that defines the
behavior for which to search. The computer will then untiringly and consistently
quantify the particular behavior resulting from this interpretation.
The measurement of the males posturing behavior (i.e ., the time he spent in front
of the female introducing the next sigmoid display) involves three search criteria.
First, the male must be in front of the female (pass values of in Figure 3A set to
0 < < 90 ). Second, the male must at least partly face the female ( criterion
in Figure 3A set to 0 < < 60 ). Note that all angles are presented without signs
because there is no distinction between the right side and left side of the fish. Finally,
Figure 4. The analyses screen in the DISPLAY program. In the display area,
the frame file of binary images can be replayed and analyzed. In
the captured image shown here, the male is performing a sigmoid
display toward the much larger female. In the lower screen area is
shown a pop-up window with the classifiers defining the sigmoid dis-
play. Note that the small circles are all within the rectangles lim-
iting the pairwise classifier values (defined in Figures 2 and 3),
implying that all criteria for the sigmoid display are met in this
frame. Distance: distance between the centroids of the two fish (a in
Figure 3); FAngle: position of the female relative to the male measured
as the angle (0180 ) between the males y-axis and a line between the
two fishs centroids ( in Figure 3); MAngle: position of the male relative
to the female measured as the angle (0180 ) between the females y-axis
and a line between the two fishs centroids ( in Figure 3); MShape: male
cuvature ( in Figure 2).
the two fish must be within a distance of a few centimeters (a in Figure 3A set to <
60 mm).
The guppy sigmoid display is a much more complex behavior. Firstly, the combi-
nation of involved parameters and their ranges of pass values change during the
course of the display. Accordingly, a positive identification of the entire display by
the software requires temporal adjustments of the search criteria. This is achieved
by associating a timer to each search criterion, engaging and disengaging its function
(Figure 4). The onset of the display is characterized by the male being within the
anterior part of the females field of view for at least 0.2 s (0 < < 90 ; time out
0.2 s) at a distance of at least 22 mm (a > 22 mm) exposing the side of his body
( > 68 ), which is locked in a distinct curvature for at least 0.5 s ( > 20 ; time out
0.5 s). After this initial phase the rules are changed allowing the male to move within
the females entire field of view (0 < < 140 ), but with his body still locked in a
curvature ( > 5 ) with the convex side continuously facing her ( > 68 ). Display
termination is registered when one or more of these criteria are no longer fulfilled.
The frame files of all treated and control fish were analyzed by the DISPLAY
software. The complete analysis of a 10-min frame file takes about 25 s with a
300 MHz Pentium II computer. The time devoted to posturing behavior, number and
duration of the sigmoid displays and the average values of all the measured parameters
are saved in a data file for subsequent statistical analysis.
Downloaded by [University of Alberta] at 03:27 31 December 2014
followed by Dunnetts test for multiple comparisons, *p < .05; **p <
.0001.
and 10.0 g/mg fodder), which was used as the positive antiandrogenic control. A
group of male guppies receiving uncontaminated fodder served as controls. Follow-
ing exposure, each male was paired with a non-receptive (gravid) female in the test
aquarium. Non-receptive females were used to preclude copulations and hence to
ensure constant female responses toward all males. The scenario was then recorded
for 10 min after which the posturing behavior and the sigmoid displays were quantified
together with the each of the seven behavioral elements. In Figure 5 the effects of
the lowest application rates of the three antiandrogens is shown. It can be noted that
the sexual instinct of the male guppy was seriously compromised by these chemicals.
The number of posturing behaviors (and time devoted to this behavior, data not shown
here) were significantly inhibited after exposure to the lowest doses of Vinclozolin
and p ,p -DDE, and all three chemicals significantly suppressed sigmoid displays.
FUTURE DEVELOPMENT
The behavior vision system presented here was developed with the aim of quanti-
fying complex behavior patterns in guppy and mosquitofish, and as such is confined
to establish the head and tail ends of torpedo-shaped fish. In order to extend the
applicability of the system, it is desirable to include other silhouette shapes such
as flatfish as well as other animal species. Also, it is planned to upgrade from the
present two-dimensional system to a three-dimensional system by adding a second
camera. This will not only allow quantification of behavior patterns where depth is
involved, but will also greatly facilitate the frame-by-frame identification of the fish.
ACKNOWLEDGMENT
This work was supported by the Danish Natural Science Research Council.
REFERENCES
Baatrup E and Bayley M. 1993. Quantitative analysis of spider locomotion employing
computer-automated video tracking. Physiol Behav 54:8390
Baatrup E and Junge M. 2001. Antiandrogenic pesticides disrupt sexual characteristics in the
adult male guppy (Poecilia reticulata). Environ Health Persp 109:106370
Bayley M, Nielsen JR, and Baatrup E. 1999. Guppy sexual behaviour as an effect biomarker
of estrogen mimics. Ecotoxicol Environ Safety 43:6873
Bayley M, Junge M, and Baatrup E. 2002. Exposure of juvenile guppies to three antiandrogens
causes demasculinization and reduced sperm count in adult males. Aquat Toxicol 56:227
39
Chapin RE, Stevens JT, Hughes CL, et al. 1996. Endocrine modulation of reproduction.
Fundam Appl Toxicol 29:117
Clotfelter ED, Bell AM, and Levering KR. 2004. The role of animal behaviour in the study of
Downloaded by [University of Alberta] at 03:27 31 December 2014