Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Abstract. Timing is crucial for the quality of expressive music performances. It is a means to mediate musical
form and largely effects the emotive and motor characterization of a piece. Different epochs of music history do
not only differ in their compositional styles but also caused change processes in performance practise.
To facilitate musicological investigations in historically informed performances and their changes, especially in
the late baroque period, we had to create a software tool—less an autonomous performance system, rather a
high-level performance editing system. Flexible formal models for performative features should allow to explore
the parameter spaces and to simulate and evaluate a broad variety of styles: reserved baroque, affective romantic,
unprecise beginners, and so on.
This paper focusses on the timing aspects of musical performances. We identified four general feature classes,
namely tempo, rubato, constant asynchrony and human imprecision. To explore their degrees of freedom we
ran a number of evaluations of professional recordings, live performances, and experimental recordings. On this
basis we elaborate adequate formal models and describe their implementation within a MIDI-based performance
system.
the figuration of climaxes, melodic destinations, oboe). The advantage was that all interpretations
and musical phrases. Thus, it is applied over seg- played live and no recordings were improved after-
ments with musically medium-term and long-term wards. In addition, the recording equipment (AKG
extent, hence macro timing. C 1000 microphones and Zoom Handy H4 recorder)
Rubato Musical meter is rarely performed exactly. as well as its position and the room all recordings were
Little prolongations and compressions are used made in, were the same. An international jury selected
consciously and subconsciously to express fig- 15 players for recorder, who all studied or had been
ures, motifs, metric accentuations, peak tones etc. studying historically informed performance. We ana-
Accordingly, rubato defines musically short-term lyzed the compulsory piece, the sonata in f minor for
timing deviations that take place within clearly recorder and basso continuo (from Telemann’s “Der ge-
delimited frames. Any deviations also have to be treue Music Meister”). In the first movement, signed
compensated within the same timeframe to keep Triste, all performers played very distinct rubati.
up with the basic tempo. For that reason they In the experimental recordings 10 professional mu-
are called balanced deviations. These occur as sin- sicians for classical music as well as experts in histori-
gular phenomenons but more often as repetitive cally informed performance played baroque and mod-
schemes (e.g., in the Viennese waltz). ern instruments (brass, strings and woodwinds). To
get results that are free of any further contextual in-
Constant Asynchrony Different onsets between fluences, they performed ritardandi and accelerandi on
musicians in an ensemble do often show system- non-melodic tone repetitions.
atic behaviour. It is originated in the hierarchy Beats and onsets were detected in two steps, which
of instruments in the score (leading parts are combined automatic onset detection and human tap-
ahead) and is affected in its extent by the overall ping. The automatic onset detection generated a num-
tempo [14]. ber of onset hypotheses based on algorithms described
Human Imprecision Within the analyses deviations by Duxbury et al [2], the power over time of an au-
occur that cannot definitely be traced to a system- dio signal1 and changes in energy between various fre-
atic reason. Even if effects of fingering, shifting, quency bands in a sequence of spectra2 [1]. These were
and room acoustics are taken into account, a rest hypotheses for single onsets and also for onsets, which
of imprecision remains. are of secondary relevance (e.g., arpeggiated cembalo
To determine appropriate parameter settings for par- play). By tapping, we set markers within the hypothe-
ticular musical contexts and styles we carried out a sis space. These markers provided clues to identify the
number of performance evaluations as described in the most valid hypotheses which were used for tempo and
following. rubato analyses.
The parameter spaces defined in the previous section Every performance of the Trumpet Concerto showed
were discovered by an analysis of live, studio, and ex- outstanding deviations in timing to mark phrase
perimental recordings. boundaries. However, we could not find any evidence
for permanent tempo changes over a long period of
3.1 Methodology time. To evaluate whether successive deviations in
note lengths can be described with a curve, we approx-
The studio recordings were represented by 10 pro- imated the successive deviations with linear, quadratic
fessionally produced recordings of G. P. Telemann’s and cubic functions in the first six bars of the ada-
Trumpet Concerto in d major (TWV 51:D7). This gio. Only two performances showed a significance of
chamber concert is one of the most famous baroque α > 0.05 with the cubic function as the best fitting
concerts for trumpet and typical in its form [7]. Af- one, followed by the quadratic function.
ter a global analysis of tempo changes we focused on
In contrast to the phrase arch performance, which
the first six bars of the first movement, the adagio.
consists of an acceleration to a turning point and a
There, the most tempo changes emerged, leading us to
slowdown until the end of a phrase, we could neither
assume a possible phrase-dependent performance. We
detect tempo changes over the whole phrase, nor an
also present results of rubato analyses, using the ex-
acceleration to a turning point (only for one out of ten
ample of three motific groups of four sixteenth notes.
The live recordings were made during the 5th In- 1 http://sv.mazurka.org.uk/MzPowerCurve
ternational Telemann Competition for historical wood- 2 http://mazurka.org.uk/software/sv/plugin/
wind instruments (recorder, baroque flute and baroque MzSpectralFlux/
-2-
Expressive Musical Timing
Adagio
acc
P
nner
er
and
occurrence 11 6 4 3 6 30
acce
do Triste
l
er
an
rd
ando
-3-
Expressive Musical Timing
First-Note-Lengthening
lssl lsll
R2 F α R2 F α Figure 2: Rubato over four sexteenth notes in the
lin. .985 195 .0008 .989 261 .0005 Triste movement.
log. .983 169 .0010 .971 102 .0020
pow. .983 172 .0010 .985 193 .0008
linear function would describe an exact equal playing
Table 3: Best fitting curves for the rubato over four that was excluded because of the above-mentioned re-
sixteenth notes in the Triste. lin.=linear, log.= log- sults. The power curve just overlaid the linear one
(with marginal deviations in a more unfavourable di-
arithmic, pow.= power function. l =long, s=short
rection than the mean curve), and therefore has to be
excluded as well.
More obvious results we found in the live record-
The often found last-note-lengthening [3, 4] depends
ings of the Triste movement. Here, two groups of four
on the importance of the following first note. In the
sixteenth notes occur and are performed by 15 inter-
Triste the last notes have been played longer at the
preters. As seen in Table 2, for most of the part the
end of the phrase. Therefore, the last note should not
contour long-short-short-long (lssl ) was performed.4
be seen as a lengthened note. It rather has to be seen
A definite result has been the lengthening of the first
as an additional pause before the following phrase or
note. Compared to the mean deviations of the last
figure.
three sixteenths, the first was played from 15% up to
In the late nineteenth century, Riemann [18] sowed
140% longer (with mean x̄ = 66% and SD = 28%).
the seed with his rules of agogic from which contempo-
Nevertheless, the high variation of the first note shows
rary performances developed and still refer to, respec-
its outstanding position. This can also be seen in Fig-
tively. In this regard, we discovered differences, ex-
ure 2, were the accumulated intervals are shown. The
emplified on historically informed performance. They
lengthening of the first note results in a maximum de-
concern tempo and rubato features, their shape char-
flection of the performance curve, referring to an as-
acteristic and intensity. Thus, a synthetic perfor-
sumed equal play.
mance must guarantee the flexibility in rubato and also
The most frequent contours lssl and lsll in the
tempo, particularly the various shapes and curvatures.
recorder sonata (see Table 2) were approximated sepa-
In the following we will describe our approach to this.
rately, as demonstrated in Table 3. As the curve does
not describe the relative deviations, the logarithmic
function as well as the linear and power function fit 4 Macro Timing
best. Apart from the statistical relevance of these find- For the formalization and implementation of timing
ings, the logarithmic function has to be preferred: A features we decided to keep the macro-micro distinc-
4 It has to be mentioned that the cembalist decides the tion. This Section will focus on macro timing and
length of the last sixteenth note, and therefore if it will be- describe our approach to modeling expressive musical
come long or short. The recorder only plays four sixteenth tempo within a performance system. In order to sup-
notes and ends in a pause, filled by the continuo. port the huge amount of characteristics, as discovered
-4-
Expressive Musical Timing
-5-
Expressive Musical Timing
5 Micro Timing 1
Micro-level timing features add fine-structured details r2
q qq
to the macro-timing curve. They often show a repeti-
tive or irregular but continual behavior.
q q
rubato time
5.1 Formalization
q
Micro-level timing features have to be differentiated as
q q
those with systematic and those with apparently ran-
qq q
dom behavior. Both can change over time; imprecise
r1
q
ensemble play can, e.g., be originated in a situation
within the composition which is technically difficult to
0
i>1
i=1
0<i<1
realize. As a result, both feature types are to be or- metrical time 1
q q q q
ganized as dated entries within ordered lists MS (sys-
tematic deviations) and MR (random imprecision).
Systematic Deviations
Figure 3: Three rubato deviation schemes for a
Rubati and constant deviations are both of systematic timeframe of four quarter notes with different set-
type, hence, summarized into one formalism (m is the tings for i.
index of the MS list entry):
Sm = (dm , fm , r1m , r2m , im , cm )
Random Imprecision
In correspondence to the tempo formalism (see Sec-
tion 4) dm indicates the tempo-independent date (in Up to now, the performance is perfect regarding macro
MIDI ticks) from when on the micro-level deviations and micro timing. Nevertheless, human musicians are
are to be applied. It is terminated by dm+1 . rarely able to perform all nuances perfectly. Even ex-
The simplest kind of deviation, the constant asyn- tensively trained professionals are subject to psycho-
chrony, is a plain delay. Its value is given by attribute logical and motor conditions which introduce a gaus-
cm in milliseconds (cm ∈ Z). sian distribution into the accuracy of micro timing.
All remaining attributes define the rubato deviation Friberg’s KTH rule system implements this perfor-
scheme (see Figure 3) which is continuously applied to mance noise by two components: the musician’s motor
all consecutive timeframes of length fm (in ticks). One delay and long term tempo drifts [4]. The latter, i.e.,
timeframe may, e.g., cover the length of a measure, a long term tempo drifts, have to be classified as macro-
figure, or even less. Since all rubato deviations have to timing features (see Section 4). Human imprecision
compensate within the same frame, fm also defines the causing micro deviations, however, have to be applied
meter of overall synchrony. Consequently, the rubato and parameterized more carefully to measure up with
deviation scheme must be a mapping of metrical time the qualitative aspects of player’s aptitude.
to rubato time in the domain [0; fm ). It can change over time according to the musical con-
The potential function in [0; 1) again turned out to text and technical difficulty. Thus, we organize these
provide a sufficient behaviour. So the timeframe was deviations as dated information in an ordered list MR .
scaled down to this domain. Exponent im controls An entry
whether the time has to: Rm = (dm , σm )
– be stretched in the beginning and compressed in
defines the normal distribution around the exact mil-
the end (0 < im < 1),
liseconds date of all note events in [dm ; dm+1 ) with a
– be accelerated in the beginning and stretched in standard deviation of σm (in milliseconds).
the end (im > 1), or
– remain unchanged (im = 1). 5.2 Implementation
An initial non-negative delay can be set by r1m . Cor-
To get the definite milliseconds date for each note
respondingly, r2m sets the arrival at the end of the
event, all micro-timing deviations have to be added to
frame early. Both attributes indicate a relative posi-
the macro timing. The whole sequence of date trans-
tion within the timeframe and have to hold the follow-
formations is illustrated in Figure 4.
ing condition:
For numerical reasons, the rubato transformation is
0 ≤ r1m < r2m ≤ 1; r1m , r2m ∈ R already applied to the tempo-independent tick date by
-6-
Expressive Musical Timing
-7-
Expressive Musical Timing
[5] A. Friberg and J. Sundberg. Does Music Perfor- [17] B. H. Repp. A Microcosm of Musical Expression.
mance Allude to Locomotion? A Model of Final I. Quantitative Analysis of Pianists’ Timing in the
Ritardandi Derived from Measurements of Stop- Initial Measures of Chopin’s Etude in E major.
ping Runners. The Journal of the Acoustical So- The Journal of the Acoustical Society of America,
ciety of America, 105(3):1469–1484, March 1999. 104(2):1085–1100, 1998.
[6] GRAME. MidiShare Developer Documentation. [18] H. Riemann. Musikalische Dynamik und Agogik,
Computer Music Research Lab., France, 1.91 edi- Lehrbuch der musikalischen Phrasierung auf
tion, Jan. 2006. Grund einer Revision der Lehre von der musikalis-
[7] W. Hirschmann. Telemann, Georg Philipp— chen Metrik und Rhythmik. Hamburg, Germany,
Die Konzerte. In I. Allihn, editor, Barock- 1884.
musikführer Instrumentalmusik 1550–1770, pages [19] N. P. M. Todd. The dynamics of dynamics: A
450–454. Metzler und Bärenreiter, 2001. model of musical expression. The Journal of the
[8] W. Hobohm. Berührungspunkte in den Biografien Acoustical Society of America, 91(6):3540–3550,
Georg Philipp Telemanns und Johann Sebastian 1992.
Bachs sowie ihrer Familien, volume 18 of Magde- [20] M. M. Wanderley and C. Cadoz. Gesture-Music.
burger Telemann-Studien, chapter 1. Georg Olms, In M. M. Wanderley and M. Battier, editors,
Hildesheim, Zürich, New York, 2005. Trends in Gestural Control of Music, pages 71–
[9] H. Honing. The Final Retard: On Music, Motion, 86. Ircam, Centre Pompidou, 2000.
and Kinematic Models. Computer Music Journal, [21] G. Widmer and W. Goebel. Computational Mod-
27(3):66–72, 2003. els of Expressive Music Performance: The State
[10] P. N. Juslin. Cue Utilisation in Communication of the Art. Journal of New Music Research,
of Emotion in Music Performance: Relating Per- 33(3):203–216, Sept. 2004.
formance to Perception. Journal of Experimental [22] G. Widmer and A. Tobudic. Playing Mozart by
Psychology: Human Perception and Performance, Analogy: Learning Multi-Level Timing and Dy-
26(6):1797–1813, 2000. namics Strategies. Journal of New Music Re-
[11] G. Milmeister. The Rubato Composer Soft- search, 32(3):259–268, Sept. 2003.
ware: Component-Based Implementation of a
Functional Concept Architecture. PhD thesis,
Mathematisch-naturwissenschaftliche Fakultät
der Universität Zürich, 2006.
[12] J. J. Quantz. Versuch einer Anweisung die Flöte
traversière zu spielen. Bärenreiter, reprint (1997)
edition, 1752.
[13] J. J. Quantz. Brief an Telemann vom 11. Januar
1753, pages 364–366. VEB Deutscher Verlag für
Musik, Leipzig, Germany, 1972.
[14] R. A. Rasch. Synchronisation in Performed En-
semble Music. Acustica, 43:121–131, 1979.
[15] R.-J. Reipsch. Zur Rezeption von Telemanns
Kompositionen für Traversflöte im Umfeld von
Quantz—Neues aus dem Notenarchiv der Sing-
Akademie zu Berlin. In B. E. H. Schmuhl and
U. Omonsky, editors, 34. Wissenschaftliche Ar-
beitstagung Michaelstein 2006—Zur Flötenmusik
in Geschichte und Aufführungspraxis von 1650 bis
1850, Michaelstein, Germany, 2009.
[16] B. H. Repp. Diversity and Commonality in Music
Performance: An Analysis of Timing Microstruc-
ture in Schumann’s “Träumerei”. Journal of the
Acoustical Society of America, 92(5):2546–2568,
1992.
-8-