Sei sulla pagina 1di 11

Ann. N.Y. Acad. Sci.

ISSN 0077-8923

A N N A L S O F T H E N E W Y O R K A C A D E M Y O F SC I E N C E S
Special Issue: The Neurosciences and Music VI
PERSPECTIVE

Now you hear it: a predictive coding model


for understanding rhythmic incongruity
Peter Vuust,1,2 Martin J. Dietz,3 Maria Witek,1,2 and Morten L. Kringelbach1,2,4
1
Center for Music in the Brain, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark. 2 The Royal Academy of
Music, Aarhus/Aalborg, Aarhus, Denmark. 3 Center for Functionally Integrative Neuroscience, Department of Clinical
Medicine, Aarhus University, Aarhus, Denmark. 4 Department of Psychiatry, University of Oxford, Oxford, United Kingdom

Address for correspondence: Peter Vuust, Professor, M.Sc., Ph.D., Director, Center for Music in the Brain (MIB), Department of
Clinical Medicine, Aarhus University, Royal Academy of Music, Nørrebrogade 44, 8000 Aarhus C, Denmark.
petervuust@gmail.com

Rhythmic incongruity in the form of syncopation is a prominent feature of many contemporary musical styles.
Syncopations afford incongruity between rhythmic patterns and the meter, giving rise to mental models of differently
accented isochronous beats. Syncopations occur either in isolation or as part of rhythmic patterns, so-called grooves.
On the basis of the predictive coding framework, we discuss how brain processing of rhythm can be seen as a
special case of predictive coding. We present a simple, yet powerful model for how the brain processes rhythmic
incongruity: the model for predictive coding of rhythmic incongruity. Our model proposes that a given rhythm’s
syncopation and its metrical uncertainty (precision) is at the heart of how the brain models rhythm and meter based
on priors, predictions, and prediction error. Our minimal model can explain prominent features of brain processing
of syncopation: why isolated syncopations lead to stronger prediction error in the brains of musicians, as evidenced
by larger event-related potentials to rhythmic incongruity, and why we all experience a stronger urge to move to
grooves with a medium level of syncopation compared with low and high levels of syncopation.

Keywords: rhythm; music; predictive coding; brain

A brief introduction to predictive coding sations. These causes are hidden in the sense that
things in the world can only be observed through
Prediction is increasingly viewed as a fundamental
noisy sensory input that evolves over time. Compu-
principle of brain processing that determines per-
tationally, this model inversion could be achieved in
ception, action, and learning. Emerging predictive
continuous time by minimizing a free-energy bound
coding (PC) theories1–6 have offered novel explana-
on the surprise F > − ln p(s̃ |m) about sensory
tions for how specialized brain networks can identify
input s̃ given the brain’s model m of the world. The
and categorize causes of its sensory inputs, integrate
free energy F is a function of sensory input s̃ and a
information with other networks, and adapt to new
probability density q (␽) that parameterizes its hid-
stimuli. Here, for simplicity, we will use the term PC
den causes and their states.
as synonymous with Karl Friston’s hierarchical PC
framework.5 Briefly, PC proposes that perception, F = E q [ln q (␽|μ) − ln p(s̃ , ␽|m)] (1)
action, and learning constitute a recursive Bayesian
process by which the brain attempts to minimize the Minimizing the free energy F corresponds to
prediction error between lower level sensory input maximizing the evidence ln p(s̃ |m) for the brain’s
and the brain’s top-down predictions. An excel- model of the world.6 In PC, top-down connections
lent summary of the recent advances was given by provide lower levels with predictions in the form
Clark.5 of prior expectations about states of the world,
Under a Bayesian formulation of PC in the brain, whereas bottom-up connections carry prediction
perception corresponds to inverting a generative errors that update posterior expectations in higher
model of the things in the world that cause our sen- levels to provide better predictions. This leads
doi: 10.1111/nyas.13622
Ann. N.Y. Acad. Sci. 00 (2018) 1–11 
C 2018 New York Academy of Sciences. 1
Now you hear it Vuust et al.

to the following hierarchical equations for how pated patterns (groove). However, the model may
top-down predictions g (μ(i ) ) given by posterior possibly be further extended to microtiming and
expectations μ(i ) at higher levels and bottom-up maybe even to the relationship between tonal center
prediction errors (i ) = μ(i −1) – g (μ(i ) ) from lower and melody or harmony.
levels evolve when exposed to changes in stimuli s ˜: Figure 1 shows a schematic of our proposed
predictions: model. Specifically, we propose that the brain’s per-
  ception of syncopation is determined not only by the
∂g μ(i )
μ̇ =
(i )
· ξ(i ) − ξ(i +1) (2) prediction errors that follow from rhythmic incon-
∂ (i ) gruity, but also by how these are weighted by their
and precision-weighted prediction errors: relative precision. This means that the expected pre-
   cision encodes the confidence with which we extract
ξ(i ) = π(i ) μ(i −1) − g μ(i ) , (3)
the meter from a particular rhythm. By assigning
where the dot notation (·) denotes the time deriva- more or less precision or confidence to the ensuing
tive and ␲ is the precision assigned to the prediction prediction errors, the brain perceives the rhythm as
errors. The i index is used to refer to a relative hierar- more or less syncopated, because these prediction
chical level. Both higher level predictions and lower errors are given more salience. In other words, the
level prediction errors are weighted by their pre- prediction errors that matter are those to which we
cision. The precision is the inverse of the variance assign a greater precision or confidence. This means
and encodes the confidence about sensory inputs in that the prediction errors that matter for perceptual
lower areas, relative to the confidence with which synthesis have to be violations that are “predictably
states in the world that cause sensory inputs can be unpredicted.” If there are too many violations, pre-
predicted in higher areas. diction errors will be attenuated because the “pre-
dicted precision” is itself too low, and there is a high
The predictive coding of rhythmic
degree of uncertainty about the meter. In the case of
incongruity model
syncopation, we can obtain an estimate of both the
In terms of music, the ideas behind PC in the precision and the prediction error. The syncopation
brain are remarkably similar to theories address- in a given musical rhythm can be calculated directly
ing the role of prediction in music perception from the musical score, demonstrated, for exam-
and appreciation.7,9,10 Predictive processes consti- ple, by Longuet-Higgins and Lee’s formulation or
tute central mechanisms in the perception and cog- Witek and colleagues’ adjusted formulation.19 The
nition of music. They are prerequisites for joint precision (metrical uncertainty) can be behaviorally
music making11–13 and are essential for musical estimated by measuring participants’ sensorimotor
tension and surprise,10 as well as for intramusi- synchronization to the beat using finger-tapping
cal meaning.9 For this reason, several authors have paradigms20,21 or motion capture22,23 or by neu-
proposed music as an ideal domain for testing and rophysiological measures.24,26
further developing PC theories,15,16 informing our In the following, we show how PC in general and
understanding of brain mechanisms in general, and the PCRI model in particular can help to explain
perhaps even helping us to understand the funda- experimental observations concerning musical
mental prediction principles of the brain. rhythm and meter. In particular, we will demon-
Recent behavioral and neuroscientific experi- strate that PCRI accounts well for the observed U-
ments have shown how brain processing of rhythm shaped relationship between syncopation and expe-
can be seen as a special case of PC.17 This prompted rience of groove and for the effect of expertise on
us to develop a simple yet powerful model explain- brain processing of syncopations, where the predic-
ing how the brain processes rhythmic incongruity: tion errors that matter for the perception of syn-
the predictive coding of rhythmic incongruity copation are violations that are predictably unpre-
(PCRI) model (Fig. 1). The present account focuses dicted under the brain’s model of the meter.
on two phenomenologically distinct yet structurally
Predictive coding of rhythm
related types of rhythmic incongruity: the occa-
sional appearance of a surprising beat followed by Traditionally, music theory holds that rhythmic
a surprising rest (syncopation) and repeated synco- events are perceived as groupings of temporal events

2 Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences.
Vuust et al. Now you hear it

Figure 1. Proposed model of the predictive coding of rhythmic incongruity (PCRI). The figure provides a schematic illustration
of the variables related to increasing syncopation of musical grooves (dotted lines). (A) Under predictive coding, the precision-
weighted prediction error is given by the difference between the sensory stream s̃ and the brain’s predictions g(␮) timed with
the precision ␲. The i index is used to refer to a relative hierarchical level in the brain. For grooves, the syncopations result in a
prediction error ⑀ = s̃ − g(␮), which can be calculated directly from the score by using, for example, Witek et al.’s modification of
Longuet-Higgens and Lee’s formulation. (B) By assigning more or less precision or confidence to the ensuing prediction errors, the
brain perceives the grooves as more or less groovy. (C) We propose that the observed U-shaped relationship between syncopation
and grooviness93 can be explained by the PCRI model as a function of the level of syncopation and precision or confidence assigned
to the ensuing prediction errors. (D) The formulas for describing the relationship.

against the backdrop of an implied reference struc- sible experimental setting, when they showed that
ture, namely, the meter. The meter is a hierarchical listening to a series of entirely regular and unac-
framework consisting of evenly spaced and differ- cented metronome beats causes the brain to auto-
entially accented beats, providing to each metric matically register the beats as alternating in salience
position a timing and a metrical weight. The met- (a 2/4 or a 4/4 meter). In PC terms, the brain is inter-
rical weights are thought to linearly correspond to preting the neutral input, in this case unaccented
the strength of the expectation toward events occur- metronomic beats, according to its own predictive
ring at these time points.18 In other words, the more framework (the meter27,28 ).
metrically salient a position is in the hierarchy, the Important for our PCRI model, the way we expe-
stronger the expectation that events will occur at rience the rhythmic content in music is heavily
this metrical position. dependent on how precise our model of the meter is.
Under PC, the rhythm is the acoustical input to In music, the rhythms will usually be much less pre-
our ears, whereas the meter is the brain’s posterior dictable than simple metronomic beats. They will in
expectations that constitute its predictive model. different ways engage the brain, creating prediction
The rhythm can be more or less in accordance with error that can challenge the metrical model, even to
the meter, creating stronger or weaker prediction the point where a different meter may be as good
error between auditory input and predictive model. or better at explaining the auditory input.29,30 The
Brochard et al.24 provided strong evidence for the latter is the case for polyrhythm, where two rhythms
existence of metric expectations in the simplest pos- indicating two competing meters are played

Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences. 3
Now you hear it Vuust et al.

simultaneously, creating tension between the rhyth- inference when choosing a mental model for inter-
mic events and the meter.29 When listening to music, preting noisy sensory data. Note, though, that such a
the brain is constantly trying to assess the plau- behavioral finding is not sufficient to conclude that
sibility of competing models or hypotheses (i.e., the brain processes are also governed by Bayesian
meters), given its musical input. The ensuing predic- inference.
tion errors are evoked by the actual music (bottom-
up) on one hand and depend on the expectations Syncopations and PCRI
of the interpreting brain (top-down) on the other Our PCRI model targets the frequently investigated
hand. Importantly, brain processing and structure example of prediction error arising from a rhythm-
underlying musical expectation are shaped by cul- meter discrepancy: syncopation.18,19,38,39 Syncopa-
ture, personal listening history, musical training, tion occurs when onsets occur on metrically weak
and biology.31–36 accents and subsequent rests or tied notes occur
The central PC claim that the brain uses Bayesian on metrically strong accents (Fig. 2). Such expecta-
inference when choosing a plausible metrical model tions can be conceptualized in Bayesian terms:40,41
for a given rhythmical input was recently supported by assigning relative probabilities to all notes and
experimentally. Using a finger-tapping paradigm, rests of a pattern, based on prior information about
Elliot and colleagues provided evidence suggest- statistical frequencies and a hierarchical model of
ing that humans exploit a Bayesian inference pro- meter, a syncopation’s perceptual effect is a con-
cess to control movement timing when facing sequence of its predictability within the context of
microtemporal differences.37 They presented two music as a whole. Importantly, for a syncopation
metronomes of equal tempo but differing in phase to obtain its characteristic effect, it must be experi-
and temporal regularity to participants and asked enced as contradicting the meter, yet not so strongly
participants to synchronize their tapping with the that the experience of the meter falls apart. Synco-
experienced beat. When participants chose to inte- pations can also be thought of as phase-shifts, where
grate the two timing cues into a single-event esti- the rhythmic onset, rather than occurring in phase
mate, modeling the behavior as a Bayesian infer- with its metric reference point, has a negative lag
ence process provided a better description of the and occurs before it. Hence, syncopations will influ-
data than other plausible models. This is consis- ence the two terms on the right side of the upper
tent with the PC claim that the brain uses Bayesian equation in Figure 1. On one hand, they create a

Figure 2. Syncopation and meter. (A) Syncopation is a mismatch between the auditory input (the rhythm) and the meter (the
brain’s predictive model: s and w denote strong and weak beats, respectively), which creates prediction error between lower level
sensory areas and higher level areas (B) leading to perception, action (in the form of wanting to move), emotion, and learning.

4 Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences.
Vuust et al. Now you hear it

prediction error between the sensory input and the The neural processing of these isolated syncopa-
prediction. On the other hand, they may unsettle tions seems to involve the attentional network. The
the precision of our meter perception and thus the MMNm, originating primarily in the auditory cor-
precision-weighted prediction error. tices, was followed by a P3am that was localized to a
larger network tying together components from the
Using the PCRI model to understand
auditory cortex with the parietal and frontal brain,
isolated syncopations in musicians
consistent with the typical localization of the P3a to
Vuust and colleagues were the first to note that neu- frontal,50,51 auditory,52,53 and temporoparietal54,55
ral responses to isolated syncopations occurring in sources (for a review, see Ref. 56). Research on
continuous rhythmic streams are consistent with the P3a demonstrates that it represents a network with
PC framework in that they have properties similar both task-specific and general elements.56 One likely
to electrophysiological error signals and their sub- explanation is that the P3a reflects a network involv-
sequent evaluation.14 They performed magnetoen- ing both the modality/task-specific areas evoking
cephalography while musicians and nonmusicians the error signal and higher regions that can eval-
were listening without attending to isolated syn- uate it.44 This is exactly what would be expected
copations occurring pseudo-randomly in musical for error signals in response to a rhythmic incon-
drum rhythm excerpts. These syncopations elicited gruity in a PC framework, suggesting that the P3am
two prominent event-related potentials (ERPs), the reflects a neural network that acts on the error sig-
magnetic counterpart of the mismatch negativity nal of the MMN. The MMN and the P3a are gener-
(MMNm) and the P3am. The mismatch negativity ally believed to reflect different stages of processing
appears to have the properties of an error signal aris- subserving an attention-switching mechanism.57,58
ing from superficial cortical layers as posited by PC. Whereas the MMN is thought to be the first stage
It is elicited to violations of auditory expectancy in involuntary attention capture,59 the P3a most
and has been found in response to pattern devia- likely reflects the actual switch of attention.60 The
tions determined by physical parameters, such as P3a response may indicate that attention should be
frequency,42 intensity,43 spatial localization,44 and designated to the metric violation as a means of
duration,45 but also to patterns with more abstract providing a better estimate. In terms of PC, there
properties.46,47 is an intimate relationship between attention and
Musical experts are known to have larger ampli- precision. Prediction errors that are afforded greater
tude and latency of the MMN.48,49 Accordingly, precision are effectively boosted, such that they have
in the study by Vuust and colleagues, rhythmic a greater influence on higher level expectations and
expert musicians were observed to have larger MMN consequent predictions. Crucially, the brain has to
amplitudes compared with rhythmically unskilled predict both the content of the sensorium and its
participants. We know from a large corpus of tap- precision. Simulations of PC using, for example,
ping literature (for reviews, see Refs. 20 and 21) and the Posner paradigm suggest that late (endogenous)
neurophysiological data24 that musically trained responses, such as the P300, may reflect a revision of
individuals have more precise meter perception than beliefs about the precision or predictability of sen-
nonmusicians. As a result, the larger error response sory streams.61 This suggests that early (i.e., mis-
observed in the brains of rhythmically skilled musi- match negativity) violation responses correspond
cians is consistent with the PCRI model. Here, the to a precision-weighted prediction error, while later
precision-weighted prediction error is the difference (i.e., P300) responses reflect belief updates about
between the prediction and the sensory input, mul- precision per se that underwrite a redeployment of
tiplied by the precision of the prediction (Fig. 1). attentional gain.44
Hence, even though the discrepancy between the Music in general encompasses such incongruities
rhythm and the meter as measured in the stimu- that direct the listener’s attention toward salient
lus was the same for both musician and nonmusi- parts of the music. Vuust et al.14 found larger
cian participants, the experienced prediction error MMNm and P3am in experts, suggesting that both
is, according to the model, weighted differently. This the competence of the listener (top-down) and
is consistent with the larger ERPs to the rhythmic strength of the musical violation (bottom-up) deter-
incongruity in the musicians. mine whether attention is attracted to the stimulus.

Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences. 5
Now you hear it Vuust et al.

Participants tested in this study were all impro- the music.62–66 In groove-directed music, such as
vising musicians who need to be able to respond soul, funk, hip-hop, electronic dance music, and
swiftly to such incongruities,29 and it might be reggae, the tempo of the music is mostly kept
that they have developed a more precise metrical constant (Fig. 3). On one hand, this eliminates
model. Interestingly, the debriefing of the partici- the possibility of expressing emotions through
pants indicated that they did not consciously dis- tempo alterations, as is more common in classical
tinguish the different types of metric displacement music.67,68 On the other hand, a stable tempo makes
or display any aesthetic appreciation of the stimuli, it easier to create tension between the rhythm and
despite clear brain processing differences between the meter. In most groove-directed music, listen-
groups. ers expect the tempo to remain largely unchanged
within a certain piece. They may therefore evalu-
Groove
ate any rhythmic incongruity as a potential syn-
While syncopations occurring in isolation seem copation. This opens up a fine-grained grid of
to predominantly engage attention-switching brain possible rhythmic layers for the musicians to play
mechanisms, syncopations that occur regularly with. In these styles of music, the rhythm section,
within the rhythmic texture of music may have a usually consisting of drums/percussion, bass, and
quite different purpose and effect on the nervous guitar/keyboard, will often play repeated syncopated
system—one that makes us want to move and that rhythmic patterns (grooves), keeping the amount of
feels pleasurable. With many contemporary styles syncopation relatively constant in the different sec-
of popular music, especially music with African- tions of the pieces.69
American influences, the sensation of groove is an The pleasurable sensation of wanting to move
important affective response. Groove is character- to highly repetitive syncopated rhythms was inves-
ized by a pleasurable drive toward body movement tigated by Witek and colleagues in a series of
in response to rhythmically entraining elements in studies.22,66,70 Using a battery of 50 groove-based

Figure 3. Different musical styles have different relationships between rhythm and meter. The figure is a schematic illustration
of the stylistic differences in the use of syncopation and tension between rhythm and meter. (A) In classical music, the tempo is
(often) flexible, allowing for expressive timing. (B) In jazz music, the tempo is kept relatively constant, but the rhythm section will
constantly vary the degree of tension between the rhythms and the meter using single (*) or multiple syncopations and polyrhythms
(**). (C) In groove-based music, the tempo is ideally kept completely constant throughout a piece of music. Here, the rhythm
section will often play a groove in which the amount of syncopation in different sections of the piece is kept constant. Vocalists or
soloists might vary the use of syncopations, however.

6 Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences.
Vuust et al. Now you hear it

drum patterns, they asked participants in an online meter becomes obscured, leading to less precision
survey to rate the patterns on a 7-point Likert scale in the predictive model. Here, it is difficult for the
as to how much they wanted to move and the plea- brain to detect the signal in the noise. In contrast,
sure felt. The degree of syncopation in the stimuli what the system experiences as precision-weighted
was calculated using Witek et al.’s index of syn- prediction error is highest at intermediate levels
copation, which adds instrumental weights to the of syncopation for which both objective prediction
model proposed by Longuet-Higgens and Lee to error and the precision of the prediction are mod-
adjust for the polyphonic character of drum pat- erate (Fig. 1). According to PC, the brain can min-
terns. Briefly, a pattern’s overall degree of syncopa- imize prediction error through action. By moving
tion is calculated by taking the sum of differences the body in a way that changes the bottom-up pro-
in metrical weights between the notes and rest that prioceptive and sensory input and thus resamples
constitute the syncopations, adjusting for instru- the evidence,77 the error signal will self-suppress. In
mental weights. The 50 drum patterns included the context of groove, we feel the urge to move our
34 transcribed from real funk tracks, whereas the bodies to the metrical beat in order to—at least at
remaining patterns were constructed specifically an unconscious level—strengthen the metric model
for the experiment, aiming for a continuum from and suppress or attenuate the precision of prediction
weakly syncopated to strongly syncopated rhythm errors.
patterns. Witek and colleagues found an inverted Importantly, this reasoning is dependent on a lin-
U-shaped relationship between degree of synco- early decreasing relationship between meter percep-
pation and the groove ratings, suggesting that the tion and syncopation, as schematically shown in the
sensation of groove is strongest at intermediate lev- middle panel of Figure 1. This relation is partly
els of discrepancy between the rhythmic (sensory) supported by the decrease in synchronization in
input and the metrical predictive framework. The response to increase in syncopation found in Witek
inverted U-shape71 has earlier been hypothesized et al.’s motion capture study.22 Here, the results
to reflect the relationship between music complex- suggested a broken metrical model for the high-
ity and liking72–74 and perceptual complexity and est levels of syncopation. Hence, in addition to large
arousal in art more broadly,75 although empiri- prediction errors, the brain’s predictive model—by
cal studies have shown that this function largely which it explains away prediction error—is com-
depends on the musical style in question.74 In a sub- promised for high levels of syncopation, because it
sequent study, Witek and colleagues76 used motion no longer considers the sensory evidence to be suf-
capture to record free movements of hand and torso ficiently precise. In contrast, for the intermediate
while participants listened to a subset of 15 of the levels of syncopation, we may experience a strong
drum patterns mentioned above, categorized into drive toward reinforcing the meter by moving in
three levels of syncopation: low, medium, and high. time with the beat. We may here elect to ignore vio-
For low and medium levels of syncopation, partic- lations by attenuating or suppressing their sensory
ipants synchronized their movements to the meter, precision. This account rests on the formulation of
whereas for high levels of syncopation they synchro- sensory attenuation through the attenuation of pre-
nized very poorly. cision that accompanies the consequences of action.
In other words, in active inference formulations of
PC, it is necessary to suspend attention—to the con-
How to understand the inverted U-shape of
sequences of action—by attenuating sensory preci-
groove in terms of the PCRI model
sion to realize proprioceptive predictions (of the
The notion of an inverted U-shaped relationship sort involved in dancing). Psychologically, this cor-
between syncopation and the pleasurable drive to responds to ignoring the consequences of action to
move is congruent with the notion of precision- selectively discount evidence against our predictions
weighted prediction error as formulated in the PCRI of sensory input.78 Future studies should aim at test-
model, shown in the bottom panel of Figure 1. ing this hypothesis (e.g., comparing dancing and
The regularly organized rhythms with lower lev- nondancing participants’ perception of or memory
els of syncopation feed forward only little predic- for syncopation). Paradoxically, though, moving to
tion error. For the highest levels of syncopation, the the beat and hence reinforcing the meter allows for

Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences. 7
Now you hear it Vuust et al.

more precise predictions, which would reinforce the rodents86,87 has shown dopamine release to both
prediction error from subsequent syncopations. expected and unexpected stimuli, suggesting that
The urge to move to music seems to be related to the complex interaction between dopamine release
auditory–motor coupling, as described in a number and predictions leads to adaptive learning in the
of neuroscientific studies. These studies show activ- short and long term. A still unresolved question is
ity in brain networks linking auditory and sensori- whether the relationship between syncopation in
motor areas of the brain to the perception of musical groove and pleasure is modulated by the dopamine
rhythm.79,80 Furthermore, electrophysiological data system.
show that, even for rhythms in which the meter
Generalizability of the PCRI model
is not acoustically accented, the fundamental fre-
quencies of the meter still dominate the signal.81 For simplicity, we have restricted our PCRI model
Recently, Velasco and Large showed that partici- to target rhythmic syncopations. Importantly, we
pants’ degree of synchronization with increasingly have argued that it explains prominent features
syncopated rhythms could successfully be explained of the brain processing of syncopation. As evi-
by a neuronal network model encompassing a hier- denced by musicians’ larger ERPs to rhythmic
archy of only two levels: one corresponding to the incongruity, isolated syncopations seem to lead to
sensory system modeled with a simple Hopf bifur- larger precision-weighted prediction errors than in
cation and the other corresponding to the motor nonmusicians.88 As shown in subjective rating stud-
system tuned to operate near a double limit-cycle ies, listeners experience a stronger urge to move to
bifurcation.82 grooves with medium levels of syncopation, com-
Despite being consistent with the PCRI model’s pared with low and high levels.66 Here, it is impor-
rhythmic and metric levels, Large’s model does tant to note that the rhythm/meter dichotomy, a
not explicitly incorporate the behaviorally reported schematic prediction that is culturally learned from
pleasure aspect of groove. Prediction and expecta- early childhood,89 is only part of the predictive pro-
tion are frequently linked to emotion and pleasure cesses related to groove. While listening to a musical
in music scholarship,8 but there is still no empirical groove, the brain also forms short-term predictions
evidence for why medium levels of prediction error through drum/bass patterns that are repeated over
in music are the most pleasurable. Kringelbach and and over again and is influenced by veridical expec-
Berridge83 suggested that the brain rewards predic- tation (i.e., knowledge about the time course of
tion error since it leads to learning and thereby max- a specific musical piece after repeated listening).
imizes future prediction. Another perspective on These expectations are thought to be processed by
the paradoxical attractiveness of prediction errors different brain networks.8 For simplicity, the PCRI
is that they play a central role in active inference for- model does not at present consider these veridical
mulations of predictive processing. In this instance, predictive processes, but they could potentially be
prediction errors portend an opportunity to resolve incorporated into future versions of the model.
uncertainty and minimize prediction errors in the Another example of metric incongruity in groove
future.83 Formally, this has been cast in terms of is microtiming90 —the small temporal discrepan-
salience or epistemic affordance. This fits comfort- cies between the meter and the rhythmic events as
ably with the opportunity provided by predictably played or phrased by musicians and music produc-
unpredictable music. Rewarding actions minimize ers. However, the contribution of microtiming to the
the brain’s free energy or maximize epistemic value, pleasurable experience of wanting to move (groove)
thus building a more generalizable and accurate remains unclear. On one hand, it is clear that these
model of the world. In Bayesian terms, this trans- systematic incongruities between the actual realiza-
lates into an optimization of the evidence for our tion of the rhythms and the meter in well-played
models, or succinctly, self-evidencing.84 groove music exist.91 On the other hand, their con-
Though it is important not to confuse reward tribution to the sensation of groove has been dif-
prediction error with PC, a likely candidate for ficult to determine in a laboratory context. In a
mediating the effect of musical reward is the neu- recent study,92 Davies and colleagues found, con-
rotransmitter dopamine in the mesolimbic path- trary to common belief, that systematic increase in
way, as suggested by Gebauer et al.85 Research in microtiming led to decreased groove ratings, except

8 Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences.
Vuust et al. Now you hear it

for a prototypical jazz pattern. For this pattern, the Competing interests
groove ratings were largely unaffected, an effect that
The authors declare no competing interests.
was more pronounced in an expert listener group
than for untrained listeners. The general decrease
in groove ratings for larger magnitudes of micro- References
timing is consistent with PCRI. According to PCRI,
microtiming increase would supposedly lead to a 1. Friston, K. 2005. A theory of cortical responses. Philos. Trans.
R. Soc. Lond. B Biol. Sci. 360: 815–836.
decrease in metrical certainty, whereas the synco- 2. Bar, M. 2009. Predictions: a universal principle in the oper-
pation in the rhythms used in that study remained ation of the human brain. Philos. Trans. R. Soc. Lond. B Biol.
the same. However, as Davies et al.’s study indicates, 364: 1181–1182.
this effect can be overwritten by musical expertise. 3. Rao, R.P. & D.H. Ballard. 1999. Predictive coding in the visual
For expert jazz listeners, microtiming differences are cortex: a functional interpretation of some extra-classical
receptive-field effects. Nat. Neurosci. 2: 79–87.
stylistically expected; hence, they may not lower the 4. llinas, R.R. 2001. Prediction is the ultimate function of the
precision. This is consistent with our earlier dis- brain. In I of the Vortex. R.R. Llinas, Ed.: 21–52. Cambridge,
cussion of isolated syncopations, where musicians’ MA: The MIT Press.
larger ERPs compared with nonmusicians could be 5. Clark, A. 2013. Whatever next? Predictive brains, situated
explained by the fact that musicians have more sta- agents, and the future of cognitive science. Behav. Brain Sci.
36: 181–204.
ble metrical representations than nonmusicians. 6. Friston, K. 2010. The free-energy principle: a unified brain
theory? Nat. Rev. Neurosci. 11: 127–138.
7. Meyer, L. 1956. Emotion and Meaning in Music. Chicago, IL:
Conclusions and caveats University of Chicago Press.
In the present paper, we have presented a simple 8. Huron, D. 2006. Sweet Anticipation: Music and the Psychology
of Expectation. Cambridge, MA: The MIT Press.
model for understanding how the brain processes 9. Vuust, P. & M.L. Kringelbach. 2010. The pleasure of making
rhythmic incongruity, namely, the model for PCRI. meaning: evidence from the neuroscience of music. Interdis-
The model proposes that the explainable prediction cip. Sci. Rev. 35: 166–182.
error processed by the brain depends on a combina- 10. Rohrmeier, M.A. & S. Koelsch. 2012. Predictive informa-
tion of syncopation and the uncertainty of the meter tion processing in music cognition. A critical review. Int. J.
Psychophysiol. 83: 164–175.
perception. While this model can effectively explain 11. Keller, P.E., G. Knoblich & B.H. Repp. 2007. Pianists duet
important phenomenological aspects of rhythmic better when they play with themselves: on the possible role
incongruity, including expertise-related differences of action simulation in synchronization. Conscious. Cogn.
in brain processing of isolated syncopations and 16: 102–111.
the inverted U-shaped relationship between the 12. Gebauer, L., M. Witek, N. Hansen, et al. 2016. Oxytocin
improves synchronisation in leader–follower interaction.
experience of wanting to move and amount of Sci. Rep. 6. https://doi.org/10.1038/srep38416.
syncopation, we still lack evidence regarding the 13. Konvalinka, I., P. Vuust, A. Roepstorff, et al. 2010. Follow
pleasure component of the sensation of groove. We you, follow me: continuous mutual prediction and adapta-
may of course speculate that our affective evaluation tion in joint tapping. Q. J. Exp. Psychol. 63: 2220–2230.
of a rhythm’s relative “grooviness” also depends on 14. Vuust, P., L. Ostergaard, K.J. Pallesen, et al. 2009. Predictive
coding of music–brain responses to rhythmic incongruity.
a combination of the actual prediction error and Cortex 45: 80–92.
the uncertainty of our rhythmic prediction. In this 15. Friston, K. & D.A. Friston. 2013. A free energy formulation
regard, the PCRI model formulations emphasize of music generation and perception: helmholtz revisited. In
that rewarding actions are those that minimize the Sound–Perception–Performance. Vol. 1. R. Bader, Ed.: 43–69.
brain’s free energy, thus building a stronger and Basel: Springer International Publishing.
16. Schaefer, R.S., K. Overy & P. Nelson. 2013. Affect and non-
more accurate model of the world. However, it does uniform characteristics of predictive processing in musical
not consider prediction error as such to be positive behaviour. Behav. Brain Sci. 36: 226–227.
or negative. Future studies should aim to clarify 17. Vuust, P. & M.A. Witek. 2014. Rhythmic complexity and
the relationship between rhythmic incongruity predictive coding: a novel approach to modeling rhythm
and the resolution of uncertainty (i.e., salience and meter perception in music. Front. Psychol. 5: 1111.
18. Longuet-Higgins, H.C. & C. Lee. 1984. The rhythmic inter-
and epistemic affordance) and to determine the pretation of monophonic music. Music Percept. 1: 424–441.
role of this relationship in making meaningful and 19. Witek, M.A.G., E.F. Clarke, M.L. Kringelbach & P. Vuust.
enjoyable musical experiences. 2014. Effects of polyphonic context, instrumentation and

Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences. 9
Now you hear it Vuust et al.

metric location on syncopation in music. Music Percept. 32: 39. Ladinig, O., H. Honing, G. Haden, et al. 2009. Probing
201–217. attentive and preattentive emergent meter in adult listeners
20. Repp, B.H. 2005. Sensorimotor synchronization: a review without extensive musical training. Music Percept. 26: 377–
of the tapping literature. Psychon. Bull. Rev. 12: 969– 386.
992. 40. Temperley, D. 2007. Music and Probability. Campridge, MA:
21. Repp, B.H. & Y.H. Su. 2013. Sensorimotor synchronization: MIT Press.
a review of recent research (2006–2012). Psychon. Bull. Rev. 41. Temperley, D. 2010. Modeling common-practice rhythm.
20: 403–452. Music Percept. 27: 355–376.
22. Witek, M.A., T. Popescu, E.F. Clarke, et al. 2017. Syncopation 42. Sams, M., P. Paavilainen, K. Alho, et al. 1985. Auditory fre-
affects free body-movement in musical groove. Exp. Brain quency discrimination and event-related potentials. Elec-
Res. 235: 995–1005. troencephalogr. Clin. Neurophysiol. 62: 437–448.
23. Burger, B., J. London, M.R. Thompson & P. Toiviainen. 43. Näätänen, R., P. Paaviliainen, K. Alho, et al. 1987. The mis-
2017. Synchronization to metrical levels in music depends match negativity to intensity changes in an auditory stimulus
on low-frequency spectral components and tempo. Psychol. sequence. Electroencephalogr. Clin. Neurophysiol. 40: 125–
Res. https://doi.org/10.1007/s00426-017-0894-2 131.
24. Brochard, R., D. Abecasis, D. Potter, et al. 2003. The “tick– 44. Dietz, M.J., K.J. Friston, J.B. Mattingley, et al. 2014. Effec-
tock” of our internal clock: direct brain evidence of sub- tive connectivity reveals right-hemisphere dominance in
jective accents in isochronous sequences. Psychol. Sci. 14: audiospatial perception: implications for models of spatial
362–366. neglect. J. Neurosci. 34: 5003–5011.
25. Snyder, J.S. & E.W. Large. 2005. Gamma-band activity 45. Paavilainen, P., M.-L. Karlsson, K. Reinikainen, et al. 1989.
reflects the metric structure of rhythmic tone sequences. Mismatch negativity to change in spatial location of an audi-
Brain Res. Cogn. Brain Res. 24: 117–126. tory stimulus. Electroencephalogr. Clin. Neurophysiol. 73:
26. Jongsma, M.L., P. Desain & H. Honing. 2004. Rhythmic con- 129–141.
text influences the auditory evoked potentials of musicians 46. Paavilainen, P., J. Simola, M. Jaramillo, et al. 2001. Preatten-
and nonmusicians. Biol. Psychol. 66: 129–152. tive extraction of abstract feature conjunctions from audi-
27. Benjamin, W.E. 1984. A theory of musical meter. Music Per- tory stimulation as reflected by the mismatch negativity
cept. 1: 355–413. (MMN). Psychophysiology 38: 359–365.
28. Palmer, C. & C.L. Krumhansl. 1990. Mental representations 47. Van Zuijen, T.L., E. Sussman, I. Winkler, et al. 2004. Group-
for musical meter. J. Exp. Psychol. Hum. Percept. Perform. 16: ing of sequential sounds—an event-related potential study
728–741. comparing musicians and nonmusicians. J. Cogn. Neurosci.
29. Vuust, P. 2000. Polyrhythm and Metre in Modern Jazz—A 16: 331–338.
Study of the Miles Davis Quintet of the 1960’ies (Danish). 48. Vuust, P., E. Brattico, M. Seppanen, et al. 2012. Practiced
Aarhus: RAMA. musical style shapes auditory skills. Ann. N.Y. Acad. Sci.
30. Pressing, J., J. Summers & J. Magill. 1996. Cognitive multi- 1252: 139–146.
plicity in polyrhythmic pattern performance. J. Exp. Psychol. 49. Tervaniemi, M. 2009. Musicians—same or different? Ann.
Hum. Percept. Perform. 22: 1127–1148. N.Y. Acad. Sci. 1169: 151–156.
31. Zatorre, R.J. & I. Peretz. 2001. The Biological Foundations of 50. Daffner, K.R., M.M. Mesulam, P.J. Holcomb, et al. 2000.
Music. New York: New York Academy of Sciences. Disruption of attention to novel events after frontal lobe
32. Bangert, M. & G. Schlaug. 2006. Specialization of the spe- injury in humans. J. Neurol. Neurosurg. Psychiatry 68:
cialized in features of external human brain morphology. 18–24.
Eur. J. Neurosci. 24: 1832–1834. 51. Schröger, E., M.H. Giard & C. Wolff. 2000. Auditory distrac-
33. Chakravarty, M.M. & P. Vuust. 2009. Musical morphology. tion: event-related potential and behavioral indices. Clin.
Ann. N.Y. Acad. Sci. 1169: 79–83. Neurophysiol. 111: 1450–1460.
34. Bigand, E. & B. Poulin-Charronnat. 2006. Are we “expe- 52. Alho, K., I. Winkler, C. Escera, et al. 1998. Processing of novel
rienced listeners”? A review of the musical capacities that sounds and frequency changes in the human auditory cortex:
do not depend on formal musical training. Cognition 100: magnetoencephalographic recordings. Psychophysiology 35:
100–130. 211–224.
35. Tillmann, B., J.J. Bharucha & E. Bigand. 2000. Implicit learn- 53. Opitz, B., A. Mecklinger, A.D. Friederici, et al. 1999. The
ing of tonality: a self-organizing approach. Psychol. Rev. 107: functional neuroanatomy of novelty processing: integrating
885–913. ERP and fMRI results. Cereb. Cortex 9: 379–391.
36. Krumhansl, C.L., P. Toivanen, T. Eerola, et al. 2000. Cross- 54. Downar, J., A.P. Crawley, D.J. Mikulis, et al. 2000. A multi-
cultural music cognition: cognitive methodology applied to modal cortical network for the detection of changes in the
North Sami yoiks. Cognition 76: 13–58. sensory environment. Nat. Neurosci. 3: 277–283.
37. Elliott, M.T., A.M. Wing & A.E. Welchman. 2014. Mov- 55. Knight, R.T., D. Scabini, D.L. Woods, et al. 1989. Contribu-
ing in time: Bayesian causal inference explains move- tions of temporal–parietal junction to the human auditory
ment coordination to auditory beats. Proc. Biol. Sci. 281. P3. Brain Res. 502: 109–116.
https://doi.org/10.1098/rspb.2014.0751. 56. Friedman, D., Y.M. Cycowicz & H. Gaeta. 2001. The nov-
38. Fitch, W.T. & A.J. Rosenfeld. 2007. Perception and pro- elty P3: an event-related brain potential (ERP) sign of the
duction of syncopated rhythms. Music Percept. 25: 43– brain’s evaluation of novelty. Neurosci. Biobehav. Rev. 25:
58. 355–373.

10 Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences.
Vuust et al. Now you hear it

57. Knight, R.T. & D. Scabini. 1998. Anatomic bases of event- 74. Orr, M.G. & S. Ohlsson. 2005. Relationship between com-
related potentials and their relationship to novelty detection plexity and liking as a function of expertise. Music Percept.
in humans. J. Clin. Neurophysiol. 15: 3–13. 22: 583–611.
58. Woods, D.L. 1990. The physiological basis of selective atten- 75. Berlyne, D.E. 1971. Aesthetics and Psychobiology. East Nor-
tion: implications of event-related potential studies. In walk, CT: Appleton-Century-Crofts.
Event-Related Brain Potentials: Basic Issues and Applications. 76. Witek, M.A., E.F. Clarke, M. Wallentin, et al. 2015. Correc-
J.W. Rohrbaugh, R. Parasuraman & R. Johnson, Jr., Eds.: tion: syncopation, body-movement and pleasure in groove
178–209. New York: Oxford University Press. music. PLoS One 10: e0139409.
59. Schröger, E. 1996. A neural mechanism for involuntary 77. Friston, K. 2003. Learning and inference in the brain. Neural
attention shifts to changes in auditory stimulation. J. Cogn. Netw. 16: 1325–1352.
Neurosci. 8: 527–539. 78. Brown, H., R.A. Adams, I. Parees, et al. 2013. Active infer-
60. Escera, C., K. Alho, E. Schröger, et al. 2000. Invol- ence, sensory attenuation and illusions. Cogn. Process. 14:
untary attention and distractibility as evaluated with 411–427.
event-related brain potentials. Audiol. Neurootol. 5: 151– 79. Grahn, J.A. & M. Brett. 2007. Rhythm and beat perception
166. in motor areas of the brain. J. Cogn. Neurosci. 19: 893–906.
61. Feldman, H. & K.J. Friston. 2010. Attention, uncertainty, 80. Chen, J.L., V.B. Penhune & R.J. Zatorre. 2008. Moving on
and free-energy. Front. Hum. Neurosci. 4: 215. time: brain network for auditory–motor synchronization
62. Madison, G. 2006. Experiencing groove induced by music: is modulated by rhythm complexity and musical training.
consistency and phenomenology. Music Percept. 24: 201– J. Cogn. Neurosci. 20: 226–239.
208. 81. Nozaradan, S., I. Peretz, M. Missal, et al. 2011. Tagging the
63. Madison, G., F. Gouyon, F. Ullén, et al. 2011. Modeling the neuronal entrainment to beat and meter. J. Neurosci. 31:
tendency for music to induce movement in humans: first 10234–10240.
correlations with low-level audio descriptors across music 82. Large, E.W., J.A. Herrera & M.J. Velasco. 2015. Neural net-
genres. J. Exp. Psychol. Hum. Percept. Perform. 37: 1578– works for beat perception in musical rhythm. Front. Syst.
1594. Neurosci. 9: 159.
64. Janata, P., S.T. Tomic & J.M. Haberman. 2012. Sensorimotor 83. Kringelbach, M.L. & K.C. Berridge. 2009. Towards a func-
coupling in music and the psychology of the groove. J. Exp. tional neuroanatomy of pleasure and happiness. Trends
Psychol. Gen. 141: 54–75. Cogn. Sci. 13: 479–487.
65. Stupacher, J., M.J. Hove, G. Novembre, et al. 2013. Musical 84. Hohwy, J. 2016. The self-evidencing brain. Noûs 50: 259–
groove modulates motor cortex excitability: a TMS investi- 285.
gation. Brain Cogn. 82: 127–136. 85. Gebauer, L., M.L. Kringelbach & P. Vuust. 2012. Ever-
66. Witek, M.A.G., E.F. Clarke, M. Wallentin, et al. 2014. Synco- changing cycles of musical pleasure: the role of dopamine
pation, body-movement and pleasure in groove music. PLoS and anticipation. Psychomusicology 22: 152–167.
One 9: e94446. 86. Schultz, W. 2007. Behavioral dopamine signals. Trends Neu-
67. Clarke, E.F. 1989. The perception of expressive timing in rosci. 30: 203–210.
music. Psychol. Res. 51: 2–9. 87. Schultz, W., K. Preuschoff, C. Camerer, et al. 2008. Explicit
68. Repp, B.H. 1999. Detecting deviations from metronomic neural signals reflecting reward uncertainty. Philos. Trans. R.
timing in music: effects of perceptual structure on the mental Soc. B Biol. Sci. 363: 3801–3811.
timekeeper. Percept. Psychophys. 61: 529–548. 88. Vuust, P., K.J. Pallesen, C. Bailey, et al. 2005. To musicians,
69. Danielsen, A. 2010. Musical Rhythm in the Age of Digital the message is in the meter. Neuroimage 24: 560–564.
Reproduction. Farnham: Ashgate. 89. Phillips-Silver, J. & L.J. Trainor. 2005. Feeling the beat: move-
ment influences infant rhythm perception. Science 308: 1430.
70. Witek, M.A. 2016. Filling in: syncopation, pleasure and
90. Iyer, V. 2002. Embodied mind, situated cognition, and
distributed embodiment in groove. Music Anal. 36: 138–
expressive microtiming in African-American music. Music
160.
Percept. 19: 387–414.
71. Wundt, W. 1874. Grundzuge der physiologischen psychologie.
91. Danielsen, A. 2006. Presence and Pleasure. The Funk Grooves
Leipzig: Engelmann.
of James Brown and Parliament. Middletown, CT: Wesleyan
72. North, A.C. & D.J. Hargreaves. 1995. Subjective complexity, University Press.
familiarity, and liking for popular music. Psychomusicology 92. Davies, M., G. Madison, P. Silva, et al. 2013. The effect of
14: 77–93. microtiming deviations on the perception of groove in short
73. North, A.C. & D.J. Hargreaves. 1997. Experimental aesthetics rhythms. Music Percept. 30: 497–510.
and everyday music listening. In The Social Psychology of 93. Witek, M.A., E.F. Clarke, M. Wallentin, et al. 2014. Syncopa-
Music. D.J. Hargreaves & A.C. North, Eds.: 84–103. Oxford: tion, body-movement and pleasure in groove music. PLoS
Oxford University Press. One 9: e94446.

Ann. N.Y. Acad. Sci. 00 (2018) 1–11 


C 2018 New York Academy of Sciences. 11

Potrebbero piacerti anche