Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Research report
h i g h l i g h t s
a r t i c l e
i n f o
Article history:
Received 5 November 2013
Received in revised form
19 December 2013
Accepted 23 December 2013
Available online 3 January 2014
Keywords:
Tools
Mu rhythm
Observation
Action
Affordance
Training
a b s t r a c t
Tool stimuli can be analyzed based on their affordance, that is, their visual structure hinting at possible
interaction points. Additionally, familiar tools can initiate the retrieval of stored objectaction associations, providing the basis for a meaningful object use. The mu rhythm within the electroencephalographic
alpha band is associated with sensory-motor processing and was shown to be modulated during the sight
of familiar tool stimuli, suggesting motor cortex activation based on either affordance processing or access
to stored conceptual objectaction associations. The current study aimed to investigate the impact of such
associations, acquired by observation of manipulation, in a training study controlling for inherent object
affordances and previous individual differences in object-related experience. Participants observed the
manipulation of a set of novel tool objects and visually explored a second set of novel tools for which only
functional information was provided. In contrast to non-trained objects, observed objects modulated the
mu rhythm over left sensory-motor cortex within 200 ms after training. Additionally, both observed and
visually explored objects modulated mu rhythm over right sensory-motor cortex in the same time window to some extent, with the effect being stronger for the latter. This result suggests that motor cortex
activation in visual processing of tools can result from observation of tool manipulation. However, mu
rhythm modulation, albeit with a different and less clear left-lateralized pattern, is also seen when the
tools were only made visually familiar and when information was restricted to the tools function.
2014 The Authors. Published by Elsevier B.V. Open access under CC BY-NC-SA license.
1. Introduction
0166-4328 2014 The Authors. Published by Elsevier B.V. Open access under CC BY-NC-SA license.
http://dx.doi.org/10.1016/j.bbr.2013.12.033
tools, most likely representing the stored motor action representation associated with the tool (for review, see [36]). Furthermore,
behavioral studies have shown that the mere sight of tools can
prime, or potentiate, motor responses to object parts, affording an
action through motor facilitation, therefore supporting the idea of
the automatic extraction of affordances when seeing manipulable
objects. Together, these ndings suggest that action information
can be an integral part of object representations.
One potential mechanism for this is described in the Two Action
Systems Model [2], which proposes that the action system is separable into two functionally and anatomically distinguishable units,
a Structural System and a Functional System. The Structural System
is devoted to perform an online analysis of visual object structures for a rapid interaction and is proposed to be not exclusively
cognitive. During repeated and skilled interaction with objects, a
Functional System extracts the characteristics of an action that
remain constant across object-directed interactions, hence providing the basis for the formation of conceptual object representations.
During manual object interaction the extracted functional knowledge and object-associated actions thus become integral parts of
conceptual representations, which do, however, comprise different types of knowledge about an object in different modalities. A
key component for the evolution of human tool use behavior is
the capacity to learn through the observation of others performing
an action [7]. This therefore suggests that the formation of mental
representations of tools is not only bound to direct interactive experience with the object, but can also result from indirect experience
through the observation of others interactions with the object. It
has been shown that certain neurons in area F5 of the monkey cortex, called mirror neurons, discharge during the observation of
others performing object-related actions [810], a property that
has been proposed to represent a direct matching mechanism by
which the observed motor action is mapped onto the observers
internal motor representations [11,12].
Electroencephalography (EEG) studies investigating sensorymotor processing in humans have analyzed the mu rhythm, which
refers to oscillatory brain activity in the alpha and beta band
(812 Hz and 20 Hz), in electrodes placed over the sensory-motor
cortices. Event-related desynchronization (ERD) of the oscillatory
neuronal ring that underlies the mu rhythm can, for example,
be found during movement execution (e.g., [1315]) but also during the observation of movements (e.g., [16,17]) and movement
imagery (e.g., [18]). These properties of the mu rhythm show that
the motor system can also be engaged in the absence of active
action execution, and some researchers argue that this activity
partly represents an index of the mirror neuron system [19]. Furthermore, ndings on the suppression of the mu rhythm during
object-related in contrast to meaningless actions have been interpreted as activation of goal-directed motor programs related to
the mirror neuron system [16]. Interestingly, the simple viewing
of tool stimuli, even without the demand to interact, can also lead
to mu rhythm suppression between 140 ms and 300 ms after stimulus presentation [20], possibly reecting the automatic access to
object-associated actions. Further support for this comes from early
event-related potentials (ERPs) during the processing of tools for
which sources were described in the left postcentral gyrus and
bilateral premotor cortex. However, so far it is not clear if the modulation of the mu rhythm during the sight of tool stimuli relates to
simple visual affordance processing, or to experience-dependent
objectaction associations that can be acquired during observation
of object manipulation. As mu suppression has been found both for
action execution and for the sight of known objects [1315,20], it
seems likely that active object experience plays a role in the activation of motor cortex during visual object processing. While mu
suppression was also seen for the observation of meaningful actions
[16,17,21], it is not clear what effect the observation of object
329
330
331
RTs (ms)
Before learning
After learning
Accuracy (%)
Before learning
After learning
NO
VIS
OBS
518 (117)
480 (135)
518 (104)
467 (125)
521 (116)
472 (128)
92.53 (4.27)
94.91 (3.18)
93.52 (4.10)
97.42 (2.25)
93.52 (4.42)
96.76 (3.12)
332
between the rst and last training session), or between ERD and the
time interval between the rst day of training and the post training EEG assessment, or between ERD and the time span between
the last training session and the post training EEG assessment (all
p > .105).
3.2.2. Analysis of the upper mu frequency band of 1012 Hz
No signicant effects of interests were found for all time windows in the frequency band of 1012 Hz (all p > .05).
4. Discussion
The present study aimed at elucidating the impact of observational learning of manipulation on the processing of pictures of
invented, previously unfamiliar tools. Within three training sessions, participants observed one set of the invented tools being
manipulated (OBS) and visually explored a second set for which
they were only informed about the tools functions but not the concrete manipulation (VIS). A third set served as an untrained control
(NO) and was not part of the training. In sum, our results demonstrated that the different types of training did have a differential
modulatory effect on sensory-motor cortex activation when seeing
the tools after training. More specically, on scalp regions over left
sensory-motor cortex this modulation was characterized by a linear
trend of mu ERD depending on the type of object-experience (NO,
VIS and OBS, respectively), whereby seeing non-trained objects
induced the least ERD, and those for which manipulation was
observed induced the greatest activity. Over right sensory-motor
cortex, signicant mu rhythm modulation by training was also
found, with signicantly larger ERD for VIS in comparison to NO.
It is now generally accepted that conceptual representations
involve different types of knowledge related to specic modalities
[32]. For tools, associations with manipulation and function play
a particularly important role. The role of experience in the emergence of new representations is the matter of an ongoing debate.
The present study addressed this issue by systematically varying
the type of object-related experience. Although it is not possible
to induce highly elaborated object representations in just three
training sessions, the design with previously unfamiliar, manipulable objects [23,24] allowed insights into an important mechanism
involved in the emergence of tool representations, that is, the
learning of objectaction associations. The current study is, to our
knowledge, the rst to provide evidence for an effect of the type of
object-related experience on object-processing by motor-related
brain structures, as reected by the mu rhythm. The nding of mu
rhythm modulation for tools which were observed during manipulation is consistent with studies on the processing of familiar tools,
which also showed early mu rhythm suppression [20]. For the OBS
of the present study, the observation of the concrete steps of manipulation could have led to the formation of action representations
and motor plans that were associated with the objects. There is evidence that the mu rhythm reects general motor-related activity:
during action imitation and observation, mu rhythm modulation
correlates with BOLD responses in a rather broad cortical network
consisting of inferior parietal lobe, premotor and frontal cortex, as
well as medial frontal cortex, thalamus, temporal lobe and cerebellum [19].
A possible mechanism underlying the effect of manipulation
observation on the subsequent processing of tools might relate
to the human mirror neuron system (hMNS). It has been shown
that certain neurons in area F5 of the monkey cortex, called
mirror neurons, discharge during the observation of others
performing object-related actions [810]. This property has been
proposed to represent a direct matching mechanism by which
the observed motor action is mapped onto the observers internal
333
Fig. 2. Grand average training-specic ERD traces measured on scalp regions over left sensory-motor cortex (A) and right sensory-motor cortex (B), before and after training.
OBS = observation of manipulation training objects, VIS = visual training objects, NO = not trained objects.
334
Acknowledgment
The authors thank the German Research Foundation for supporting this work (Deutsche Forschungsgemeinschaft, DFG; SFB 874/TP
B6 to C.B.).
References
[1] Gibson JJ. The theory of affordances. In: Shaw R, Bransford J, editors. Perceiving,
acting and knowing: toward an ecological psychology. Erlbaum: Hillsdale, NJ;
1977. p. 6782.
[2] Buxbaum LJ, Kalenine S. Action knowledge, visuomotor activation, and embodiment in the two action systems. Ann N Y Acad Sci 2010;1191:20118.
[3] Lewis JW. Cortical networks related to human use of tools. Neuroscientist
2006;12(3):21131.
[4] Chao LL, Martin A. Representation of manipulable man-made objects in the
dorsal stream. Neuroimage 2000;12(4):47884.
[5] Creem-Regehr SH, Lee JN. Neural representations of graspable objects: are tools
special? Brain Res Cogn Brain Res 2005;22(3):45769.
[6] Martin A, Wiggs CL, Ungerleider LG, Haxby JV. Neural correlates of categoryspecic knowledge. Nature 1996;379(6566):64952.
[7] van Schaik CP, Deaner RO, Merrill MY. The conditions for tool use in primates:
implications for the evolution of material culture. J Hum Evol 1999;36:71941.
335
[26] Creem-Regehr SH, Dilda V, Vicchrilli AE, Federer F, Lee JN. The inuence of
complex action knowledge on representations of novel graspable objects: evidence from functional magnetic resonance imaging. J Int Neuropsychol Soc
2007;13(6):100920.
[27] Kumar S, Riddoch MJ, Humphreys G. Mu rhythm desynchronization reveals
motoric inuences of hand action on object recognition. Front Hum Neurosci
2013;7:66.
[28] Lee TW, Girolami M, Sejnowski TJ. Independent component analysis using
an extended Infomax algorithm for mixed subGaussian and superGaussian
sources. Neural Comput 1999;11(2):41741.
[29] Pineda JA. The functional signicance of mu rhythms: translating seeing and
hearing into doing. Brain Res Brain Res Rev 2005;50(1):5768.
[30] Pfurtscheller G, Aranibar A. Evaluation of event-related desynchronization
(ERD) preceding and following voluntary self-paced movement. Electroencephalogr Clin Neurophysiol 1979;46(2):13846.
[31] Greenhouse SW, Geisser S. On methods in the analysis of prole data. Psychometrika 1959;24(2):95112.
[32] Kiefer M, Pulvermuller F. Conceptual representations in mind and brain:
theoretical developments, current evidence and future directions. Cortex
2012;48(7):80525.
[33] Murata A, Fadiga L, Fogassi L, Gallese V, Raos V, Rizzolatti G. Object representation in the ventral premotor cortex (area F5) of the monkey. J Neurophysiol
1997;78(4):222630.
[34] Proverbio AM, Adorni R, DAniello GE. 250 ms to code for action affordance
during observation of manipulable objects. Neuropsychologia 2011;49(9):
27117.
[35] Proverbio AM, Azzari R, Adorni R. Is there a left hemispheric asymmetry for
tool affordance processing? Neuropsychologia 2013;51(13):2690701.
[36] Grafton ST, Arbib MA, Fadiga L, Rizzolatti G. Localization of grasp representations in humans by positron emission tomography. 2. Observation compared
with imagination. Exp Brain Res 1996;112(1):10311.
[37] Haaland KY, Harrington DL. Hemispheric asymmetry of movement. Curr Opin
Neurobiol 1996;6(6):796800.
[38] Majdandzic J, Grol MJ, van Schie HT, Verhagen L, Toni I, Bekkering H. The role
of immediate and nal goals in action planning: an fMRI study. Neuroimage
2007;37(2):58998.
[39] Cross ES, Cohen NR, Hamilton AFD, Ramsey R, Wolford G, Grafton ST. Physical
experience leads to enhanced object perception in parietal cortex: insights from
knot tying. Neuropsychologia 2012;50(14):320717.
[40] Alemanno F, Houdayer E, Cursi M, Velikova S, Tettamanti M, Comi G, et al.
Action-related semantic content and negation polarity modulate motor areas
during sentence reading: an event-related desynchronization study. Brain Res
2012;1484:3949.
[41] Locatelli M, Gatti R, Tettamanti M. Training of manual actions improves language understanding of semantically related action sentences. Front Psychol
2012;3:547.