Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Research report
article info
abstract
Article history:
Humans share implicit preferences for cross-modal mappings (e.g., low pitch sounds are
preferentially paired with darker colours). Individuals with synaesthesia experience cross-
modal mappings to a conscious degree (e.g., they may see colours when they hear
sounds). The neonatal synaesthesia hypothesis claims that all humans may be born with this
explicit cross-modal perception, which dies out in most people through childhood, leaving
only implicit associations in the average adult. Although there is evidence for decreasing
Keywords:
Synaesthesia
and visual dimensions e a combination that has rarely been studied. Second, we asked
Cross-modality
older participants. 210 participants between the ages of 5e74 years assigned colours to
Touch
tactile stimuli. Smoothness, softness and roundness of stimuli positively correlated with
Colour
luminance of the chosen colour; and smoothness and softness also positively correlated
with chroma. Moreover, tactile sensations were associated with specific colours (e.g.,
softness with pink). There were no age differences for luminance effects. Chroma effects,
however, were found exclusively in children and adolescents. Our findings are consistent
with the neonatal synaesthesia hypothesis which suggests that all humans are born with
strong cross-modal perception which is pruned away or inhibited throughout development. Moreover, the findings suggest that a decline of some forms of cross-modality may
take place over a much longer time span than previously assumed.
2012 Elsevier Ltd. All rights reserved.
1.
Introduction
* Corresponding author. Division of Mind and Brain Research, Department of Psychiatry and Psychotherapy, Charite Universitatsmedizin
Berlin, Campus Mitte, Chariteplatz 1, D-10117 Berlin, Germany.
E-mail address: Vera.Ludwig@charite.de (V.U. Ludwig).
0010-9452/$ e see front matter 2012 Elsevier Ltd. All rights reserved.
doi:10.1016/j.cortex.2012.04.004
1090
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
2.
Method
2.1.
Participants
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
2.2.
Materials
We created 18 tactile stimuli based on three scales, of roughness, hardness, and roundness:
Roughesmooth. Six flat surfaces (23 cm 28 cm) ranged
from rough to smooth. Roughness was quantified by the ISO
grit value of commercially available sandpapers. Low grit
values correspond to a rough surface (fewer, but bigger,
grains) and high values to a smoother surface (more, but
smaller, grains). Surface values were graded exponentially
yielding perceptually approximately equidistant degrees of
rough / smoothness (revealed by piloting): P60 (roughest
stimulus), P120, P240, P600, P1200, and no grits (smoothest
stimulus). Surfaces were regularly replaced to avoid wear.
Hardesoft. Stimuli comprised six cubes (150 cm
100 cm 75 cm) ranging from hard to soft, each made from
foam covered in identical black material. Piloting again revealed
that the six foam cubes were perceived as approximately equidistant in terms of hardness. The hardness of foam was established from the mean hardness values (in Newton) provided by
the supplier. These values were 270 (hardest), 215, 175, 132.5, 85,
and 40 (softest).
Pointederound. Six wooden 3-dimensional shapes (10 cm
high) ranging from pointed to round were manufactured by
1091
2.3.
Procedure
2.4.
Data preparation
Fig. 1 e Equations (left) used to obtain graphs (top-right) varying from triangle [function f1(x)] to half-circle [function f6(x)],
provided as plans for wood turner to create the wooden 3D shapes used as stimuli (shown bottom-right) for the
pointederound gradient.
1092
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
2.5.
Statistical analyses
3.
Results
3.1.
3.1.1.
Luminance
3.1.2.
Chroma
1093
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
Table 1 e Total number of choices for particular colours for each stimulus for all participants (n [ 210) with associated
p-values for Cochrans Q test, as well as p-values and effect sizes for McNemars tests comparing the extremes of each
tactile scale.
Stimulus
Number of choices
Red
Blue
Green
Yellow
Black
White
Brown
Grey
Orange
Pink
Purple
RougheSmooth
1
(Roughest)
2
3
4
5
6
(Smoothest)
Cochrans Q p-value
McNemar p-value
McNemar effect size 4
9
13
10
10
5
7
.47
.80
.02
36
21
39
37
45
43
.02
.46
.05
28
29
41
56
53
38
**
.23
.08
9
11
17
16
12
29
*
*
.22
45
45
26
11
6
15
***
***
.27
1
0
1
3
11
23
***
***
.30
34
38
21
18
18
5
***
***
.32
24
32
24
26
27
18
.33
.41
.06
8
11
15
11
9
9
.63
1.00
.00
4
2
8
8
16
16
**
.01
.18
12
8
8
14
8
7
.48
.36
.06
HardeSoft
1
(Hardest)
2
3
4
5
6
(Softest)
Cochrans Q p-value
McNemar p-value
McNemar effect size 4
24
15
13
14
12
9
.08
.02
.17
63
59
62
53
41
40
.01
.01
.01
26
40
37
42
43
38
.22
.13
.10
2
6
9
11
18
25
***
***
.29
34
26
23
14
14
12
***
**
.22
1
3
1
3
7
7
.03
.08
.12
16
12
17
13
10
6
.19
.04
.14
14
10
7
13
10
7
.36
.17
.09
9
9
6
2
6
10
.25
1.00
.00
7
11
14
22
30
35
***
***
.29
14
19
21
23
19
21
.71
.28
.07
PointedeRound
1
(Pointiest)
2
3
4
5
6
(Roundest)
Cochrans Q p-value
McNemar p-value
McNemar effect size 4
34
31
17
13
15
18
**
.03
.15
31
36
28
36
40
34
.66
.79
.02
41
41
50
58
58
57
.10
.07
.13
25
19
25
20
22
21
.88
.63
.03
18
12
8
7
5
4
*
.01
.19
1
5
1
2
1
4
.16
.37
.06
19
12
23
14
19
22
.27
.71
.03
8
8
8
8
9
5
.93
.58
.04
13
16
24
16
15
18
.38
.42
.06
12
11
15
17
19
10
.40
.82
.02
8
19
11
19
7
17
.03
.11
.11
Note. For each colour separately, Cochrans Q test analyses whether choices are evenly distributed across the six stimuli of the tactile scales.
As a follow-up, for each colour separately, McNemars test analyses whether the frequency of choices for that colour differ between the
extremes of each scale (i.e., 1st vs 6th stimulus). The numbers of choices for each colour per stimulus are printed in normal font, while p-values
and effect sizes are printed in italics. Interpretation of 4: .5: large effect, .3: moderate effect, .1: small effect. ***p < .001, **p < .01, *p < .05 (all
HolmeBonferroni corrected within each tactile scale, i.e., for 11 comparisons). For non-significant effects, the uncorrected p-value is shown.
3.1.3.
Colour categories
1094
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
Fig. 2 e Tactileevisual correspondences for all participants (n [ 210). Error bars depicted (95% confidence interval). (A) Effects
of smoothness, softness, and roundness (from top to bottom) on CIE lightness. (B) Effects of smoothness, softness, and
roundness (from top to bottom) on CIE chroma.
chroma, softnesseluminance, softnessechroma, and roundnesseluminance) still hold within the 11 colour categories. For
this, we first calculated the average luminance and the average
chroma for each stimulus for each colour category. We then
correlated these luminance and chroma values with the
respective tactile scales (from 1 to 6) for each colour separately,
with corrected alpha levels.
The softness of stimuli still significantly correlated with
luminance within 5 of the 11 colour categories (within blue:
r .98; green: r .96; brown: r .96; grey: r .95; and pink:
r .93; all HolmeBonferroni corrected for 11 comparisons,
overall type I error rate a .05; Holm, 1979). Therefore we can
conclude that there is indeed a softnesseluminance mapping
effect which is independent of the preference of pairing
softness with specific colours. Similarly, a significant
1095
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
Age group
Friedmans ANOVA
c2-statistic
Roughesmooth on chroma
Hardesoft on chroma
Pointederound on chroma
5e9 years
10e18 years
19 years
5e9 years
10e18 years
19 years
5e9 years
10e18 years
19 years
c (5)
c2(5)
c2(5)
c2(5)
c2(5)
c2(5)
c2(5)
c2(5)
c2(5)
24.17
12.83
2.38
5.73
14.31
5.14
.92
4.51
9.92
Effect size r
***
.03
.80
.33
*
.40
.97
.48
.08
.36
.10
.04
.22
.33
.17
.04
.08
.20
**
.41
.74
.04
*
.21
.72
.51
.14
Note. ***p < .001, **p < .01, *p < .05 (all HolmeBonferroni corrected). For non-significant effects, the uncorrected p-value is shown. Interpretation
of effect sizes: r .10: small; r .30: medium; r .50: large (Cohen, 1988).
3.2.
N1 3 N2 3
1096
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
4.
Discussion
This study shows that all people (i.e., not just synaesthetes)
systematically associate tactile sensations with visual dimensions (as has been found in other sensory domains; Marks et al.,
1987; Ward et al., 2006). In cross-modal matching, smoothness,
softness and roundness positively correlated with the luminance of colour; and smoothness and softness also positively
correlated with chroma. Additionally, certain tactile sensations
were associated with specific colours (e.g., roughness with
brown). In our age analysis we found that luminance effects
were similarly strong in all age groups. Chroma effects,
however, were exclusively found in children and adolescents.
4.1.
Mechanisms for touchecolour associations in
humans
We found that humans systematically associate certain tactile
sensations with certain visual sensations. A subset of our
associations might reflect real-world associations, and therefore indicate learning. For example, we found a significant
association between softness and pinkness, which may stem
from the Western convention of associating pinkness with
infancy and femininity, an effect reinforced in children from
a young age (Pomerleau et al., 1990). However, colour category
effects (e.g., softnessepinkness) tended to be independent of
chroma/luminance effects (e.g., softnesseluminance). For
example, although both pinkness and luminance were associated with softness, our softnesseluminance mappings were
found even within the category of pink suggesting two independent
effects. Softnesseluminance mappings (and other mappings
linked with chroma/luminance) do not appear to reflect realworld associations. For example, there is no clear real-world
link between softness and high luminance, which can be seen
by considering any number of dark natural objects that are soft
rather than hard (e.g., mud, humus, hair, fur). Hence, for many
of our effects, real-world associations are an unsatisfactory
explanation (but see below for one exception mediated by
language).
On a neuronal level, tactileevisual correspondences might
be mediated by communication of somatosensory and visual
Age group
Roughesmooth
5e9 years
10e18 years
Black* (4 .30), white* (4 .24), green (p .003, 4 .09), grey (p .007, 4 .15), pink (p .02, 4 .24)
Brown* (4 .37), black (p .008, 4 .11), yellow (p .008, 4 .29), white (p .03, 4 .22),
pink (p .02, 4 .13)
Black* (4 .35), white* (4 .36), brown (p .008, 4 .37), grey (p .04, 4 .06), pink (p .01, 4 NA)
Blue (p .03, 4 .08)
Black* (4 .33), brown (p .04, 4 .00), yellow (p .02, 4 .24)
Pink* (4 .48), yellow (p .004, 4 .36), black (p .05, 4 .27)
Orange (p .005, 4 .03)
Black (p .004, 4 .21), brown (p .01, 4 .19)
Brown (p .04, 4 .20)
Hardesoft
Pointederound
19 years
5e9 years
10e18 years
19 years
5e9 years
10e18 years
19 years
Note. Shown are all colours with a Cochrans Q test p-value < .05. Marked with * are associations that survive HolmeBonferroni correction within
each tactile scale (i.e., for 33 comparisons; overall a .05). For those that do not survive correction, uncorrected p-values are given. Effect size 4 is
calculated for McNemars tests comparing the two extremes of each tactile scale. In contrast, Cochrans Q test is calculated across all levels of
the tactile scales, explaining possible discrepancies between p and 4. The direction of the association of the colours with tactile scales is not
indicated. NA: McNemars test cannot be carried out since no participant in this group chose pink for the first or last stimulus. Interpretation of
4: .5: large effect, .3: moderate effect, .1: small effect.
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
4.2.
Explanations for the development of touchecolour
associations with age
In our age analysis we found that some effects were clearly
present in children and adolescents, but not in adults. First,
smoothnessechroma mapping was only and strongly found
in the youngest age group of 5e9-year-olds. There was a trend
for this effect in the 10e18-year-olds but no effect at all in the
adults. This is exactly the type of development one would
expect for a cross-modal mapping of the type that the
neonatal synaesthesia hypothesis proposes. Second, softnessechroma mapping was only found in 10e18-year-olds old
with a trend in the 5e9-year-olds. Again there was no indication at all for this effect in adults. It has to be noted that
direct comparisons of effect sizes between children and adults
did not survive Bonferroni correction for multiple
1097
4.3.
1098
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
5.
Conclusion
Acknowledgements
V.L. was supported by a Huygens Scholarship Programme
award by the Dutch Ministry of Education, Culture and
Science. We thank Sean Roberts for writing the software
programme used in this study. We are also grateful to our
anonymous reviewers for their helpful comments.
references
c o r t e x 4 9 ( 2 0 1 3 ) 1 0 8 9 e1 0 9 9
1099
Rich AN, Bradshaw JL, and Mattingley JB. A systematic, largescale study of synaesthesia: Implications for the role of early
experience in lexical-colour associations. Cognition, 98(1):
53e84, 2005.
Rockland KS and Ojima H. Multisensory convergence in calcarine
visual areas in macaque monkey. International Journal of
Psychophysiology, 50(1e2): 19e26, 2003.
Rosenthal R. Meta-Analytic Procedures for Social Research. Newbury
Park, CA: Sage, 1991.
Rosenthal R, Rosnow RL, and Rubin DB. Contrasts and Effect Sizes in
Behavioural Research: A Correlational Approach. Cambridge:
Cambridge University Press, 2000.
Sadato N, Okada T, Kubota K, and Yonekura Y. Tactile
discrimination activates the visual cortex of the recently blind
naive to braille: A functional magnetic resonance imaging
study in humans. Neuroscience Letters, 359(1e2): 49e52, 2004.
Sapir E. A study in phonetic symbolism. Journal of Experimental
Psychology, 12(3): 225e239, 1929.
Sathian K and Zangaladze A. Tactile spatial acuity at the human
fingertip and lip: Bilateral symmetry and interdigit variability.
Neurology, 46(5): 1464e1466, 1996.
Simner J and Ludwig VU. The color of touch: A case of tactilevisual synaesthesia. Neurocase, 18(2): 167e180, 2012.
Simner J, Ward J, Lanz M, Jansari A, Noonan K, Glover L, et al.
Non-random associations of graphemes to colours in
synaesthetic and non-synaesthetic populations. Cognitive
Neuropsychology, 22(8): 1069e1085, 2005.
Spector F and Maurer D. The colour of os: Naturally biased
associations between shape and colour. Perception, 37(6):
841e847, 2008.
Spector F and Maurer D. Synesthesia: A new approach to
understanding the development of perception. Developmental
Psychology, 45(1): 175e189, 2009.
Spector F and Maurer D. The colors of the alphabet: Naturallybiased associations between shape and color. Journal of
Experimental Psychology: Human Perception and Performance,
37(2): 484e495, 2011.
Spence C. Crossmodal correspondences: A tutorial review.
Attention, Perception, & Psychophysics, 73(4): 971e995, 2011.
Steven MS and Blakemore C. Visual synaesthesia in the blind.
Perception, 33(7): 855e868, 2004.
Tkalcic M and Tasic JF. Colour spaces: Perceptual, historical and
applicational background. EUROCON 2003. Computer as a tool.
The IEEE Region, 8(1): 304e308, 2003.
Wagner K and Dobkins KR. Synaesthetic associations decrease
during infancy. Psychological Science, 22(8): 1067e1072, 2011.
Walker P, Bremner JG, Mason U, Spring J, Mattock K, Slater A,
et al. Preverbal infants sensitivity to synaesthetic crossmodality correspondences. Psychological Science, 21(1): 21e25,
2010a.
Walker P, Francis BJ, and Walker L. The brightness-weight
illusion: Darker objects look heavier but feel lighter.
Experimental Psychology, 57(6): 462e469, 2010b.
Ward J, Banissy MJ, and Jonas CN. Haptic perception and
synaesthesia. In Grunewald M (Ed), Human Haptic Perception.
Basel: Birkhauser, 2008: 259e265.
Ward J, Huckstep B, and Tsakanikos E. Sound-colour
synaesthesia: To what extent does it use cross-modal
mechanisms common to us all? Cortex, 42(2): 264e280, 2006.
Zangaladze A, Epstein CM, Grafton ST, and Sathian K.
Involvement of visual cortex in tactile discrimination of
orientation. Nature, 401(6753): 587e590, 1999.