The Brains That Never Learned to Separate the Senses

For one man, the word “Tuesday” carries the faint, unmistakable taste of stale bread. For a woman across the country, the alphabet is a small painted parade: every letter arrives already wearing its own color, the way the rest of us might see a letter arrive already wearing its shape. Somewhere else, a musician watches the note C bloom a warm red in the air, and a listener flinches at a stab of pain that registers not just as sensation but as a jagged flash of yellow light.

For most of the history of medicine, these people were told, gently or not, that they were confused. Poets, dreamers, exaggerators. Perhaps liars. The reports were too strange and too private to prove, and science has never been comfortable with claims it cannot count. But the strangeness turned out to be real, and measurable, and far more common than anyone guessed. Roughly one person in twenty-five experiences some version of it. Their senses are genuinely wired together, and the wiring has a name.

The condition is called synesthesia, from the Greek syn, meaning together, and aisthesis, meaning sensation. A joining of the senses. And the deeper researchers have looked, the more the phenomenon has stopped being a curiosity at the edge of perception and started to look like a clue to how every human brain is built.

A Victorian polymath asks the first real question

The first person to take colored hearing seriously with anything like scientific rigor was a Victorian gentleman of restless and sometimes troubling curiosity: Francis Galton, cousin of Charles Darwin and a man who tried to measure nearly everything, from the efficacy of prayer to the geography of female beauty. In 1880 he published a paper in Nature on people who saw numbers and letters as colored, and who arranged their weeks, months, and figures into elaborate mental landscapes.¹

Galton did something modern in method. He collected accounts, compared them, and noticed a pattern nobody had documented: the trait ran in families. Parents and children, siblings, cousins, all reporting the same peculiar automatic coloring of the world. He suspected it was inherited, a hunch that would take more than a century to confirm.

What he lacked was any way to look inside the head. Galton could catalogue what people told him, but he could not prove that a synesthete’s red was any more real than a metaphor. And so, having opened the door, he could not walk through it. Neither could anyone else. Within a generation, the door was quietly shut.

A hundred years of silence

The early twentieth century belonged to a psychology that wanted only what it could see and count. Behaviorism, in its ascendancy, treated the inner life as a black box unworthy of study. What could not be observed from the outside and reproduced in a laboratory was, by definition, not science. Introspection, the reporting of private experience, was dismissed as unreliable, unverifiable, and slightly embarrassing.

Synesthesia had the misfortune of being nothing but private experience. It was a claim about the texture of one person’s inner world, and no external instrument of the era could confirm or deny it. So the topic fell out of the journals almost entirely. For close to a hundred years, serious research on synesthesia nearly vanished.

The synesthetes did not vanish, of course. They simply learned to keep quiet. Many of them assumed, well into adulthood, that everyone saw letters in color or heard tastes in music, that these were figures of speech taken for granted by all. Others discovered early that describing what they perceived earned them strange looks, and so they said nothing. An entire population of unusual perceivers passed through the twentieth century largely undocumented, hiding in plain sight, because the science of the day had no room for them.

What finally reopened the case was not a change in philosophy but a change in machinery. The arrival of brain imaging meant that, for the first time, the private could be made visible. The inside of the skull could be watched at work. And when researchers finally pointed those instruments at synesthetes, the old dismissals began to collapse.

The man who tasted shapes

In the early 1980s, an American neurologist named Richard Cytowic found himself at a dinner party where the host apologized for a dish with an oddly specific complaint. “There aren’t enough points on the chicken,” the man said, meaning the flavor felt too round, too smooth, when he had wanted something with sharp edges. He tasted shapes. Flavors arrived in his mouth as geometry he could run his hands over.²

Most people would have laughed it off. Cytowic did not. He recognized the description as something worth investigating and began studying the man, and then others like him, in earnest. Using the crude blood-flow measurements available at the time, he found that something genuinely unusual happened in these brains during a synesthetic experience, with activity shifting in patterns that did not match ordinary perception. His work, and the book he later wrote, dragged the subject back from the century of neglect into which it had fallen.²

But a returning topic is not the same as a proven one. Skeptics could still argue that synesthetes were reporting vivid imagination, or well-practiced association, rather than true involuntary perception. To silence that objection, science needed a test that a person could not fake. Something that would reveal whether the colors were real and automatic, or merely described after the fact.

The hidden triangle

The elegant solution came from a deceptively simple experiment. Researchers printed a field of numbers on a page, mostly fives, with a scattering of twos arranged so that the twos formed a shape, a triangle, say, hidden among the fives. To the ordinary eye, the twos and fives look nearly identical. Finding the shape requires slow, deliberate scanning, one digit at a time, and most people take several seconds to notice the pattern, if they spot it at all.³

For a synesthete who sees numbers in color, the effect was startling. If their fives glowed green and their twos glowed red, the hidden triangle leapt off the page in an instant, a colored figure sitting on a colored ground. In these pop-out tests, synesthetes located the shape dramatically faster than non-synesthetes, in some conditions by a wide margin.³

This mattered enormously, because you cannot fake speed. A person can claim, after the fact, that a two looks red. But you cannot consciously decide to see a shape faster than your eyes can scan it. The color had to be present at the earliest, automatic stage of perception, doing perceptual work before conscious thought arrived. The neuroscientist V. S. Ramachandran, who helped design and popularize this line of research, used precisely such tests to argue that the phenomenon was perceptual rather than imaginary.³

Signals that leak between neighbors

Ramachandran also offered an explanation for the wiring itself, and it began with a fact of brain geography. The region of the brain that processes the visual form of numbers and letters sits directly adjacent to a region heavily involved in processing color, both tucked into the fusiform gyrus of the temporal lobe. In most people, these neighbors stay politely separate. In synesthetes, Ramachandran proposed, there is extra cross-wiring, and signals leak from one to the other. See a number, and the color region lights up alongside it, unbidden.³

It was, he argued, not a metaphor and not a memory trick. Their brains were genuinely connected differently, with more physical links running between areas that in most people communicate less. Later imaging work using diffusion tensor imaging, which traces the white-matter tracts that connect brain regions, supported the idea, finding greater structural connectivity in the relevant pathways of synesthetes’ brains.⁴ The cross-talk had an anatomy.

Where did that anatomy come from? Galton’s old hunch turned out to be right. Synesthesia runs in families. Studies suggest that a large fraction of synesthetes, on the order of forty percent, have a close relative who shares some form of the trait, and researchers have hunted for the genes involved.⁵ Something heritable is clearly at work.

But heredity is not the whole story, and here the picture grows subtle. Identical twins, who share their DNA, do not always share their synesthesia, and even when both twins are synesthetic, they frequently disagree about which letter is which color. If genes alone dictated the experience, that could not happen. The colors themselves are not written directly into the DNA.

Instead, the evidence points to a familiar collaboration. Genes appear to set up a brain that is primed to blend the senses, but experience decides how the blending plays out. In one striking pattern, many synesthetes’ letter colors can be traced back to a specific childhood object: a set of colored alphabet magnets or refrigerator letters. A red plastic A on the fridge becomes, in some cases, a lifelong red A in the mind.⁶ The genes load the gun; a toy from the 1970s pulls the trigger. Nature and nurture, tangled past the point of separation.

We may all have started here

Then comes the reversal that changes how you think about the whole phenomenon. The most provocative idea in synesthesia research is not that a few unusual people have too many connections. It is that, at the very beginning, all of us did.

The infant brain is not a sparse, tidy network. It is wildly, extravagantly over-connected, a riot of links between regions that in the adult brain stay strictly apart. In the first months of life, the senses appear to bleed freely into one another, and some developmental researchers have argued that every newborn is, in effect, a synesthete, living in a world where sound and light and touch have not yet been sorted into separate channels.⁷

What happens next is one of the quiet marvels of development: pruning. As the brain matures, it aggressively cuts away the excess, trimming connections it does not use and reinforcing the ones it does, sculpting the sprawling infant network into the specialized, compartmentalized adult one. The senses separate. Sound stops being visible. The blending fades, and most of us forget it ever existed.

Synesthetes, on this view, are not people whose brains built something extra. They are people who kept something the rest of us threw away. Where the ordinary brain pruned the bridge between color and number, theirs left it standing. The condition is less an addition than a preservation, a surviving trace of the connected world we were all born into.

The company of artists

That surviving wiring often arrives with gifts. Synesthetes tend to score measurably higher on certain tests of memory, particularly for the kinds of material their extra associations can anchor.⁸ A phone number that comes pre-tinted in a sequence of colors is simply easier to hold onto than a string of bare digits. The condition provides its own mnemonic scaffolding, a second sensory tag riding along with the first.

And then there is the long, suggestive association with art. Synesthetes appear far more often among people who work in creative fields than chance would predict, and the roster of likely and confirmed synesthetes reads like a syllabus. The composer Olivier Messiaen built chords to reproduce the colors he saw. The painter Wassily Kandinsky spoke of hearing his canvases. The novelist Vladimir Nabokov devoted a passage of his memoir to the precise hues of his alphabet, an inheritance he shared with his mother, his wife, and his son.⁹ Painters, poets, and composers fill the ranks in numbers that are hard to dismiss.

It is tempting to draw the obvious conclusion, that blending the senses is where art quietly begins, that the metaphor at the heart of every poem, the sound of a color and the color of a sound, is for some people not a figure of speech but a literal report. The causation is surely tangled, and not every synesthete is an artist, nor every artist a synesthete. But the overlap hints at something true about creativity itself: that it may live in the unexpected connection, the signal that leaks across a border it was supposed to respect.

What the pruning took

For a hundred years, the people who tasted words and saw music were told they were imagining things. It turned out they were remembering something. Not a memory in the ordinary sense, but a structural one, a fragment of an earlier way of perceiving that most human brains dismantle before we are old enough to describe it. The synesthete’s red A and warm C and pointed chicken are the visible edge of a world we all once inhabited and then, in the slow work of growing up, agreed to leave behind. So the next time a song strikes you as warm, or a word feels sharp in a way you cannot quite explain, the sensation may not be pure poetry. It may be a faint signal from a brain that once tasted color, before it learned, so thoroughly, to forget.

Sources

1. Galton, F., “Visualised Numerals,” Nature, 1880. — https://www.nature.com/articles/021252a0
2. Cytowic, R. E., The Man Who Tasted Shapes, MIT Press, 1993/2003. — https://mitpress.mit.edu/9780262532556/the-man-who-tasted-shapes/
3. Ramachandran, V. S. & Hubbard, E. M., “Synaesthesia: A Window Into Perception, Thought and Language,” Journal of Consciousness Studies, 2001. — https://www.ingentaconnect.com/content/imp/jcs/2001/00000008/00000012/1244
4. Rouw, R. & Scholte, H. S., “Increased structural connectivity in grapheme-color synesthesia,” Nature Neuroscience, 2007. — https://www.nature.com/articles/nn1906
5. Barnett, K. J. et al., “Familial patterns and the origins of individual differences in synaesthesia,” Cognition, 2008. — https://www.sciencedirect.com/science/article/abs/pii/S0010027708000097
6. Witthoft, N. & Winawer, J., “Learning, Memory, and Synesthesia,” Psychological Science, 2013. — https://journals.sagepub.com/doi/10.1177/0956797612452573
7. Maurer, D. & Mondloch, C. J., “Neonatal synesthesia: A reevaluation,” in Synesthesia: Perspectives from Cognitive Neuroscience, Oxford University Press, 2005. — https://global.oup.com/academic/product/synesthesia-9780195166231
8. Rothen, N., Meier, B. & Ward, J., “Enhanced memory ability: Insights from synaesthesia,” Neuroscience & Biobehavioral Reviews, 2012. — https://www.sciencedirect.com/science/article/abs/pii/S0149763412001030
9. Nabokov, V., Speak, Memory, Harper & Brothers, 1951. — https://en.wikipedia.org/wiki/Speak,_Memory

Related reading

• The Controlled Hallucination Behind Everything You See
• The Face in the Wall Socket

More from the Mind edition →