UNTOLD · Mind · NO. M01

The Verdict Your Brain Reaches Before You Say Hello

A century of psychology suggests we judge strangers in a tenth of a second, and rarely revise.

Share
The Verdict Your Brain Reaches Before You Say Hello

Sometime in the late nineties, a young psychologist at Princeton named Alexander Todorov became preoccupied with a question that sounds almost too simple to study. How long does it take to decide whether you can trust someone’s face? Most people, if asked, would guess a few seconds. Enough time to register a smile, hear a voice, take in the shape of the eyes. Todorov suspected the real number was much smaller. By 2006, working with his colleague Janine Willis, he had found it. One hundred milliseconds. Roughly a third of the time it takes to blink. 1

The finding has aged into something close to common knowledge. It surfaces in TED talks, leadership seminars, books about charisma and persuasion. But the strangeness of the underlying claim tends to get lost in repetition. The Princeton study did not merely show that people form fast impressions. It showed that giving people more time to look at a face did not change their judgment at all. Volunteers shown a stranger for a tenth of a second arrived at the same verdict, on average, as volunteers given unlimited viewing. The extra seconds added only one thing: confidence. The brain was not weighing evidence. It was confirming a decision it had already filed.

This is the uncomfortable architecture of social cognition. We tend to think of judgment as a deliberation, a sifting of cues across the duration of a meeting. In practice, the deliberation is largely theater. The verdict is in before the handshake. What follows is mostly the search for reasons that the verdict was correct.

The hundred-millisecond verdict

Willis and Todorov’s experiment was elegantly stripped-down. Volunteers sat at a screen. Photographs of strangers appeared, sometimes for as little as a tenth of a second, sometimes longer, sometimes with no time limit at all. After each face, the volunteers rated the person on five traits: trustworthiness, competence, likeability, aggressiveness, attractiveness. The ratings were then compared across exposure times. 1

The results were almost eerily consistent. A face shown for 100 milliseconds produced trust judgments that correlated strongly with the same face shown for as long as the viewer wanted. Subsequent work by Todorov’s lab pushed the exposure even shorter, down to 33 milliseconds, and the pattern held. 2 The brain was operating in territory that conscious thought cannot reach. By the time a viewer became aware of having seen a face, the social verdict had already been rendered somewhere beneath that awareness.

Neuroimaging has since traced part of this process to the amygdala, a pair of almond-shaped structures buried deep in the temporal lobes. The amygdala is best known for its role in fear, but it functions more broadly as a salience detector, a piece of neural hardware that flags whatever in the environment might matter for survival. Faces, unsurprisingly, are near the top of its list. Studies using functional MRI have shown that the amygdala responds to untrustworthy-looking faces within a few hundred milliseconds, including faces presented so briefly that participants report not having seen them consciously at all. 3

The machinery, in other words, is not optional. It runs underneath us, the way breath runs underneath thought, and it produces verdicts we then inherit as if they were our own considered conclusions.

A judge built for a different world

Why would evolution install such a hasty magistrate in the human brain? The standard answer points to the asymmetry of social risk in ancestral environments. For most of the species’ history, encountering a stranger was a high-stakes event. Misreading a friendly traveler as hostile cost a missed opportunity. Misreading a hostile one as friendly could cost everything. Across millions of such encounters, the brain that decided fast and erred on the side of caution outlived the brain that paused to gather evidence.

The legacy of that selection pressure is a face-reading system tuned for speed rather than accuracy. It draws on broad-strokes features, the width of a jaw, the angle of the brows, the upturn or downturn of the resting mouth, and translates them, almost instantly, into the moral vocabulary of trust and threat. Todorov’s later work has shown that these features cluster reliably. Faces that people rate as trustworthy tend to share certain proportions, regardless of whether the people behind them are, in any meaningful sense, actually trustworthy. 4

This is the first awkward thing the research forces us to confront. The brain’s trust judgments correlate with facial geometry far more tightly than they correlate with anything a person has actually done. A wide-jawed man with low brows can spend a lifetime being kind and still strike strangers as menacing on first sight. A symmetrical, soft-featured woman can deceive easily, because the system that should flag her behaviors has already vouched for her face.

The judge inside us is not weighing character. It is reading bone structure and pattern-matching against a template assembled by deep evolutionary time. That template was useful on the savanna. It is a strange tool to bring to a hiring panel, a first date, a courtroom.

What comes first, colors everything after

In 1946, decades before Todorov’s stopwatch arrived, a Polish-American psychologist named Solomon Asch noticed that the order of information mattered in a way that classical logic could not explain. Asch presented students with lists of traits describing a fictional person. One group heard the person described as intelligent, industrious, impulsive, critical, stubborn, and envious. A second group heard the same six words in reverse: envious, stubborn, critical, impulsive, industrious, intelligent. 5

The traits were identical. The order alone had been flipped. Yet when the students were asked to describe their overall impression of the person, the two groups produced strikingly different portraits. The first group described someone broadly competent, whose stubbornness might be the cost of doing serious work. The second group described someone difficult, whose intelligence felt almost like a warning sign, a sharper edge on an already abrasive personality.

Asch named the phenomenon the primacy effect. What comes first builds the frame. Everything that follows is bent to fit inside it. The mind does not assemble a person additively, trait by trait, the way a chemist assembles a compound. It constructs a hypothesis from the earliest data, then absorbs later data through the lens of that hypothesis.

This is why a single late kindness from someone you have already filed under cold can feel suspicious, a maneuver, a hidden agenda. The same kindness from a warm person needs no explanation. The mind has already decided what kind of story it is in, and it sorts new scenes accordingly. Psychologists since Asch have folded this into a broader category they call confirmation bias, the tendency to seek and weight evidence that supports beliefs already held. In ordinary thinking, confirmation bias distorts our reading of arguments and data. In social perception, it distorts our reading of people, with the added difficulty that the original belief was formed in a fraction of a second, by a system we cannot consciously consult.

The thin slice

In the 1990s, a Harvard psychologist named Nalini Ambady began testing how thin a slice of behavior could be and still predict a person’s reputation. Her early studies focused on teachers. Ambady recorded silent video clips of college instructors lecturing, then trimmed those clips down to a few seconds. The clips contained no words, only fragments of gesture, posture, and expression. She showed them to strangers and asked for ratings: warmth, confidence, competence. 6

The ratings that strangers produced after watching a few seconds of silent footage correlated strongly with the end-of-semester evaluations the actual students gave at the close of the course. A two-second judgment by a stranger matched, on average, the considered judgment of students who had spent four months in the same classroom.

Ambady called the effect thin slicing. The phrase captured something disquieting. Human reputation, the thing we believe we earn slowly through behavior, can be predicted from slivers of nonverbal information so small they barely qualify as evidence. Subsequent studies extended the finding to surgeons (whose risk of being sued correlated with brief samples of their bedside tone), to political candidates (whose election outcomes correlated with one-second judgments of competence from their photographs), and to job interviews. Roughly seventy percent of hiring managers, in surveys conducted across the 2010s, admit forming an opinion about a candidate within the first five minutes of an interview, and many concede the verdict arrives even earlier. 7

The rest of the interview, in such cases, is not really an interview. It is a search for confirmation. Questions are framed in ways that elicit the expected answer. Answers are interpreted in ways that fit the original verdict. The candidate is given the chance to demonstrate the brilliance the interviewer already suspects, or to confirm the mediocrity the interviewer has already decided upon.

The asymmetry of blame

The stickiness of a first impression is not only a matter of speed and primacy. There is a third mechanism, identified in the early seventies by the Stanford social psychologist Lee Ross, that gives the verdict its particular moral weight. Ross called it the fundamental attribution error. 8

The phenomenon is simple to describe and almost universal in its grip. When strangers behave badly, we tend to attribute their behavior to their character. He is late because he is careless. She was rude because she is unkind. He fumbled the answer because he is not very bright. When we ourselves behave the same way, we tend to attribute the behavior to the situation. I am late because the traffic was unusual. I was rude because I am exhausted. I fumbled the answer because the question was poorly framed.

The asymmetry is not minor. It means that the snap impression of a stranger is not merely fast and stubborn. It is also unfairly personal. The brain converts a single observed behavior into a claim about who someone fundamentally is, while reserving for itself the right to be a complicated person caught in difficult circumstances. The result is a social cognition system that hands out indictments more easily than it hands out context. Once an early behavior has been read as evidence of character, it becomes nearly impossible to revise without active effort, because every later behavior gets folded back into the original verdict. He was warm at lunch because he is trying to compensate for being careless. She apologized because she is unkind enough to need to.

Ross’s work, alongside Asch’s and Todorov’s, suggests that a first impression is not a single judgment but a small architecture of mutually reinforcing biases. Speed delivers a verdict before reason can intervene. Primacy frames everything that follows. Attribution converts behavior into character. Confirmation bias keeps the structure standing.

The autobiography of strangers

There is one more layer, and it is the layer most easily missed. The verdicts the brain hands down about strangers are not impartial. They are autobiographical.

The face you immediately distrust often resembles, in some configuration you may never consciously identify, a face from your own past. The voice that puts you instantly at ease echoes someone who once kept you safe. Researchers studying what they sometimes call transference effects have shown that the brain reads new people through templates built from the people we have already loved, feared, depended on, or been hurt by. A new acquaintance whose features faintly recall a childhood antagonist can trigger wariness that has nothing to do with the acquaintance and everything to do with the antagonist. 9

What presents itself as intuition about a stranger is often, on closer inspection, a memory the conscious mind has not been invited to review. This is why two people can meet the same person and form opposite first impressions, each insisting their reading is the truthful one. They are reading different ghosts.

This is also why the rhetoric of trusting your gut, so common in popular advice about hiring and dating, deserves more skepticism than it usually receives. The gut is fast, ancient, and confident, but its speed is bought at the cost of granularity. It is fluent in the language of resemblance, not the language of evidence. It mistakes the new person for an old one, then presents the resulting feeling as wisdom.

Whether the verdict can be revised

The research on whether first impressions can be changed is, perhaps appropriately, divided. The dominant finding remains pessimistic. Across many domains, including teacher evaluations, juror perceptions, and workplace assessments, early judgments persist with remarkable durability, often surviving disconfirming information that, on paper, ought to have overturned them.

More recent work, however, has begun to identify the conditions under which impressions actually shift. A 2019 study by Bertram Gawronski and colleagues at the University of Texas found that updating a negative first impression requires not just contradicting evidence but contradicting evidence delivered across multiple contexts. 10 A single counterexample is treated as an exception. Several counterexamples in the same setting are treated as a phase. Only when the new behavior is observed repeatedly, across different situations, and in ways the brain cannot easily attribute to circumstance, does the original verdict begin to soften.

This is a demanding standard. It explains why the people we have already filed into one category tend to stay there. We rarely encounter them in enough varied contexts to give the categorization a chance to fail. Office colleagues remain office colleagues. The neighbor remains the neighbor. The brain’s frame, once installed, is rarely subjected to the breadth of evidence that would dismantle it.

It also explains why the few first impressions we do successfully revise tend to come from relationships that force us into varied contexts. Long friendships, romantic partnerships, family across decades. These are the conditions under which the original verdict has time to be falsified in enough ways to actually fall. Most relationships never reach that threshold. Most people remain to us, more or less permanently, the person we decided they were in the first second.

The unfinished stranger

The research arrives, in the end, at a more unsettling conclusion than the headline number suggests. The claim that the brain judges in a hundred milliseconds is striking on its own. The deeper claim is that the brain spends the rest of its acquaintance with a person defending that judgment. Speed is only the beginning. The harder work is the long, quiet labor of confirmation, the way every later observation is filtered through the early frame, the way contradicting evidence is metabolized into footnotes rather than allowed to overturn the verdict.

This is not, strictly speaking, a failure of the brain. The system that produces first impressions is doing what it was built to do, in roughly the timeframe and with roughly the level of accuracy that ancient environments required. The problem is that modern life asks the system to do work it was never designed for. To assess a job candidate across a forty-minute conversation. To decide, in a single dinner, whether a person is the kind of person to spend a life with. To weigh testimony in a courtroom, or competence on a hiring panel, or trustworthiness in a negotiation, where the cost of a false read is no longer measured in survival but in years, careers, and the slow accumulation of injustice.

The most useful thing the research offers, in the end, is not a technique for forming better first impressions. It is a habit of skepticism toward the ones we have already formed. The face you found cold may belong to someone you have not finished meeting. The colleague you decided was careless may have been carrying a private weight you never thought to ask about. The candidate you wrote off in the first five minutes may have spent the next forty answering questions designed, without anyone quite intending it, to confirm a verdict already filed. The brain is fast. It is also, in matters that matter, frequently wrong. The strangers it has already judged for you deserve, at minimum, the chance to surprise the judge.

Watch the companion essay on YouTube
— Companion videoThe same essay, told visually. About seven minutes.

Sources

  1. Willis, J. & Todorov, A., ‘First Impressions: Making Up Your Mind After a 100-Ms Exposure to a Face,’ Psychological Science, 2006. — https://journals.sagepub.com/doi/10.1111/j.1467-9280.2006.01750.x
  2. Todorov, A., Pakrashi, M. & Oosterhof, N. N., ‘Evaluating Faces on Trustworthiness After Minimal Time Exposure,’ Social Cognition, 2009. — https://guilfordjournals.com/doi/10.1521/soco.2009.27.6.813
  3. Freeman, J. B., Stolier, R. M., Ingbretsen, Z. A. & Hehman, E. A., ‘Amygdala Responsivity to High-Level Social Information from Unseen Faces,’ Journal of Neuroscience, 2014. — https://www.jneurosci.org/content/34/32/10573
  4. Todorov, A., Face Value: The Irresistible Influence of First Impressions, Princeton University Press, 2017. — https://press.princeton.edu/books/hardcover/9780691167497/face-value
  5. Asch, S. E., ‘Forming Impressions of Personality,’ Journal of Abnormal and Social Psychology, 1946. — https://psycnet.apa.org/record/1947-01278-001
  6. Ambady, N. & Rosenthal, R., ‘Half a Minute: Predicting Teacher Evaluations from Thin Slices of Nonverbal Behavior and Physical Attractiveness,’ Journal of Personality and Social Psychology, 1993. — https://psycnet.apa.org/record/1993-46719-001
  7. Barrick, M. R., Swider, B. W. & Stewart, G. L., ‘Initial Evaluations in the Interview: Relationships with Subsequent Interviewer Evaluations and Employment Offers,’ Journal of Applied Psychology, 2010. — https://psycnet.apa.org/record/2010-21220-008
  8. Ross, L., ‘The Intuitive Psychologist and His Shortcomings,’ Advances in Experimental Social Psychology, 1977. — https://www.sciencedirect.com/science/article/abs/pii/S0065260108603573
  9. Andersen, S. M. & Chen, S., ‘The Relational Self: An Interpersonal Social-Cognitive Theory,’ Psychological Review, 2002. — https://psycnet.apa.org/record/2002-15487-008
  10. Cone, J., Mann, T. C. & Ferguson, M. J., ‘Changing Our Implicit Minds: How, When, and Why Implicit Evaluations Can Be Rapidly Revised,’ Advances in Experimental Social Psychology, 2019. — https://www.sciencedirect.com/science/article/abs/pii/S0065260117300333