The Science of Leading
All Episodes

Why Gut Hiring Fails, and What Predicts Performance

This episode breaks down why unstructured interviews and “hire by vibe” decisions so often mislead leaders, from first-impression lock-in to similarity bias and vague culture fit. It then shows how structured interviews, work samples, and scorecards create a more reliable system for predicting real job performance.


Chapter 1

Imported Transcript

Claire Monroe

Welcome to the show. Edwin, here’s the uncomfortable truth that still stings a bit: someone can walk out of an interview feeling absolutely certain—like, “that’s our hire”—and still be completely wrong.

Edwin Carrington

Yes, and the confidence is often the most misleading part. Unstructured interviews feel diagnostic because they’re vivid. You remember the handshake, the eye contact, the quick answer to something unexpected. But those are exactly the conditions where halo effect, similarity bias, and first-impression lock-in quietly take over.

Claire Monroe

First-impression lock-in is the one that gets me. You mean the first few minutes basically decide the whole interview?

Edwin Carrington

Very often, yes. If a candidate starts strong, every later answer gets interpreted generously. If they start awkwardly, they’re climbing uphill the entire time. That isn’t measurement. It’s narrative. And people are very good at building narratives out of thin evidence.

Claire Monroe

And similarity bias is the subtler one, right? Not some obvious “I like people like me,” but more like… this person thinks the way I think, communicates the way I do, and suddenly my brain tags that as quality.

Edwin Carrington

Exactly. Familiarity masquerades as judgment. Leaders believe they’re identifying excellence, when in practice they’re rewarding comfort and calling it instinct.

Claire Monroe

Okay, but I’m going to push back a little. Experienced managers do pick up on things that aren’t on paper—judgment, presence, maybe even grit. Are we being too dismissive of intuition?

Edwin Carrington

Not dismissive—just precise about its role. Intuition can generate a hypothesis. It should not deliver a final decision. The more reliable approach is less intuitive and more structured: ask the same job-relevant questions, use a defined scorecard, and compare evidence across candidates. That consistency improves signal and reduces noise.

Claire Monroe

“Reduces noise” feels important. Because a lot of hiring discussions sound confident, but underneath it’s… static. I’ve seen a panel shift in seconds. Candidate leaves, someone says, “She’s a star,” and suddenly everyone remembers the good parts and forgets the weak ones.

Edwin Carrington

That’s a common failure mode. The strongest personality in the room becomes the unofficial scoring system. Not because they have better evidence, but because certainty spreads quickly, especially under time pressure.

Claire Monroe

Right, confidence is contagious. One person says “executive presence,” and now everyone’s replaying the same polished moment instead of questioning the thin answers behind it.

Edwin Carrington

And “executive presence” often becomes a catch-all for vague impressions. It can conceal bias, class signals, communication style preferences. A structured scorecard forces a more useful question: what did this person actually demonstrate that connects to the role?

Claire Monroe

So if a team can’t point to specific behaviors or answers, then what they’re calling judgment is probably just chemistry.

Edwin Carrington

Yes. And chemistry is useful in social settings. It is not sufficient as a hiring method.

Claire Monroe

So what actually predicts performance better than that smooth, flowing interview everyone enjoys?

Edwin Carrington

Three methods, used properly: structured interviews, work sample tests, and job-relevant assessments. They outperform free-form conversations because they approximate future behavior rather than surface-level impression.

Claire Monroe

Work samples feel almost too obvious once you say it. If you’re hiring a writer, have them write. If you’re hiring a salesperson, simulate a real sales conversation. If it’s a manager, give them a messy team problem and see how they think through it.

Edwin Carrington

Exactly. “Show me” is far more informative than “tell me.” Someone can be excellent at telling their story and still underperform in the actual work. Validity increases when the assessment resembles the job.

Claire Monroe

And just to ground that—validity means the method actually connects to real performance, not just producing a clean-looking score.

Edwin Carrington

Correct. A valid method predicts outcomes that matter. An invalid one creates the appearance of rigor without meaningful signal.

Claire Monroe

This is slightly uncomfortable to admit, but I can feel myself doing this. Someone answers quickly, confidently, with a neat structure, and my brain goes, “capable.” Which is… not reliable.

Edwin Carrington

It’s very human. Confidence is easy to observe. Competence is often quieter, slower, and context-dependent. The goal is not to judge personality in an hour-long conversation. It’s to predict behavior under real conditions.

Claire Monroe

That’s the shift, isn’t it. Not “do I like this person” or even “are they impressive,” but “what are they likely to do here repeatedly when things get difficult?”

Edwin Carrington

Exactly. And this is where base-rate thinking helps. Instead of asking how this one interview felt, ask which methods consistently predict success across many hires. Leaders often ignore the base rate in favor of a compelling individual story.

Claire Monroe

The “I know there’s a process, but I have a really good feeling about this one” situation.

Edwin Carrington

Yes. Often the beginning of a costly mistake.

Claire Monroe

And this is where culture fit gets tricky. It sounds reasonable, but it can easily turn into sameness.

Edwin Carrington

More often than leaders acknowledge. “Culture fit” becomes shorthand for familiarity—shared background, style, or comfort. A better lens is values in action: how does this person handle disagreement, accountability, pressure, learning?

Claire Monroe

So not “would I enjoy working with them,” but “when something breaks, do they respond in a useful way?”

Edwin Carrington

Exactly. And if the answer comes from a vague feeling, you don’t yet have a reliable answer.

Claire Monroe

Let’s make this practical. If someone says, “this all makes sense, but I don’t have time to build a massive hiring system,” what’s the minimum viable version?

Edwin Carrington

Start with five steps. Define the role clearly. Identify the few competencies that truly matter. Build a consistent scorecard. Compare candidates using evidence rather than memory. And calibrate after hiring—look back and check whether your interview signals matched real performance.

Claire Monroe

That last step—calibration—feels like the one almost nobody does. People hire, move on, and never check if their decisions actually worked out.

Edwin Carrington

Without calibration, there is no learning loop. Hiring becomes folklore. People rely on confidence rather than outcomes.

Claire Monroe

The part I’d want on a wall somewhere is not confidence—but hit rate. How often were you actually right?

Edwin Carrington

Exactly. Now, there is a real tension between speed and rigor. Teams often feel they need to hire quickly. Sometimes that urgency is valid. But a poor hire creates far more delay over time—rework, team friction, lost productivity.

Claire Monroe

So what feels fast in the moment can be very slow over the next six months.

Edwin Carrington

Precisely. Sloppy hiring feels efficient only at the beginning.

Claire Monroe

And none of this works if people won’t actually use the system. So it has to be simple enough that busy teams don’t ignore it.

Edwin Carrington

Correct. A usable system is better than a perfect one. Clear competencies, a small set of structured questions, one realistic work sample, independent scoring before discussion, and a simple calibration habit. That already creates a meaningful improvement.

Claire Monroe

Independent scoring before discussion—that’s a big one, right? It stops the loudest voice from shaping everyone else’s opinion.

Edwin Carrington

Exactly. Capture judgments before social influence begins. Otherwise, you’re not collecting multiple perspectives—you’re watching one opinion spread.

Claire Monroe

Which brings us back to the strange part. Leaders standardize everything else—finance, operations, quality—but hiring, which defines the entire system, still gets treated like taste.

Edwin Carrington

Yes. And that raises an important question. If effective hiring systems are repeatable and teachable, why do so many leaders still treat hiring as an art instead of building it like an operating system?

Claire Monroe

Probably because art flatters the artist. Systems expose the score.