The Science of Leading

EducationBusiness

Listen

All Episodes

Stop Guessing in Interviews: Structured Hiring That Works

This episode unpacks why polished interviews so often miss the mark and how unstructured hiring can reward charm over actual job behavior. It also explores how structured interviews, clear scoring, and careful use of AI can improve fairness and prediction without scaling bias.

This show was created with Jellypod, the AI Podcast Studio. Create your own podcast with Jellypod today.

Is this your podcast and want to remove this banner? Click here.


Chapter 1

Imported Transcript

Claire Monroe

Welcome to The Science of Leading. I’m Claire Monroe with Edwin Carrington. Let me start with something painfully familiar. Candidate walks in, great handshake, smooth story, confident eye contact, says everything you want to hear… and six months later, you’re quietly wondering how you got it so wrong.

Edwin Carrington

And the uncomfortable truth is, most people in that room thought they were being careful. They weren’t. They were being impressed. And those are two very different mental processes.

Claire Monroe

“Impressed” is doing a lot of work there. Because interviews do seem to reward polish. Fluency. Likeability. Sometimes just… being similar to the interviewer. Not necessarily whether this person can actually deliver results when things get messy.

Edwin Carrington

Exactly. Most hiring still operates on a kind of quiet assumption that you can infer future behavior from a short conversation. Thirty, maybe forty-five minutes, and suddenly we believe we’ve assessed judgment, resilience, integrity. In reality, we’ve mostly observed how someone performs in an interview setting.

Claire Monroe

That’s such a subtle shift. So the candidate might be excellent at the very specific job of interviewing… not the actual job they’re being hired to do.

Edwin Carrington

Yes. Interviews often turn into auditions for confidence. And confidence is persuasive to the point of being misleading. Without evidence, it’s just presentation. The deeper issue is that organizations still rely on intuition as if human behavior reveals itself quickly and cleanly. It doesn’t.

Claire Monroe

And once you believe you can “read people,” you stop demanding proof. You just… trust your impression. Which, to be fair, a lot of leaders say with absolute certainty.

Edwin Carrington

They do. I’ve said it myself in the past. And I was wrong often enough to stop trusting that instinct. Strong hiring systems don’t ask, “Did I like them?” They ask, “What did they actually demonstrate, and did we evaluate that consistently?”

Claire Monroe

So this is where structure comes in. Because without it, interviews are basically… improvisation. Sometimes insightful, sometimes all over the place, and almost impossible to compare.

Edwin Carrington

That’s a good way to frame it. In an unstructured interview, one candidate gets deep questions about conflict, another talks about career goals, and a third ends up telling a story about a marathon. Then we line them up and pretend the comparison is fair. It isn’t.

Claire Monroe

And when people talk about “FBI-style” interviewing, what they really mean is discipline. Same questions, clear signals, observable behavior… not just gut feeling.

Edwin Carrington

Exactly. Strip away the branding and it’s very straightforward. Ask comparable questions. Look for concrete examples. Understand what happened, what the person did, and what changed as a result. Then evaluate that against defined criteria. That’s closer to investigation than impression.

Claire Monroe

That structure matters. Because if someone says, “I’m a strong leader,” that’s… nice, but meaningless. If they say, “I took over a team of 12, turnover was high, I changed how we ran one-on-ones, clarified roles, and retention improved,” now you actually have something to work with.

Edwin Carrington

Exactly. Past behavior isn’t perfect, but it’s far more reliable than charisma. And it improves fairness. Because when decisions are driven by instinct, instinct tends to favor what feels familiar. That’s where bias quietly enters the system.

Claire Monroe

And then we layer technology on top of that and call it progress. That’s where “algorithmically mediated inequality” comes in, right? Bias, but now it’s automated and harder to see.

Edwin Carrington

Yes. If you digitize a flawed process, you don’t remove bias, you scale it. And if the system is opaque, managers don’t even understand why decisions are being made. That’s not rigor. That’s outsourcing responsibility.

Claire Monroe

So let’s make this practical. If someone actually wants to improve hiring, what do strong systems do differently?

Edwin Carrington

They define success before the interview begins. They standardize questions. They focus on job-relevant behaviors. And they score answers based on evidence, not delivery style. The research on this is consistent. Structured interviews outperform intuition.

Claire Monroe

And when we say structured, we’re not just talking about rigid scripts. There are specific types of questions that work better, right?

Edwin Carrington

Yes. Three categories tend to be effective. Past behavioral questions, where candidates describe what they’ve actually done. Situational questions, where they explain how they would handle a realistic scenario. And background questions, which explore relevant experience in a disciplined way. Across multiple studies, these approaches predict performance more reliably than informal conversations.

Claire Monroe

So asking someone to explain a concept perfectly… isn’t necessarily the best signal?

Edwin Carrington

Correct. Knowledge and performance are related, but they’re not the same. Someone can sound highly competent and still struggle with execution, prioritization, or decision-making under pressure. Evidence of behavior tends to be more predictive than polished explanations.

Claire Monroe

That explains why some interviews feel like trivia contests. You’re testing recall, not real-world capability.

Edwin Carrington

Exactly. And those formats can be appealing because they make the interviewer feel sharp. But hiring isn’t about validating the interviewer. It’s about making a better prediction.

Claire Monroe

Which brings us back to AI. Because there’s a lot of excitement around speed and scale. But if the underlying criteria are weak, you’re just accelerating bad decisions.

Edwin Carrington

Precisely. Poor inputs at scale produce poor outcomes at scale. If algorithms are built on vague proxies or biased historical data, you get faster, more consistent mistakes. Efficiency without clarity is not progress.

Claire Monroe

So the real value of AI isn’t replacing judgment. It’s forcing clarity in how decisions are made.

Edwin Carrington

That’s the useful application. Define criteria clearly. Standardize evaluation. Make scoring transparent. Keep humans accountable. When tools support that process, they reduce noise instead of hiding it. That’s where platforms like OAD.ai can be useful, if they’re used to structure evidence and improve comparability.

Claire Monroe

So for anyone hiring next week, the move isn’t to “trust your gut more.” It’s to define what good looks like, ask consistent questions, and evaluate actual evidence. Not delivery, not confidence… evidence.

Edwin Carrington

Exactly. And one useful mindset shift is this: you’re not trying to feel certain after a short conversation. You’re trying to reduce the odds of being wrong.

Claire Monroe

And that’s a much higher bar. If you want to put that into practice, you can test tools like OAD’s behavioral assessments for free at o-a-d-dot-a-i. It’s a straightforward way to bring more structure and clarity into hiring.

Edwin Carrington

Thanks for listening.

Claire Monroe

See you next time on The Science of Leading.