How to Run a Debrief and Record a Reasoned Hiring Decision

The interview debrief is where good hires die. You can run four careful interviews, capture clean independent signal, and then destroy all of it in a 30-minute meeting where the first confident sentence sets the verdict. An interview debrief is the meeting where a hiring panel converts its separate assessments into one decision, and it is the single most neglected, highest-leverage step in hiring. The interview measures the candidate. The debrief decides their fate, and it is almost always run on memory and seniority instead of evidence.

The problem is not that interviewers fail to gather signal. It is that the debrief aggregates that signal socially rather than statistically. Whoever speaks first or loudest anchors the room. When the hiring manager, usually the most senior person present, states their vote before anyone else, junior interviewers quietly drift toward it. The evidence was in the room. The meeting threw it away.

Why the debrief, not the interview, is where hiring breaks

Interviews can produce good independent signal. The debrief is where that signal gets pooled, and pooling people in a room introduces three well-documented failure modes: anchoring, conformity, and seniority deference.

Anchoring bias, first formalized by Tversky and Kahneman in Science (1974), means the first number or judgment introduced disproportionately shapes everyone else’s. In a debrief, the first confident “I think this is a hire” becomes the gravitational center the rest of the conversation orbits. The halo effect, documented by Thorndike all the way back in 1920, compounds it: one salient trait, a great answer, an impressive logo on the resume, colors the entire rating.

Now stack seniority on top. The most senior voice usually speaks first and carries the most weight, so junior interviewers face a choice between contradicting their boss with a half-formed argument or nodding along. Most nod. The result is a meeting that looks like consensus but is actually one person’s opinion wearing four people’s faces. The signal from the other three was real. It just never made it onto the table.

How do you run an interview debrief?

Run an interview debrief in five steps that protect the independent signal you already collected:

1. Lock independent scorecards before the meeting. Each interviewer submits an evidence-tied score within about 24 hours of their interview, with no editing once the debrief opens.
2. Vote before you discuss. Open with a silent hire / no-hire tally, not an open conversation.
3. Go junior to senior. The most junior interviewers speak first; the hiring manager speaks last, so seniority can’t anchor the room.
4. Discuss only the disagreements. Spend time where votes split, and tie every claim to specific evidence. Reject “I just had a bad feeling.”
5. Record the decision. Write down the outcome, the votes behind it, and who made the call, as structured data with an audit trail.

The order is the whole point. Capture happens before influence, voting happens before discussion, and the loudest voice goes last. Everything below explains why each step earns its place.

The science: structure beats vibes

The evidence on structured versus unstructured hiring is among the most replicated in industrial-organizational psychology, and it points one direction: structure wins.

Schmidt and Hunter’s landmark 1998 meta-analysis in Psychological Bulletin put the predictive validity of structured interviews at roughly .51 against roughly .38 for unstructured ones. That gap is the difference between a hiring method that reliably tracks future performance and one that mostly tracks how much the interviewer liked the candidate.

Reliability is even more damning. Conway, Jako and Goodman’s 1995 meta-analysis in the Journal of Applied Psychology, pooling 111 reliability estimates, found interrater reliability for unstructured interviews averaging about .37. Read that plainly: two interviewers watching the same unstructured candidate barely agree with each other. If your panel’s raw assessments don’t agree, a debrief that just averages their gut feelings is averaging noise.

Structure, meaning standardized questions, anchored rating scales, and a defined rule for combining ratings, is the single biggest lever for both validity and agreement. The debrief is where that combining rule either exists or doesn’t. Most debriefs don’t have one. They have a conversation.

A reliability coefficient of .37 is not a statement that reviewers agree in 37% of cases. Discuss differing observations and criterion interpretations; an average may hide a material disagreement.

This is the same logic behind a structured interview scorecard: the scorecard is the artifact that makes validity possible, and the debrief is where you either honor it or override it with the loudest opinion in the room.

The three levers that protect the signal

Every fix for a broken debrief is upstream of the conversation. You cannot debias a meeting from inside the meeting once anchoring has already happened. There are three levers, and all three operate before anyone speaks.

Lever 1: Lock scorecards before the meeting

Independent scores, submitted before the debrief and frozen once it starts, help limit later influence and preserve the initial judgment. If a junior interviewer commits to a 3-out-of-4 on a specific competency, with notes citing what the candidate actually said, that score can’t quietly migrate to the manager’s number during the meeting. The commitment is already on record.

The mechanism is well supported even where a single clean statistic isn’t: independent judgment formed before exposure to the group is the standard countermeasure to anchoring and conformity. The practical rule is simple. No editing after the debrief opens. A score you can revise once you’ve heard the room isn’t an independent score.

Lever 2: Round-robin, junior first

Speaking order is not a courtesy. It is a bias control. When the hiring manager speaks last, their seniority can’t set the anchor, and junior interviewers state their real assessment instead of a pre-edited version of it. Go around the table from least senior to most senior, every time.

Lever 3: Vote, then discuss

Start with a tally, not a debate. A quick hire / no-hire vote surfaces where the panel actually disagrees in about ten seconds, and then you spend the meeting only on the splits. Unanimous calls don’t need 20 minutes of discussion; they need to be recorded and closed. The disagreements are where the real information lives, and they’re where evidence, not volume, has to win.

The 80% rule: a self-diagnostic for your debriefs

Here is a number you can run against your own team this quarter. Jill Macri, the former global recruiting lead at Airbnb and now at Growth by Design Talent, uses roughly 80% as the benchmark: at least four out of every five debriefs should end in a clear hire or no-hire call. A lower rate warrants reviewing the process; it does not prove a single cause.

This is a practitioner heuristic, not a peer-reviewed law, so treat it as a diagnostic rather than a target to game. But the logic is sound. When a debrief can’t reach a clear decision, it usually means one of two things: the panel was never aligned on what the role actually requires, or the hiring manager doesn’t yet know what they need. Both are fixable, and both are invisible until you start counting.

So count. What percentage of your debriefs in the last quarter ended in a clean call versus a “let’s bring them back for one more conversation”? If it’s well under 80%, you have a calibration problem masquerading as a candidate problem, and no amount of additional interviews will solve it. The cost of getting this wrong is real: a bad hire is widely estimated to cost at least 30% of the employee’s first-year salary, a figure commonly attributed to the U.S. Department of Labor and not a guaranteed minimum for every employer. For senior roles, fuller estimates run far higher. The debrief is the last gate before that cost locks in.

You don’t need more interviewers, you need independent ones

An additional interview costs time, so define what it should clarify. Google described an analysis of its own data in which four interviews predicted the hiring decision with 86% confidence. That is not 86% accuracy in predicting subsequent job performance. The reported increase below 1% per additional interview concerns the same application.

Do not generalize the finding to any four people or every role. Check whether another round will provide new information. See also the cost of excessive interview rounds.

The lesson for the debrief is direct. Your job in that meeting is not to generate new consensus through discussion. It is to aggregate the independent signal you already have using a rule everyone agreed to in advance. Four good independent scores, combined properly, beat ten people talking until someone gives in.

Record reviews and decisions in Kit

The team_review stage in Kit supports criterion-based reviews. Other cards remain hidden until the reviewer submits their own. This is not a lock on editing once a meeting starts: authorized users can update an existing review. Define a separate procedure if you need to preserve a pre-discussion version.

Voting rules include a positive-vote threshold, required reviewers, and veto handling. An application can advance automatically when configured conditions are met. A lead veto can reject the candidate automatically when that option is enabled.

The pending-decisions queue shows cases the rules did not resolve, alongside votes, thresholds, and waiting time. It does not route a fixed 20% of cases or every veto to a person. A recorded Decision includes the outcome, rationale, deciding user, and review snapshot.

Collect cards before the meeting, compare specific observations, and record the decision and reasoning. Investigate why some cases need more information without forcing an arbitrary clear-decision rate.

Start a free trial to configure team review and decision handling in Kit.