An unstructured interview loop explains about 4% of later job performance. A structured one explains about 26%.
On this page
Same hours, same people, same candidates.
Most interview loops leak that signal in the same 4 places.
The question is designed last. Nobody writes anything down. The loop runs too long. The bar lives in people’s heads.
Your interview loop rejects engineers at close to random. From the inside it looks fine.
I have run 100+ technical interviews. At Zalando I defined the hiring process for 27 markets.
The number that should end the argument
Unstructured interviews explain about 4% of later job performance. Structured ones explain 26%.
6 times more of the outcome is explained when the interview has a structure.
The 4% means this. Interview 2 candidates, pick one, and you mostly measured 3 things.
The interviewer’s mood, the candidate’s nerves, and whether the 2 clicked.
What does a normal interview loop actually measure?
Four things, none of them the job. Comfort under observation, and shared vocabulary.
Whoever interviewed most recently, and a view formed in the first 4 minutes.
None of it compares between candidates, and none of it predicts the actual work.
Interview fluency. Comfort being watched while thinking. A real skill, and not the one you are hiring for.
Shared vocabulary. “Eventual consistency” outscores the same idea in plain words.
Recency. Last week’s candidate is compared to this morning’s. The older memory has already flattened.
The first 4 minutes. Interviewers form a view early, then spend the hour looking for support.
Where does the signal leak out?
In 4 places, and almost every broken interview loop leaks in all 4.
The question gets designed after the job ad instead of before it. Nobody writes anything down until the debrief.
The interview loop runs 6 rounds when 4 would do. And the bar lives in people’s heads.
Leak 1: the question came after the job ad. Write the 3 to 5 things this person must do in year one first. Then design the question. The scorecard takes an afternoon.
Leak 2: nothing written before the debrief. The room is decided by whoever speaks first.
I have watched a strong hire become a no-hire in 11 minutes. Scores submitted in writing, alone, fix it at zero cost.
Leak 3: the loop is too long. Rounds 4 to 6 re-measure what rounds 1 to 3 told you. The candidate is 3 weeks in, with 2 other offers.
Leak 4: the bar lives in people’s heads. Ask 3 interviewers what “strong hire” means. You get 3 bars. Calibration on one recorded candidate is the fix.
Why do you never find out about a false negative?
A rejected candidate does not send a report in 18 months explaining what you missed.
The cost of rejecting good people stays invisible. A bad hire is loud and remembered.
Teams therefore add rounds, raise the bar vaguely, and reject more good people.
You see false negatives only when the criteria are written down.
A rejection then traces to a line. You can ask whether that line was fair.
What does this look like on Monday?
One afternoon and one uncomfortable meeting.
Write the 3 to 5 things your next hire does in year one. Add the evidence that would convince you of each.
Delete any round that produces no evidence against that list.
Require written scores before every debrief. No exceptions for senior people.
Run 1 calibration session where the whole panel scores the same candidate. Step 4 is the one teams skip.
At Zalando this cut time to decision, and panel disagreement went up at first. That was the process working.
Common questions
How many interview rounds should an engineering loop have?
Four for almost every role. A screen. A coding or practical round. A design or depth round. A hiring manager conversation. Rounds 5 and 6 re-measure what the first 3 showed. Meanwhile the candidate collects offers elsewhere. If 4 rounds cannot decide it, the criteria are unclear.
Does structure work for senior and staff hires too?
Yes, and the scorecard changes rather than disappearing. At staff the evidence is influence without authority. Choosing what not to build. Handling ambiguity. Those are harder to write down than coding ability. That is exactly why unstructured senior loops go so wrong.
What is the smallest change worth making first?
Written scores submitted before the debrief. It costs nothing and needs no new tooling. It stops the loudest person in the room setting the outcome. Most teams see the effect in the first debrief. The disagreement becomes visible instead of being quietly resolved.
How do you run a calibration session?
Everyone scores the same recording alone, then submits. Only then do you open the room and compare. Spend the hour on why the scores differ, not on the candidate. 2 sessions a year keeps a panel aligned. The first one is always the uncomfortable one.
Why are panel interviews used?
Panels exist to average out one interviewer’s bias. Panels only do that when each person owns a different signal. Four people asking the same questions produces 1 opinion, 4 times. Panels also push nervous candidates below their level. Two interviewers per round, with separate assignments, gathers more evidence.
The short version
Unstructured interviews explain 4% of performance. Structure takes it to 26%.
Write the scorecard before the question. Cut the interview loop to 4 rounds. Collect written scores before the debrief.
Calibrate the panel on a real candidate.
None of this needs budget. It needs someone to say out loud that the interview loop is not working.
Want it done with you rather than by you?
I run hiring audits and interviewer calibration as fixed engagements.
The first call is 20 minutes and free. I will say if your interview loop is already fine.
One hiring stage, taken apart, every week
The same teardowns that run on LinkedIn, in your inbox. No pitch, one click to leave.
Read next
Why Technical Hiring Is Broken
Most loops measure things nobody agreed on in advance. Here is what that costs, and why I started SmartHiring.
The Scorecard Template, Written First
Most hiring problems start before anyone interviews. If you cannot describe a strong answer in advance, the loop will produce noise.
Want this fixed in your loop?
Interview training for hiring managers and their panels: one workshop on your open roles, scorecards written for them, and calibration until the panel agrees. It starts with a free 20-minute call.
No pitch if the loop is already fine.