What does a hiring process audit include?

SmartHiring's hiring process audit is one written report in six parts, delivered in week 1. A summary ranks the 3 leaks by cost. The interview process review and the scorecard and loop audit follow. In the mystery application, a CV for your job ad goes through your real pipeline. The top gaps and a 4-week action plan close it.

What does SmartHiring need for the audit?

For the audit, SmartHiring needs the job ad, the scorecards and 3 recent debrief notes. An ATS export of the last 90 days shows where candidates drop out. With the CTO, Elman Huseynov writes the CV the job ad asks for. If your screen rejects it, that is finding number 1.

Example report

Client
Series A fintech, Berlin, 38 engineers
Roles open
4 backend engineers, 1 staff engineer
Loop as found
5 rounds, 6 interviewers, 2 hiring managers
Material read
Job ad, 3 scorecards, 3 debrief notes, ATS export for 90 days
Prepared by
Elman Huseynov, week of 9 March

1. Summary: the 3 leaks, by cost

In 90 days the example fintech's loop saw 212 applicants and ran 31 first rounds. It made 3 offers and closed 1. The 3 places it lost most are ranked below by what they cost, with the section that holds the evidence.

#LeakEvidenceCost in 90 days
1The CV screen rejects the candidate the ad describesMystery application rejected in 3 days, section 4The 2 strongest profiles in the ATS never reached a human
2Two interviewers, same candidate, 2 levels apart4 of 6 debriefs, section 32 offers argued over for a week, 1 lost to a faster company
3The take-home takes 9 hours and decides nothingRound 3 drop-off 41%, section 213 candidates left before a human saw their code

2. Interview process review

The example fintech's loop is shown round by round, with drop-off from the ATS export. A round without a scorecard is marked, because a round nobody scores is a round nobody can defend in the debrief.

RoundOwnerLengthScorecardCandidates inDrop-off after
CV screenRecruiter, keyword filter in the ATS~2 minNo21285% (180 rejected)
1. Recruiter callRecruiter30 minNo323%
2. Hiring manager1 of 2 EMs45 minFree text3129%
3. Take-homeCandidate, then 1 engineer9 h medianPass/fail2241% (9 never submitted)
4. System design2 engineers60 min1 to 5, no anchors1323%
5. FounderCTO30 minNo103 offers, 1 accepted

Reading. 5 rounds, 3 of them without a scorecard. The round that removes the most candidates after the screen is the take-home, and it removes them by attrition: 9 of the 13 lost never submitted. The 2 who reached the founder round and declined both wrote "timeline" in the ATS notes. Screen to offer took 34 days median; the offers that win in this market land in 14.

3. Scorecard and loop audit

I read the example fintech's 3 scorecards and 3 debrief notes. All 6 cover the same 3 candidates. The ratings can then be set against the decision.

  • Round 2 is free text. Both hiring managers write 3 to 6 lines. Neither names a level. One writes "good energy" for a candidate the other rates "not senior enough". Without a scale there is no way to tell which is right.
  • Round 4 uses 1 to 5 with no anchors. The two engineers were 2 levels apart on 4 of the 6 candidates they both saw. In 3 of the 4 cases the higher rater interviewed first and the lower rater read that rating before the round.
  • The debrief runs in the wrong order. The CTO opens and says which way they lean; the panel then discusses. In all 3 notes the final decision matches the CTO's opening line. The panel is consulted after the decision, at 4 people's hourly cost.
  • Feedback to rejected candidates is one template line. "We decided to move forward with other candidates." 2 of the 3 rejected asked for detail; neither got any. One of them is a staff engineer the team would want back in a year.

The panel does not disagree about candidates. It disagrees about the bar, because the bar is not written down anywhere.

4. Mystery application

With the example fintech's CTO I wrote the CV of the engineer the job ad asks for: 6 years backend, Go and Postgres in production, one system carried through a scaling incident, no Kubernetes line because the ad calls it "nice to have". It went through the public careers page on a Tuesday under an agreed name. Only the CTO knew.

  • Day 3: automated rejection. The ATS filter requires "Kubernetes" and "AWS" as must-haves, which the ad lists as nice-to-have. The recruiter never saw the profile.
  • Against the 90 days: 180 of 212 applicants were rejected by the same filter. A sample of 20 rejected CVs, read by hand with the CTO, held 2 profiles the CTO would have interviewed the same week.

This is leak number 1 because it sits before every other round and costs almost nothing to fix: the filter is 2 checkboxes in the ATS.

5. Top gaps and priorities

GapFixEffortWhen
ATS filter rejects the ad's own profileMust-haves in the filter match the must-haves in the ad; the recruiter reads every CV that passes1 hourNow
Round 4 ratings 2 levels apartAnchored scorecard per role: what strong, mixed and weak evidence looks like on each line; ratings locked before the debriefHalf-day workshopWeek 2
Debrief decided by the opening lineRatings read out first, lowest rater speaks first, hiring manager decides lastOne meeting ruleWeek 2
Take-home loses 41%A 90-minute paired session on a bug in a repo like theirs; AI allowed, reasoning observed1 day to buildWeek 3
Round 2 free textSame anchored scorecard, hiring-manager lines onlyCovered by the workshopWeek 2
Rejection feedback is a templateOne specific gap from the scorecard, sent by the hiring manager within 2 days10 minutes per candidateWeek 3

6. Action plan, 4 weeks

  1. Week 1. ATS filter corrected. The recruiter re-reads the 180 rejections from the last 90 days; the CTO expects 5 to 10 worth a call. Debrief order rule sent to the panel in writing.
  2. Week 2. Half-day workshop with all 6 interviewers and both hiring managers. Scorecards for backend and staff written in the room, a recorded round scored against them, ratings compared.
  3. Week 3. Paired session replaces the take-home. First 2 live rounds shadowed, each interviewer coached after. Feedback template retired.
  4. Week 4. Calibration check: two interviewers score the same round independently; any line more than 1 level apart is rewritten. Loop is 4 rounds, screen to offer targeted at 14 days.

Measured in 90 days: panel agreement within 1 level, screen-to-offer days, paired-session drop-off, offers accepted. The same 4 numbers from the same ATS export, so before and after compare.

This report is an example. The company is a composite of engineering teams I have audited; the name, dates and every number are changed. Your report is written about your loop, from your scorecards, debriefs and ATS export.

Free 30-min Call

How do you start working with SmartHiring?

Start with a free 30-minute call with Elman Huseynov. Tell him how your team interviews today. He will tell you where the loop loses signal and what to fix first. He will also say whether the audit, the workshop or calibration fits your stage.

No pitch if the loop is already fine.

  1. The call. 30 minutes. You describe the loop, I ask about the last three debriefs.
  2. In writing, within 2 days. The three places your loop loses signal, and what to fix first.
  3. You decide. Fix it yourself with the notes, or book the audit, the workshop or calibration.