The evidence-based framework for comparing candidates fairly — from setting criteria before interviews to running structured debriefs that prevent groupthink.
The 5-Step Objective Evaluation Framework
This belief — which most founders hold — reliably produces bad hires. It creates a process where personal chemistry substitutes for evidence, where whoever interviewed last has the most influence, and where interviewers compete to share their impressions instead of their data.
The research is consistent: unstructured interviews have roughly the same predictive validity as a coin flip. The reason is simple — humans are pattern-matching machines. We find evidence for the conclusion we've already reached, not evidence that challenges it.
The solution isn't to eliminate judgment — it's to structure when and how judgment enters the process.
The single highest-leverage thing you can do to improve your hiring is to write a scorecard — a list of 4–6 competencies and what strong evidence for each looks like — before your first interview.
Why before? Because defining criteria after you meet candidates means you'll unconsciously weight what your favourite candidate happens to be strong in. You've already anchored.
Example: Competencies for a Marketing Manager
For each competency, write what a score of 1 (weak), 2 (mixed), 3 (solid), and 4 (exceptional) looks like in terms of actual evidence. Not "good communication" — "can explain a technical decision to a non-technical audience with zero jargon and bring them to alignment."
Structured interviews — identical questions, identical order — consistently outperform unstructured ones in predicting job performance. The reason is straightforward: you can only compare candidates fairly if you've put them through the same test.
Pick 1–2 questions per competency. Use behavioral format: "Tell me about a time you..." Evidence from real past experience beats hypotheticals 3:1 in predictive validity.
Unstructured (weak)
"So tell me about yourself — what brings you here?"Structured (strong)
"Tell me about a time you had to build a marketing channel from scratch. What was your approach and what was the measurable outcome?"Unstructured opening ("tell me about yourself") gives you the candidate's rehearsed narrative, not evidence. Always anchor to specific past behaviour.
The most common debrief mistake: starting with "so what did everyone think?" This immediately activates anchoring. Whoever speaks first sets the frame. Everyone else subconsciously adjusts toward their position.
The rule: every interviewer scores every competency independently, in writing, before any discussion. The scores then get shared simultaneously — not sequentially.
Scoring discipline checklist
Share all scores simultaneously. Identify the variance — where people disagree is where the useful information is. Work through disagreements with evidence, not persuasion.
The debrief leader's job: "You scored communication a 2, she scored it a 4. What evidence drove each score?" Force the group to surface the actual interview data behind the rating.
Debrief structure (30 minutes)
Bias doesn't disappear when you build a structured process — but it becomes visible and discussable. These are the seven types most likely to affect startup hiring decisions:
7 Hiring Biases to Watch For
| Bias | What it looks like | How to counter it |
|---|---|---|
| Affinity bias | "We'd really get along" — hiring people who remind you of yourself | Score on competencies, not personal connection |
| Halo effect | One impressive answer elevates the rating of everything else | Score each competency independently |
| Horns effect | One weak answer depresses everything else | Require evidence for every score; look for the full picture |
| Recency bias | The last candidate seems better than the first because they're fresher | Score immediately after each interview, not at the end of a day |
| Anchoring | First impression or first interviewer's opinion dominates the debrief | Share all scores simultaneously before discussion |
| Confirmation bias | Seeking evidence that confirms the pre-interview gut feeling | Assign interviewers to specific competencies; don't share impressions before interviews |
| Availability bias | Hiring whoever is available rather than the right person | Agree on a minimum hire score before interviewing; don't move the bar for expediency |
Before any search begins, align your team on this: what is the minimum score across competencies that constitutes a hire? And stick to it — even when you're under time pressure, even when the pipeline is thin.
The most expensive hiring mistake isn't a prolonged search — it's hiring someone you knew wasn't quite right because you were tired of searching. That person costs you 3–6 months of performance, 4–12 weeks of management time, and often damages the people around them before you act.
If nobody meets the bar: reset the sourcing, not the bar.
HireLikeaPro generates custom scorecards with competencies, scoring guidance, and interview questions — all free.
Build My Scorecard Free →