August 19, 20268 min
AI-Supported Candidate Screening: What Helps, What Doesn’t
We summarise empirical reviews and the FAT* analysis of vendor practices, map SIOP validation standards onto AI tools, and draw the line to GDPR Article 22 and the EU AI Act. It is the spoke article to our EU AI Act recruiting guide.
- AI Recruiting
- Candidate Screening
- Fairness
- GDPR
- EU AI Act
What “automated screening” actually covers
The label hides very different systems: keyword rules, CV parsing, semantic matching against a competency profile, gamified tests, video analysis. Only the first three matter for most SMEs. Hunkenschroer and Luetge (2022) map AI recruiting along the process chain: the closer the system sits to a rejection, the higher the ethical and legal bar [1].
- Pre-sort: rank against defined competencies — recruiters decide who advances
- Knock-out rules: hard filters (e.g. a mandatory licence) — only if the rule is job-related and documented
- Not the same thing: auto-reject with no human review — that is the Article 22 case
Vendor claims vs documented practice
Raghavan, Barocas, Kleinberg, and Levy (2020) reviewed public materials from vendors of algorithmic pre-employment assessments [2]. The pattern: many promise bias reduction; few disclose what the model was trained on, what it predicts (historical performance? tenure? “culture fit”?), or which fairness metric they even test. Without that, “our AI is fair” is marketing, not evidence.
- Inspect the prediction target: learning from past hires also learns their bias
- Do not “remove” protected class while leaving proxies (postcode, school name, CV gaps) unchecked
- Ask for validation against job performance — not accuracy on a vendor dataset
- Technical de-biasing can conflict with anti-discrimination law if it treats groups differently [2]
Algorithmic discrimination is not an edge case
Köchling and Wehner (2020) systematically reviewed 36 studies on algorithmic decision-making in HR recruitment and development [3]. Two layers show up separately: objective fairness (differential validity and prediction across groups) and perceived fairness (how applicants experience the process). Either can damage candidate experience and legal posture — even if the model “performs” internally. Barocas and Selbst (2016) show disparate impact often arrives through seemingly neutral features, not explicit discrimination [4].
- Historical labels are not ground truth for “a good hire”
- A model that weights alma mater or employer prestige can proxy class and origin
- Perceived opacity lowers acceptance even when rankings are internally consistent [3]
Validate it like any other selection procedure
AI screening is a personnel selection procedure. The SIOP Principles (2018) apply whether a human or a model produces the score: construct, criterion, local validation, documentation, ongoing monitoring [5]. A tool that “only ranks” still needs a job-related reason for that score.
| SIOP-style requirement | What to demand from the vendor |
|---|---|
| Content validity | Which job requirements enter the score — and which do not? |
| Criterion validity | Does the score correlate with later performance, not only with “got hired”? |
| Fairness / subgroups | Adverse-impact analysis for relevant groups where lawful and statistically viable |
| Documentation | Model card: training data, update cadence, human override rate |
| Ongoing monitoring | Who checks drift when roles or applicant pools change? |
The EU hard stop: support, don’t decide
GDPR Article 22 prohibits decisions based solely on automated processing that significantly affect a person — a rejection in hiring counts. The EU AI Act treats AI used in employment and worker management as high-risk. In practice: scores may prioritise; humans must own and be able to explain the decision. That is not red tape for its own sake. It matches the research: unattended models scale error [2][3].
- No fully automated rejection from a ranking
- Privacy notice: that AI is used, for what, on which legal basis
- Explainability: which features moved the score, in language a candidate can use
- Human-in-the-loop must be real — rubber-stamping a ranking is not review
When AI screening is still the right call
The alternative to a bad model is rarely “no tool”. It is an overloaded team reading CVs in inbox order — also biased. Screening helps when the role profile leads and the model follows.
- Write competencies and knock-outs first (see the structured-interview guide)
- Match against that profile, not against “people we hired before”
- Show recruiters the rationale (which skills hit), not only a number
- Sample: periodically compare rankings to a human shortlist and explain gaps
- Log overrides — that is your audit trail, not a defect
Conclusion
AI screening is an accelerator, not a judge. The literature on vendor claims, algorithmic discrimination, and validation says the same thing as GDPR and the AI Act: disclose criteria, keep humans deciding, measure fairness instead of asserting it. Done that way, you keep the time gain without inheriting a black-box liability.
See Virkla AI Score MatchingFrequently asked questions
Is CV parsing already “high-risk AI”?
Extracting fields is not yet a selection decision. Once a score or ranking decides who gets seen, you are in the territory the AI Act treats as high-risk in employment — and in Article 22 logic if rejections follow from it.
Can we screen for “culture fit”?
As a fuzzy target, culture fit is especially prone to homophily (people like the ones you already hired). Define observable behavioural competencies and match those instead [5].
Is a vendor certificate that the model is “bias-free” enough?
No. Raghavan et al. show such claims often come without reconstructable validation or a stated fairness definition [2]. Ask for the study, the criterion, and the subgroup analysis.
What is the safest fast start?
Job-related knock-out questions, plus explainable matching against 4–6 competencies, plus a human shortlist. Skip video-emotion AI and unsupervised “personality” models.
References
- [1]Hunkenschroer, A. L., & Luetge, C. (2022). Ethics of AI-enabled recruiting and selection: A review and research agenda. Journal of Business Ethics, 178, 977–1007.
- [2]Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2020). Mitigating bias in algorithmic hiring: Evaluating claims and practices. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 469–481.
- [3]Köchling, A., & Wehner, M. C. (2020). Discriminated by an algorithm: A systematic review of discrimination and fairness by algorithmic decision-making in the context of HR recruitment and HR development. Business Research, 13, 795–848.
- [4]Barocas, S., & Selbst, A. D. (2016). Big Data’s disparate impact. California Law Review, 104, 671–732.
- [5]Society for Industrial and Organizational Psychology. (2018). Principles for the Validation and Use of Personnel Selection Procedures (5th ed.). Industrial and Organizational Psychology, 11(S1), 1–97.
