Talent, Leadership and Learning
TLL Summary Notes: Selection Under the Spotlight – Applying Evidence in Practice
On 10th November 2026, CRF hosted an online discussion for its Talent, Leadership & Learning (TL&L) Community on Selection Under the Spotlight: Applying Evidence in Practice. Led by Professor Rob Briner and Gillian Pillans, the session explored the latest scientific evidence on predicting job performance, the challenges of applying this evidence in organisational selection processes and the implications of AI for recruitment and assessment. These notes summarise the presentation and subsequent member discussion.
What Does the Evidence Tell Us About Effective Selection?
Selection aims to maximise the likelihood that individuals will perform well in a particular role. Rob highlighted several principles from work psychology research:
- Define what good performance looks like. Job performance concerns the behaviours that contribute to organisational outcomes, rather than the outcomes themselves, which may be influenced by factors outside an individual’s control. This includes task performance, contextual performance (such as supporting colleagues) and performance adaptability.
- Start with job analysis. Effective selection requires understanding the behaviours needed for a particular role and identifying the knowledge, skills, abilities and other characteristics (KSAOs) most likely to predict them. Competency frameworks can be useful, but organisations should distinguish between the behaviours required for performance and the individual attributes that predict those behaviours.
- Recognise the limitations of prediction. Even the strongest predictors typically have correlations with job performance of around 0.5, explaining approximately 25% of the variance in performance. Research findings also vary across contexts and depend on how performance is measured. Selection decisions therefore involve probabilities rather than identifying a single ‘right’ candidate.
- Prioritise direct evidence of capability. Research increasingly supports sample-based assessments, such as work sample tests, which directly assess relevant behaviours, over more indirect indicators, such as personality measures. Custom-designed assessments tailored to specific roles are also generally preferable to generic, off-the-shelf approaches.
- Consider the working environment. Individual characteristics are only one influence on performance. Job design, management quality and the wider organisational environment also determine whether employees can perform effectively. Selection alone cannot compensate for an environment that does not support performance.
Designing Selection Processes for Organisational Needs
Rob emphasised that organisations should consider what they are trying to achieve through selection beyond individual job performance. Other important outcomes may include:
- Candidate experience and perceptions of the organisation.
- Employee retention and turnover.
- Team and organisational performance.
- Fairness, adverse impact and ethical considerations.
- The time and cost involved in selection processes.
- The risks associated with poor selection decisions.
These objectives may involve trade-offs. For example, an organisation may prefer a satisfactory performer who stays in a role over an exceptional performer who leaves after six months. Similarly, selecting for organisational ‘fit’ may be valuable in some circumstances, but could discourage diversity of thinking when the organisation needs different perspectives.
Members discussed the importance of tailoring selection criteria to organisational circumstances. One attendee described using role success profiles aligned with critical competencies for positions with disproportionate organisational influence. Another highlighted the importance of assessing candidates’ ability to operate effectively in a turnaround environment.
Members also raised the challenge of maintaining selection standards in tight talent markets, where organisations may need to compromise on certain candidate attributes. This prompted questions about which characteristics are essential for successful performance and which can be developed or compensated for. In some markets, candidates are increasingly assessing employers, highlighting the importance of providing a realistic view of the role and organisation.
The discussion reinforced the importance of designing selection processes around specific organisational requirements, rather than simply adopting methods that perform well in general research. Processes should be sufficiently rigorous to support good decisions but not unnecessarily elaborate.
The Impact of AI on Selection
Members discussed how AI is changing both candidate behaviour and recruitment practices, particularly in early careers recruitment.
- Assessing candidates’ genuine capabilities is becoming more difficult. One attendee described how candidates’ use of AI in written applications had increased uncertainty about what was being assessed. Others reported concerns about candidates potentially using AI to generate responses during online interviews, making it difficult to distinguish their own capabilities from AI-generated answers.
- Organisations are reconsidering their assessment methods. Some members described bringing interviews back into face-to-face environments and introducing additional probing questions. Others are developing clearer guidance on when and how candidates can use AI, recognising that these technologies will also form part of their future work.
- AI use can itself demonstrate valuable capabilities. One attendee shared an example of a candidate who used AI to develop a tool for predicting product sales trends. Although the candidate had not written the underlying code independently, their initiative and ability to apply technology demonstrated behaviours relevant to the role.
- Employers are adopting AI cautiously. One member explained how their organisation had developed an AI agent to support managers in drafting job descriptions, while deliberately choosing not to use AI for candidate selection decisions.
The discussion highlighted the need to reconsider what assessments are intended to measure. Where AI is integral to the role, demonstrating effective AI use may be a relevant indicator of performance. Where independent capabilities are required, organisations need to ensure that assessment methods provide meaningful evidence of those capabilities.
Overcoming the Gap Between Evidence and Practice
A recurring theme was the difficulty of influencing hiring managers to adopt evidence-based assessment methods.
Members highlighted the continued preference for unstructured interviews and intuitive judgements, despite evidence supporting more systematic approaches. This can be particularly challenging when recruiting managers hire infrequently and lack experience in structured selection processes.
Similar tensions arise in talent management and development. One attendee described situations where assessment results conflicted with managers’ judgements about individuals’ potential, creating challenges in defending assessment decisions. Another highlighted how managers often focus on immediate task outcomes rather than considering the broader behaviours and capabilities required for future performance.
The discussion identified several approaches to addressing these challenges:
- Make evidence accessible to managers. HR professionals need to translate complex research into clear, practical guidance that helps managers understand why particular assessment methods are being used.
- Distinguish performance from potential. Assessing current performance and predicting future capability require different considerations, particularly when selecting individuals for leadership development or talent programmes.
- Evaluate selection effectiveness over time. Organisations should track assessment results against subsequent performance and other relevant outcomes. This can help demonstrate the value of evidence-based approaches and challenge assumptions about the effectiveness of intuitive judgements.
- Build consistency and maintain commitment. Evaluation requires reliable data, consistent measures and sufficient time to establish whether approaches are working. Organisations should avoid abandoning processes before meaningful evidence is available.
Selecting for Future Potential
Members also questioned how organisations should approach selection for early careers roles, where many of the knowledge and skills required for performance can be developed after recruitment.
Rob suggested that, where organisations intend to provide training, assessing candidates’ ability to learn and adapt may be more valuable than focusing exclusively on existing competencies. Conversely, where immediate capability is required and training opportunities are limited, existing job-relevant skills become more important.
This reinforces the importance of understanding both the requirements of the role and the development opportunities available to successful candidates.
Looking Ahead
The session highlighted that improving selection involves more than choosing the most scientifically validated assessment tools. Organisations must clearly define what they are selecting for, understand the context in which individuals will work, balance competing objectives and evaluate whether their processes deliver the intended results.
Members also identified priorities for further research, including the validity of established selection approaches such as GH Smart, the effectiveness of game-based assessments and psychometric testing, and the role of ‘dark side’ measures in identifying potential risks. Another area of interest was how organisations can make evidence-based trade-offs when suitable candidates are difficult to find.
Members’ experiences will inform CRF’s forthcoming research on evidence-based selection, scheduled for publication in March 2027, particularly around the practical barriers to applying evidence, the influence of hiring managers and the changing role of AI in recruitment. Book to attend the associated event in person here or online here.
MEMBER LOGIN TO ACCESS ALL CRF CONTENT
