When Does a Development Report Support Hiring Use?

What changes when a development report becomes a hiring screen?

A personality report validated for development is not automatically ready to help choose whom to hire. Development feedback may help someone discuss work habits or set a goal; selection uses scores to make an employment decision. Those are different inferences, even when the questionnaire is the same. The relevant question is what the score will cause the employer to do, and what evidence supports that use.

Validation is evidence for a stated interpretation and use, not a permanent quality stamp. The U.S. Office of Personnel Management (OPM) illustrates this with a personality measure intended to forecast success in a customer-service job: evidence may be needed that applicant scores relate to later performance. A work sample raises a different question because its tasks can be compared with job content. [OPM explains these different evidence questions.](https://www.opm.gov/policy-data-oversight/assessment-and-selection/assessment-strategy/)

OPM also notes that which personality factors predict performance depends on the job, and that self-report items can invite socially desirable answers. General relevance to work therefore does not establish support for a particular version, score, cutoff, and role. Start by requesting the technical documentation for the exact proposed use. [OPM describes job-dependent prediction and self-report concerns.](https://www.opm.gov/policy-data-oversight/assessment-and-selection/other-assessment-methods/personality-tests/)

If the documentation supports only coaching, self-reflection, or development, that is the boundary of the evidence currently in hand. The employer would need a separate, documented rationale before using scores to rank or exclude applicants.

Sources: Designing an Assessment Strategy; Personality Tests

What evidence connects the score to this job?

Begin with a job analysis: a documented account of important tasks and the behaviors or competencies needed to perform them. The employer should explain why the measured tendencies matter to those demands. A broad claim such as “this role needs strong people skills” does not show why a particular scale, score direction, or cutoff is relevant. The evidence chain should connect the work requirement, assessment score, expected relationship, and decision rule.

Criterion-related evidence asks whether scores relate to a relevant work outcome. Predictive evidence tests whether applicant scores forecast later outcomes. The outcome itself needs scrutiny: a performance rating may reflect useful work behavior, but can also be shaped by uneven supervision or unclear goals. Documentation should identify what was measured, who rated it, when it was measured, and how criterion limitations were considered. A correlation alone does not establish that the outcome represents the job well or that a proposed cutoff improves decisions. The employer should also describe how the criterion was scored and whether the study design supports the claimed direction of prediction. If the proposed use is to screen out applicants below a threshold, evidence about average relationships may not by itself justify that threshold or its consequences.

Evidence may sometimes transfer from other studies; a new local study is not the only possible route. The Uniform Guidelines require a documented bridge: the employer should explain how important job behaviors and criteria match, whether applicant samples are sufficiently similar, and whether the proposed use is consistent with the findings. For personality constructs, content validity alone is not an appropriate basis. A questionnaire’s workplace wording does not make it a sample of job performance. [The federal technical standards set out job-linkage, transfer, and content-evidence limits.](https://www.law.cornell.edu/cfr/text/29/1607.14)

For a useful comparison, the file should name the exact instrument version, score or composite, applicant population, criteria, study method, uncertainty, and proposed cutoff or weighting. It should then explain why evidence from another role applies to this one. This makes transfer a testable argument about similarities and differences rather than a vendor’s general claim that a report is ‘validated.’ Similar job titles alone may not establish similarity: the tasks, importance of the measured behavior, applicant group, and outcome need to be compared. The conclusion should stay within the studied range; where evidence is uncertain or the new role differs materially, the file should say so. This prevents a narrow finding from being presented as support for every role or every use of the instrument.

Reliability concerns score consistency under specified conditions. It matters because unstable scores can weaken an interpretation, but consistency does not establish that the score predicts a job outcome. OPM treats reliability and job relevance as distinct questions, and asks whether a measure adds information alongside other tools. Request reliability evidence for the relevant score and sample, then examine the separate evidence for the employment inference.

Sources: Designing an Assessment Strategy; 29 CFR § 1607.14: Technical standards for validity studies

How should fairness and alternatives affect the verdict?

Job linkage is only part of the review. Employers should examine how the proposed rule changes who advances, whether the assessment adds useful information to the existing process, and how the procedure performs when combined with interviews, experience, or other measures. A cutoff that sounds intuitively sensible still needs support. Review the intended threshold and the way scores are combined with other information, since those choices determine how evidence affects real candidates. The reviewer should trace the documented evidence through the actual selection workflow. A sound average relationship does not automatically answer whether a specific exclusion rule is justified.

In the United States, EEOC guidance explains that when a selection procedure has significant disparate impact, an employer may need to show that it predicts or significantly correlates with important elements of job performance. A less discriminatory alternative that serves the employer’s needs may also matter. The guidance’s personality-test example concerns identifying “management material”; it is a legal discussion in a Title VII context, not a psychometric study or a complete account of every jurisdiction. [The EEOC discusses this example and less discriminatory alternatives.](https://www.eeoc.gov/laws/guidance/section-15-race-and-color-discrimination)

Personality measures may contribute in some work settings, and existing evidence can sometimes transfer when job components, score meaning, criteria, and proposed use align. That possibility does not support every score or cutoff. Nor should self-reported tendencies be treated as job competencies simply because an employer values them. The case turns on evidence for the actual procedure and context. [OPM discusses potential uses alongside job-specific limits.](https://www.opm.gov/policy-data-oversight/assessment-and-selection/other-assessment-methods/personality-tests/)

Before scores affect applicants, ask for a compact evidence file that identifies the version and score rule, the job behaviors and outcome, the direct evidence or transfer rationale, the cutoff’s basis, and the review of subgroup outcomes and alternatives. It should also name who will monitor the procedure as the role or applicant pool changes. Monitoring can identify whether the assumptions behind the validation still fit the current work and whether the procedure is producing unexpected patterns. Documentation should make clear who is responsible for reviewing those signals and what would prompt reassessment. If a link is missing, resolve it before relying on the score. Development validation alone does not establish hiring suitability; selection use needs support for the particular job-related inference and decision, with fairness considered. A useful question for the hiring owner is: “What evidence connects this score and cutoff to this job, and what did you compare to check that the process works fairly?”

Sources: Personality Tests; Section 15: Race and Color Discrimination; 29 CFR § 1607.14: Technical standards for validity studies

Questions readers ask