Personality Reports for Reflection vs. Hiring Selection

Why does intended use change what a report must support?

The same self-report answer can invite two very different conclusions. Suppose a report suggests that someone tends to prefer time to prepare before speaking in a group. In a private coaching conversation, that description can prompt a check: Which recent meetings fit? When did the person respond well without preparation? What conditions changed the pattern? The report is useful if it helps make observations more specific. It need not decide whether the tendency is good or bad.

If an employer uses that score to screen applicants for a role, the question changes. The employer is making an inference about work behavior and using it to affect access to a job. Validity means evidence and reasoning support a particular interpretation of scores for a particular use. It is not a permanent stamp attached to a questionnaire. The National Research Council's explanation of testing standards makes intended purpose central to the evidence argument. So evidence that a score can start a thoughtful conversation does not by itself show that it can distinguish candidates for a job.

Consistency is a separate issue. Reliability concerns how consistently a measure produces scores under stated conditions; it does not show that the score means what a decision-maker assumes or that it predicts the outcome they care about. Reflection still benefits from understandable measures and cautious interpretation. But if a score will influence hiring, the stakes raise the evidentiary burden: the employer should be able to explain the score meaning, the job behavior it is meant to represent, and why that inference is suitable for this decision.

Sources: Performance Assessments for Adult Education: Explaining Validity in the Standards for Educational and Psychological Testing; Job Analysis

Can personality measures ever support selection?

Yes, in defined circumstances. The US Office of Personnel Management (OPM) summarizes research showing that personality measures have predicted some work outcomes, including overall performance, customer service, and teamwork. It also says they tend to be less predictive than several other methods, such as work samples and assessment centers. OPM cautions that the traits most relevant to performance depend on the job. This is a qualified case for possible use, not a blanket endorsement of any report sold to employers.

The missing link is often the work itself. OPM describes job analysis as examining a role's tasks, the competencies needed to perform them, and the connection between the two. Consider a role where staff must handle frequent customer complaints. A selection process might ask whether a measured tendency has a defensible relationship to a specific, important behavior in that work, such as listening through a difficult exchange. Simply labeling a candidate “not people-oriented” would skip that reasoning. This example illustrates the decision rule; it is not a claim about a particular instrument or job.

A meta-analysis by Tett, Jackson, and Roth reviewed 494 studies, but usable results came from 97 independent samples totaling 13,521 people. In this review, corrected mean validity estimates were .29 in confirmatory studies and .12 in exploratory studies; the estimate was .38 in studies that explicitly used job analysis to select personality measures. The authors also noted weaknesses in reporting validation-study characteristics. This older synthesis combines different measures and settings, and its corrected estimates are not forecasts for a current test or vacancy. These pooled figures do not describe individual accuracy. Its narrower lesson is that the way a measure is chosen in relation to job requirements matters; evidence still needs to fit the instrument, score interpretation, population, and outcome in the decision at hand.

Sources: Personality Tests; Personality Measures as Predictors of Job Performance: A Meta-Analytic Review

What should you ask before a report affects a hiring decision?

Ask what job requirement the assessment addresses, what score interpretation the employer uses, and what evidence supports that use. Then ask how the result changes the decision: Does it start a follow-up conversation, add one piece of evidence, or remove a candidate? A vendor's general statement that a test is “validated” does not answer these questions. The US Equal Employment Opportunity Commission's explanation of the Uniform Guidelines says that, where a selection procedure has adverse impact, an unsupported assertion of validity is not enough under that framework. Employment rules differ by jurisdiction, so this is US guidance rather than a universal legal conclusion.

Ask who sees the report, how long it is kept, whether the same conditions apply to all candidates, and whether a human reviews the result alongside other relevant evidence. Ask what applicants can do if the administration or interpretation was wrong. These are practical questions about process and consequence, not proof that the assessment is invalid. A report that affects employment deserves a clear explanation of what it measures and how its use is bounded.

Self-report also brings a context issue. Hu and Connelly's meta-analysis of within-person studies of actual applicants found higher, more socially desirable average responses and slightly lower response variability in high-stakes than lower-stakes settings; assessment order affected the pattern. This is evidence that setting can influence group results. It does not show that a particular applicant distorted answers or that personality measures cannot predict anything. It does make it reasonable to ask how the employer interprets scores when people know their answers may affect a job opportunity.

Sources: Job Analysis; Questions and Answers to Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures; Faking by Actual Applicants on Personality Tests: A Meta-Analysis of Within-Subjects Studies

How should you use a report for self-reflection?

Treat the report as a hypothesis about recurring tendencies, then test it against particular situations. If it says you prefer preparation, note a meeting where preparation helped, one where spontaneity worked, and what was different. If a colleague's feedback agrees or conflicts, consider the setting and the behavior they observed. This turns a broad description into a question you can examine rather than an identity you have to accept.

A private reflection report does not need to establish that a trait predicts job performance. It can still mislead if its terms are vague, its scoring is opaque, or it presents a tendency as a fixed rule. Look for an explanation of what the measure asks, how scores are interpreted, and what the report cannot conclude. Do not treat a general personality report as a diagnosis or a verdict about which career you should pursue. A work-pattern report can help organize questions about decisions, planning, feedback, conflict, collaboration, change, and learning; it should remain a low-stakes prompt for self-observation, not a hiring score or job recommendation.

The practical distinction is therefore about the decision and the evidence behind it. For reflection, ask whether the description helps you notice a pattern and identify a useful next observation. For selection, ask whether the employer has evidence that connects this score interpretation to the actual job and the specific employment decision, plus safeguards proportionate to its impact. Personality measures are not automatically unsuitable for selection, and a reflective report is not automatically suitable for it. If an employer asks you to complete one, a clear first conversation is: “What job-related decision will this report inform, and what evidence supports using it for that decision?”