Why a Coaching Personality Report May Not Suit Hiring

Why can the same report fit coaching but fail to justify hiring?

A personality report can be useful in coaching and still provide too little evidence for hiring. The difference is the claim being made. In a coaching conversation, a statement can serve as a question for one person to test against experience. In hiring, a score may be used to compare applicants and influence who gets access to a job. That consequential comparison needs evidence connecting the particular score interpretation to relevant work behavior, the people and setting in question, and the decision rule. Personal usefulness does not establish that connection.

Consider this illustration: “I may prefer time to compare options.” In coaching, the sentence can open a focused discussion: When has taking time helped? When has it delayed a decision? Does the tendency change when information is incomplete or a deadline is close? The person can bring examples and exceptions, then decide whether the description helps with a goal. The statement remains a prompt, not a fixed account of character or proof that coaching produced improvement.

Now imagine using the same sentence to rank applicants. By itself, it does not say whether a particular job requires quick decisions, careful comparison, both at different moments, or something else. It also does not show that a report score reliably distinguishes those behaviors or predicts a relevant work outcome. The Society for Industrial and Organizational Psychology’s *Principles for the Validation and Use of Personnel Selection Procedures* frames selection around the accuracy of inferences underlying personnel decisions and says evidence must be considered in relation to proposed uses. The Public Service Commission of Canada’s *Testing in the Public Service of Canada* likewise treats prediction of job performance as a central employment inference and calls for evidence suited to intended use. These are professional and public-service guidance, not validation findings about an unspecified commercial report.

So the report need not change for its suitability to change: the inference and consequence have changed. A reflective description may help one person notice a pattern without proving that the pattern predicts performance or justifies comparing candidates. This is not a claim that personality measures can never inform selection. It is a narrower rule: do not turn a coaching prompt into an applicant ranking unless evidence supports that particular measure, interpretation, work-related outcome, population, and decision.

Sources: Principles for the Validation and Use of Personnel Selection Procedures; Testing in the Public Service of Canada

What can a coaching conversation reasonably take from the report?

A coaching conversation can use a personality report as a tentative description to examine, not as a verdict about the person or proof that coaching has changed anything. Its immediate value may be modest and practical: helping someone put a question into words, recall examples and exceptions, and connect that discussion to a goal they have chosen. The report starts the inquiry; the person’s experience and the purpose of the conversation shape what follows. The coach can keep the discussion anchored to observable episodes rather than turning a broad label into a fixed account of character. Suppose a report says that someone prefers time to compare options. Treat that sentence as a prompt, not a finding about every decision. A coach might ask: “Can you think of a recent choice where you wanted more time? What information were you weighing? Was there a decision where you moved quickly?” The answers can make the statement more precise. Perhaps the person wanted time only when consequences were hard to reverse, or perhaps the wording does not fit their experience. Either response is useful information for the conversation; neither, by itself, establishes that the report measures a stable quality accurately. It helps to keep four things distinct. First is the score produced by the assessment. Second is the report’s interpretation of that score, including the words chosen to describe a tendency. Third is the person’s response: agreement, disagreement, uncertainty, or recognition that the description fits only in certain settings. Fourth is any later action, such as trying a different planning routine or asking a colleague for clearer decision criteria. These are related, but they are not interchangeable. A fluent interpretation is not the score itself, agreement is not independent evidence that the interpretation is accurate, and a planned action is not evidence that it worked. The SIOP Principles for the Validation and Use of Personnel Selection Procedures frame validity as evidence supporting a particular interpretation of scores for a proposed use. Applied carefully here, that standard marks a boundary: a report that prompts a useful coaching question has not thereby demonstrated that its score predicts work behavior, that a coaching discussion improves performance, or that a particular action will help. Those would be further claims requiring their own evidence. The principles address personnel selection, so this is an inference about the distinction between reflective usefulness and evidentiary support, not a study of coaching outcomes. A person can therefore keep authority over the interpretation. They can ask what examples support it, what exceptions complicate it, and whether the question matters to a goal they actually want to pursue. If the statement feels too broad, the next step may be to narrow it to a setting or behavior. If it seems wrong, the person need not force a fit. The useful result is a clearer question, even when the answer is that the report’s wording does not help.

Sources: Principles for the Validation and Use of Personnel Selection Procedures

What new claim does hiring ask a personality score to support?

Hiring asks a different question from coaching: does a defined interpretation of this score contribute useful evidence about behavior or performance relevant to this job and this selection decision? That is a prediction or comparative inference. The score is no longer only a prompt for one person to reflect; it may help determine which applicants move forward or receive an offer. The added consequence raises the evidence burden. A report’s clarity, personal resonance, or practical usefulness in discussion cannot answer the hiring question by itself. Validity means evidence supports a particular interpretation of scores for a proposed use. It is not a permanent quality stamp attached to a test for every purpose. The Society for Industrial and Organizational Psychology’s *Principles for the Validation and Use of Personnel Selection Procedures* frames the task around the accuracy of inferences underlying personnel decisions. Its guidance asks users to consider the proposed use and the evidence relevant to that interpretation. That leaves open whether it predicts an outcome in a job. Reliability means score consistency. Consistency matters because unstable scores limit what can reasonably be inferred, but a consistent score could still measure something unrelated to the work decision. The U.S. Office of Personnel Management’s *Designing an Assessment Strategy* distinguishes reliability from validity and illustrates the latter with evidence connecting a customer-service personality measure to subsequent job performance. The example clarifies the link at issue, not another instrument. One coefficient does not establish suitability for screening or ranking. The reasoning chain begins with the exact instrument and version, then identifies the construct or scale and the way its score is calculated and interpreted. Next comes the criterion: the work behavior or outcome the employer wants to anticipate. The evidence needs to make sense for the relevant time frame and population, including whether it concerns applicants or people already in the role. The employer must explain how the score enters the decision. A score used as one source of information poses a different inference from a cutoff that automatically removes candidates. Evidence for an association with a broad performance measure does not, by itself, show that a particular threshold is justified. Job analysis means identifying important work behaviors or requirements so the employer can decide what an assessment should measure and what counts as a relevant outcome. The Canadian Public Service Commission’s *Testing in the Public Service of Canada* describes job-performance prediction as a central employment inference and places assessment evidence in relation to intended uses and job requirements. It also recognizes that evidence may sometimes be generalized or transported when contexts are sufficiently comparable. That is a reasoned transfer, not permission to treat evidence for any report or role as interchangeable. These distinctions make the reader’s question more precise. “What does this report tell me?” asks first what its score describes and how uncertain that description is. “What does this report tell an employer about my likely work?” adds a criterion, a population, a decision rule, and consequences. General research about a personality construct cannot fill those gaps unless it supports the actual score interpretation and proposed use. A polished narrative cannot substitute for evidence connecting the measure to the work claim. Before use, the person relying on the report should trace that connection and explain the score’s role. If the chain breaks at the job criterion, population, or decision rule, the report may remain a useful reflective document, but the hiring inference has not been established.

Sources: Principles for the Validation and Use of Personnel Selection Procedures; Designing an Assessment Strategy; Testing in the Public Service of Canada

Why do reliability, norms, and a polished report leave the hiring question open?

A reliable result can still leave the hiring question unanswered. Reliability means score consistency: how similar scores are across comparable administrations. Consistency matters because random error can blur differences. The U.S. Office of Personnel Management’s “Designing an Assessment Strategy” explains that reliability limits useful predictions. But reducing noise does not establish what a score means for a job. A stable measure of a characteristic irrelevant to the work can be consistently irrelevant. That distinction is easy to miss when a report displays a precise number. The question is not simply whether the number repeats, but whether its interpretation supports the proposed use. The “Principles for the Validation and Use of Personnel Selection Procedures” treats validity as evidence for interpretations required by proposed uses. In hiring, the inference typically concerns later work behavior or performance. Evidence for one inference may not support another. A percentile answers a different question. It locates a person’s score relative to a reference group, often indicating the proportion scoring at or below that point. It does not say whether the person can perform a particular job, whether a score difference matters at work, or whether an employer should reject someone. Its meaning depends on who was in the norm group and whether the comparison fits the person and context. A percentile from one version or population cannot simply be carried over to another without evidence that the interpretation still holds. For example, a report might place a respondent above most people in its norm group on a scale described as deliberation. That comparison can prompt questions about whether they pause before deciding and whether this varies by situation. It does not establish that deliberation is required for a named role, that the scale measures it well for applicants, or that a high percentile predicts stronger performance. Nor does it show that people below a chosen point would perform poorly. Each is an additional claim requiring a link to the work and decision. A further source of confusion is internal consistency: how closely items within a scale relate. It can help evaluate whether questions behave like a coherent measure, but does not by itself show that the scale predicts a job outcome. Similar items can consistently capture a narrow preference while leaving the employer’s question untouched. “Designing an Assessment Strategy” separates reliability from validity and says evidence should fit the assessment’s use. Its example asks for evidence connecting a personality test intended to forecast customer-service success with later job performance. This illustrates the missing bridge; it does not validate a particular report. A polished narrative can make the leap feel smaller. A sentence such as “you prefer a clear plan before acting” is easy to recognize and discuss. Its clarity may make it a useful reflection prompt, but does not demonstrate predictive accuracy. A report may translate a continuous score into a compact label or band, making results easier to read while obscuring uncertainty and the category’s basis. Good writing cannot substitute for documentation of the instrument, score interpretation, comparison group, and proposed use. Keep the questions separate. Does the score show reasonable consistency, and what error remains? What does the comparison group tell the reader? What work behavior or outcome is being assessed? What evidence links this instrument and interpretation to that criterion in a relevant population? The “Principles for the Validation and Use of Personnel Selection Procedures” emphasizes evidence for the proposed interpretation; “Designing an Assessment Strategy” distinguishes consistent measurement from job-related prediction. An answer to one cannot stand in for the others. Reliability, norms, and readability can each contribute useful information, but none alone resolves whether a report should influence hiring. Reliability speaks to consistency, a norm describes relative standing in a particular group, and a polished explanation communicates an interpretation. The hiring question remains open until evidence connects the specified score meaning to relevant work and the employer’s decision. Ask what the score means, then what supports that job-related inference.

Sources: Designing an Assessment Strategy; Principles for the Validation and Use of Personnel Selection Procedures

When can evidence travel from coaching to selection, or between jobs?

Evidence can sometimes generalize across comparable uses, job components, or populations, but the transfer needs a documented rationale. A coaching report does not become a hiring measure merely because both settings discuss work behavior. The question is whether evidence supports the score interpretation and decision now proposed. A prompt that helps one person examine a tendency is not, by itself, evidence that the tendency predicts a criterion or distinguishes applicants for a particular role.

The Public Service Commission of Canada’s testing standards make this distinction for Canadian public-service appointments. They describe validity evidence as support for an inference from scores to work behavior, and state that evidence should exist for intended uses. Developers provide available evidence, while users check that the qualification assessed is relevant to the job. This is a professional framework for that context, not universal law or a demand that every employer conduct a new study. Its lesson is that a proposed transfer needs reasons a reader can inspect.

The standards describe validity transportability as judging whether predictive relations from another setting apply to the current one, and validity generalization as using studies in similar situations to estimate the score-to-performance relationship at hand. The Society for Industrial and Organizational Psychology’s Principles for the Validation and Use of Personnel Selection Procedures likewise tie validity to the proposed interpretation. Together, these sources reject two shortcuts: requiring fresh local data in every case, and treating any published or vendor evidence as automatically transferable.

To judge the bridge, compare conditions shaping the inference. Is it the same instrument version, measuring a similar construct, with comparable scoring and administration? Were respondents answering as applicants or incumbents reflecting on themselves? Does the target job involve similar demands, and is the performance criterion clearly defined and measured? Is the relevant language and population similar enough for the score to mean the same thing? Is evidence offered for the actual decision rule, especially if a score will exclude people rather than add information? The Canadian standards call for informed judgment about the test, circumstances, purpose, and available evidence, not a mechanical checklist.

A break in one link does not prove a measure is useless; it means the transfer needs explanation or additional evidence. Evidence that one scale predicts a defined behavior in comparable roles may be relevant elsewhere if similarities and limits are documented. It cannot establish that a different report, revised items, another applicant group, or broad hiring cutoff is justified. Evidence from reflective coaching also does not establish job-performance prediction: setting, inference, and consequence differ. As a practical inference, the more a proposed use changes the measure, population, criterion, or decision, the more closely the rationale should address that change.

This avoids both extremes. Employers need not assume evidence always starts from zero; existing work may travel when conditions are comparable and the rationale is credible. But a general claim that a report helps development or measures a work-related tendency is not enough to support selection for an unrelated role. Ask what was studied, which score and version were used, what job behavior or outcome counted as the criterion, and why findings apply here. If the answer cannot make that bridge visible, the evidence has not justified the hiring inference.

Sources: Testing in the Public Service of Canada; Principles for the Validation and Use of Personnel Selection Procedures

How do applicant stakes, response conditions, and decision rules matter?

Applicants answer a personality questionnaire in a setting where their responses may affect access to a job. A person using a report in coaching may also care how they are seen, but the immediate task is to examine a description against experience. This difference in incentive and consequence does not prove applicants will distort answers or that coaching answers are candid. Hiring therefore needs evidence about how a score functions under its actual conditions of use. Instrument, instructions, stakes, population, and decision rule help define the claim.

The publisher abstract for “Is the Political Skill Inventory Fit for Personnel Selection? An Experimental Field Study” describes one bounded test. Researchers asked 102 job incumbents to complete the Political Skill Inventory, a social desirability scale, and a Big Five inventory as if applying for a personally attractive position; 110 incumbents in a control group were told to answer honestly. The abstract reports construct and incremental criterion-related validity in both instruction conditions, and no correlation between the Political Skill Inventory and the social desirability measure. This is evidence about that inventory, those incumbent participants, instructions, and reported outcomes. It does not show that every personality report resists distortion, predicts job performance, or works in an actual applicant pool. The design simulated applicant instructions; it did not observe competing candidates or real selection decisions. Its lesson is narrower: response conditions can be studied, but a result under one condition does not settle another intended use.

What an employer does with a score matters too. A prompt in a structured conversation differs from a cutoff that removes applicants, a ranking that determines who advances, or a heavily weighted part of a composite decision. These choices change the score’s influence and the evidence needed for the inference. Reviewers should ask what information it adds beyond other job-related evidence, why the decision rule was chosen, and what uncertainty means near a threshold. An association with a relevant outcome does not establish that a particular cutoff separates qualified from unqualified people. Adding interviews or other tools does not automatically repair a weak measure; the combined process must make sense as a whole.

Prediction also cannot settle whether the measured quality is relevant to the work, whether applicants can understand the assessment and request accommodations, who sees or retains results, or how errors can be questioned. The U.S. Equal Employment Opportunity Commission’s “Employment Tests and Selection Procedures” guidance identifies personality tests as possible employment selection procedures and explains that their use can raise federal discrimination concerns, including disproportionate exclusion of a protected group without sufficient job-related justification. This U.S.-specific guidance is not a legal conclusion about an unnamed employer or report. It shows why fairness review is separate: a measure may predict a work criterion in a study while a particular process still warrants scrutiny for its effects and administration.

A reader can ask what happens after the result is produced. Is it a discussion topic, one input among several, or a gate that can end an application? What score interpretation and job behavior are connected, for which applicant population, and under what instructions? How is uncertainty handled, and what review or accommodation process exists? These questions keep evidence tied to consequence. Administration and score use belong inside the suitability judgment; the same measure cannot be presumed to carry the same meaning when stakes and decision rules change.

Sources: Is the Political Skill Inventory Fit for Personnel Selection? An Experimental Field Study; Employment Tests and Selection Procedures; Principles for the Validation and Use of Personnel Selection Procedures

Does this mean personality reports can never inform hiring?

No. Personality measures can contribute to some job-related selection decisions. The important qualification is that evidence for one measure and use does not validate every report that describes work tendencies. A selection claim must be tied to the score interpretation, the work criterion it is meant to inform, the people and setting studied, and the way an employer uses the result. Fairness and consequences also need separate consideration.

A useful counterexample comes from “Using Theory to Evaluate Personality and Job Performance Relations: A Socioanalytic Perspective.” Hogan and Holland analyzed 43 independent samples, totaling 5,242 working adults, drawn from studies dated 1980 to 2000 in Hogan Assessment Systems’ archive. All used scales from the Hogan Personality Inventory (HPI), and all included job analysis to identify personality-related job requirements. The criteria were specific performance ratings or objective productivity or personnel measures. Researchers matched personality scales with performance criteria judged to reflect related constructs. Across the 43 samples, the estimated true validity for HPI Adjustment was .43 when matched with construct-classified criteria; estimates for the other reported scales ranged from .25 to .42. These corrected, group-level estimates are not probabilities of an individual applicant succeeding or employer cutoffs.

That design offers a substantive reason not to dismiss all personality assessment in selection. The relationship looked more useful when the measure and the work criterion were specific and conceptually aligned than when the authors combined criteria into broader categories. For global criteria combining “getting along” and “getting ahead,” estimated true validity varied across HPI scales: .32 for Adjustment, .22 for Ambition, .24 for Prudence, and lower or near-zero values for several other scales. Results depended on the scale-criterion pairing; no scale was uniformly informative about all performance.

The study’s limits are just as important as its positive result. It examined one instrument, the HPI, rather than an unspecified coaching report. Its archive covered studies from 1980 through 2000, and 41 of the 43 samples used concurrent validation, in which predictor and criterion information were collected in the same general period; only two used predictive designs. The paper’s classification included no Investigative or Artistic occupations. Although job analysis was part of every included study, the archive does not establish that a particular score interpretation predicts a particular outcome in every role, applicant group, language, or present-day process. It does not show that a reflective report shares the HPI’s items, scoring, administration, or evidence. The source is a meta-analysis of archived studies associated with the instrument’s publisher, a relevant context to disclose when weighing its conclusions.

The Office of Personnel Management’s “Personality Tests” guidance reaches a similarly conditional position. It says personality tests have shown criterion-related validity in numerous settings and across different work criteria, while noting that the personality dimensions most predictive of performance depend on the job. It describes personality measures as potentially useful for work involving interpersonal interaction or teams, and less useful for highly scripted roles where personality has little room to affect performance. This is general U.S. federal guidance that summarizes a literature; it is not a validation study of the report in a reader’s hands.

OPM also identifies concerns that a positive predictive finding cannot settle. OPM notes applicants may find items intrusive or unrelated to the job, and transparent questions may invite favorable self-presentation. Its summary of generally small subgroup score differences does not establish fairness for every instrument or procedure. It cannot establish fairness in a particular employer’s process. Predicting a work criterion and treating applicants fairly are related responsibilities, but they are not the same question.

The comparison rule is therefore straightforward: a positive result supports only the inference its evidence actually tested. Evidence from a named measure, studied population, defined criterion, and specified design can make a case for considering that measure in a sufficiently comparable use. It does not transfer automatically to a different report, score band, job, applicant group, threshold, or decision process. HPI findings do not show that one score can rank all applicants or identify who will thrive. Group patterns leave uncertainty about any individual.

What would change the conclusion about a particular report is direct, relevant support for its proposed selection use, or a well-supported basis for transferring evidence from sufficiently comparable settings. The employer should identify the version, score interpretation, job-related criterion, and why the studied population and conditions fit. The decision rule matters: using a score as one input makes a different claim from excluding applicants at a cutoff. Fairness review, applicant experience, and safeguards must be considered alongside prediction. Without that evidence and process explanation, the sensible verdict is not that personality measures can never inform hiring; it is that the report’s coaching usefulness alone does not establish that this report can do so.

Sources: Using Theory to Evaluate Personality and Job Performance Relations: A Socioanalytic Perspective; Personality Tests; Principles for the Validation and Use of Personnel Selection Procedures

What should a reader do with this particular report?

Use the Work Pattern Report as a low-stakes prompt to examine your decision and collaboration tendencies. Its 100 items describe ten continuums; the result provides no norms, cutoffs, personality type, or selection score, and is not validated for hiring or job matching. Treat a statement as a starting point you can qualify, not a verdict about your ability or future work.

Choose one relevant statement. Write down a recent example that fits and a counterexample that does not. Note the situation and constraints, then name the work question raised. For instance, what information helps you decide when a deadline is close? Decide what observation or conversation could help answer it. The report alone cannot establish why a behavior occurred or predict what you will do elsewhere. Explore it privately at [/assessment](/assessment), or browse assessment-literacy material at [/topics](/topics).

If an employer proposes an assessment, ask which decision the result affects, which instrument version and score are used, and what evidence connects them to job criteria and applicants. Ask how uncertainty and fairness are considered, and who can access the result. If unclear, do not treat it as a hiring verdict. You might ask: “What will this score change, and why is it relevant to this job?” The answer should explain its role and evidence, rather than rely on a polished description.

Questions readers ask