What Job Analysis Does Before Personality Tests in Hiring

What job analysis establishes—and what it leaves open

Job analysis identifies important work and the competencies linked to it, giving an assessment a job-specific target. It does not show, by itself, that a personality questionnaire measures that target well or that its scores justify a hiring decision. OPM’s “What is a job analysis?” guidance defines it as a systematic process for documenting a job’s content, context, and requirements, and linking tasks to competencies. OPM’s Assessment and Selection guidance puts job analysis at the start of assessment planning. It is a foundation for choosing what to assess, not a certificate for a particular test.

Keep three links distinct. First is the work requirement: what important task or behavior does the role involve? Second is construct relevance: why might a defined personality tendency relate to that work? A construct is the quality a scale is intended to measure. Third is score-use evidence: does this instrument and interpretation support the proposed decision for a comparable job and population? Job analysis chiefly establishes the first link and can inform the second. It cannot alone establish the third.

When a report is called “based on job analysis,” ask what that means. Role requirements may have informed the choice of scale; the phrase does not show that scores support ranking or excluding applicants. OPM’s pages describe U.S. federal practice, not every jurisdiction’s rules. Ask which observable, important behavior the scale is meant to assess, and what separate evidence supports using its scores here.

Sources: What is a job analysis?; Assessment and Selection

What should a job analysis actually identify?

A useful job analysis describes important work: tasks, observable behaviors or work products, the conditions in which they occur, and their relative importance and difficulty. It should not begin and end with appealing trait labels. The U.S. Office of Personnel Management (OPM) explains that job analysis connects duties with competencies and that people with direct, current job knowledge can rate their importance. The Equal Employment Opportunity Commission’s (EEOC) Uniform Guidelines questions call for important observable behaviors, their associated tasks, use, importance, and difficulty. The description should be specific enough that another person can recognize the work. “Strong communicator” is too broad: it might mean writing, listening, presenting, or explaining a decision. A better analysis names the task, behavior, and context. For example, an illustrative customer-support role might require explaining a policy, checking the customer understands the options, and documenting an unresolved case for a colleague. The task is explaining and recording; behaviors include translating a rule into understandable options, confirming comprehension, and creating a usable handoff. A case note may be the work product, recording the issue, policy, options, and next action. Context matters: is the exchange written or spoken, can the employee consult guidance, and is it routine or tense? These conditions affect the behavior required and what an assessment could sample. OPM’s Assessment and Selection guidance says job analysis should include tasks, responsibilities, competencies, resources, and the performance context. Importance also needs a reasoned account. A frequent task may not be the most consequential; an infrequent one may carry substantial responsibility. EEOC guidance calls for important behaviors and their relative importance and difficulty; it does not require listing every task. A requirement may justify checking whether someone can perform a task, while analysis alone may not justify ranking applicants by ever-higher performance. The decision must fit evidence about what better performance means. Who contributes matters because written job descriptions can lag behind practice. OPM describes subject-matter experts as people with direct, up-to-date experience who know the job’s tasks; current employees and supervisors may have that knowledge. Their input can identify actual work, constraints, and critical incidents, or examples of effective or ineffective behavior. Experts should describe tasks concretely, connect them to competencies, and rate importance. The goal is to document work-based reasoning, not to make a trait official by consensus. Recency matters too. Changed responsibilities, technology, or work conditions can leave an old task list pointing at work that is no longer central. OPM names a valid, current job analysis as the first step in an effective assessment strategy. “Current” means reflecting the role applicants will enter, not merely a recently dated document. A team can check whether tasks and tools match current operations. The analysis should be specific and up to date enough to make the link between requirements and selection procedures clear. For a personality assessment, this description sets a boundary. If analysis identifies explaining policies and preserving accurate handoffs as important, the next question is whether a particular scale has a plausible, clearly defined relationship to those behaviors. A team cannot skip that question by adding “warmth,” “resilience,” or “professionalism” to a competency list. Naming a competency does not prove a questionnaire measures it. Job analysis identifies which work deserves attention and why; it does not turn every desirable quality into a necessary qualification. Ask: Which task matters? What behavior or product demonstrates it? If the answer is only “we want people who communicate well,” the target remains vague. Concrete answers give the team a better next question: whether the proposed measure represents or predicts that work.

Sources: Assessment and Selection; Questions and Answers to Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures

When does a personality construct earn consideration?

A personality construct earns consideration when the hiring team can connect a clearly defined tendency to important behavior in this particular job. That connection is a reason to investigate a scale, not proof that its score should affect hiring. The distinction matters because a familiar label such as “dependable” or “assertive” can sound self-explanatory while covering different actions, situations, and standards of effective performance. The Canadian Psychological Association’s “Psychology Works” Fact Sheet: Pre-employment Personality Assessment in Personnel Selection describes this relevance step as personality-oriented work analysis. It recommends that people who understand the role judge how relevant defined traits are to performance, and stresses that experts need a sound grasp of both the trait and how it relates to work behavior. Experts might include experienced employees or supervisors, but titles alone do not make judgments informative. They need shared definitions of the trait and effective performance. Otherwise, one expert may interpret “initiative” as acting without prompting, while another means noticing a problem and escalating it through the right channel. A rating gathered before resolving that difference can combine unlike judgments under one word. The same fact sheet cautions against relying on trait names alone: definitions should be considered carefully, and job performance itself should be defined so experts are answering a common question. The proposed link runs from a tendency, through behavior in a setting, to a work outcome. A scale name skips those middle steps. “Sociability,” for example, does not specify whether a role requires frequent unsolicited conversation, calm explanation to a frustrated customer, or accurate written updates with little live contact. The relevant question is not whether a trait sounds desirable in general, but whether its defined meaning plausibly relates to an important behavior under the conditions the job actually presents. Consider an illustrative customer-support role. A team might initially request “resilience” because agents encounter difficult interactions. That label alone leaves open what the job requires: staying composed while clarifying a request, continuing to follow the service procedure, recovering attention after an upsetting exchange, or escalating a case when authority runs out. These behaviors may call for different forms of evidence and may be shaped by training, workload, supervisor support, and customer circumstances. Job experts would first specify which behaviors matter, how often or when they occur, and what an effective response looks like. They could then discuss whether a carefully defined personality construct has a plausible relation to those behaviors. The exercise does not establish that a particular scale captures the construct, that a high or low score has a fixed meaning, or that an applicant will behave a certain way. The Office of Personnel Management’s “Assessment and Selection” guidance places job analysis at the start of assessment planning and links documented tasks to competencies and then to assessment content. Applied here, that sequence helps expose a weak rationale: “we want resilient people” is several steps away from a defined work requirement. A more useful account names the interaction, the behavior that supports effective handling, and the reason the behavior matters to the role. Even then, relevance is a screening question for the proposed construct, not a final endorsement of a report. If the hiring team cannot explain the behavior link in plain terms, the trait may be familiar or appealing rather than demonstrably role-related. If it can explain the link, the next question remains whether evidence supports the specific measure and hiring use.

Sources: Psychology Works Fact Sheet: Pre-employment Personality Assessment in Personnel Selection; Assessment and Selection

Why a trait label is not a content-valid test

A personality trait is an underlying construct, not a sample of observable job behavior. Under the US Uniform Guidelines on Employee Selection Procedures, job analysis cannot make a questionnaire about an intangible trait content-valid simply by showing that the trait sounds relevant to the job. The EEOC’s *Questions and Answers to Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures* explains why the first claim does not establish the second. Content validity asks whether the content of a selection procedure represents important aspects of work. In this approach, the employer identifies important tasks and behaviors, then shows that the procedure samples or closely approximates them. By contrast, a questionnaire asking someone to rate how dependable they are does not sample dependability as it appears on the job. Dependability is an inferred characteristic; the questionnaire records answers, not the applicant’s future attendance or follow-through. The EEOC guidance makes this contrast directly. It says a measure of the construct “dependability” should not be supported through content validity because the construct is intangible and not directly observable. It distinguishes that from inquiries into promptness and regularity of attendance in a prior work record, which are observable behaviors and may be supported through content validity. Even then, relevance depends on what the role actually requires and how that evidence is used. That finding defines relevance; it does not validate the questionnaire or its score. This boundary prevents a common reasoning shortcut. A job analysis might identify reliable follow-through as important, but that finding does not turn a self-report scale into a sample of follow-through. The Uniform Guidelines’ content-sampling logic calls for close correspondence between procedure content and observable work behavior or products, reducing the inferential leap from test performance to job performance. That conclusion is limited to the content-validity rationale. It does not mean that personality measures can never have evidence relevant to selection. The EEOC’s *Employment Tests and Selection Procedures* describes validation as one way to demonstrate job-relatedness under the US framework, and the Uniform Guidelines distinguish content evidence from other validity strategies, including evidence about relationships between scores and job performance. Personality scores could be examined for relationships with relevant work criteria, but that requires evidence about the instrument, interpretation, population, job, and decision. A general claim that a trait is useful, or that a vendor has studied it somewhere, does not establish that chain for a particular hiring use. So when a provider says a personality test is “based on job analysis,” ask what that phrase means. Did the analysis identify observable work behaviors and products, or only name desired qualities? Is the test actually sampling those behaviors, or asking about an underlying tendency? If it asks about a tendency, what separate evidence connects the resulting scores to the relevant work and supports the exact decision being made? Those questions keep job relevance in its proper role: it defines a target for assessment, while the method and evidence determine whether a particular score can responsibly support selection. This describes US guidance; requirements vary by jurisdiction.

Sources: Questions and Answers to Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures; Employment Tests and Selection Procedures

What evidence must follow the job analysis?

Once a job analysis identifies a relevant behavior, the next question is whether evidence supports using this particular questionnaire score to make the proposed hiring decision. Three links need separate support: the instrument must measure the intended construct consistently enough; the interpretation placed on its score must relate to a job-relevant criterion; and that relationship must support the decision for the population and setting at hand. A job analysis helps define the target, a role-specific link OPM’s Assessment Strategy also emphasizes. It cannot supply the missing evidence for those links. Reliability and validity answer different questions. Reliability concerns the consistency or precision of scores under specified conditions. A score can be measured consistently and still fail to support the meaning or use assigned to it. Validity concerns the evidence for an interpretation and use, rather than a permanent certificate attached to a test. A vendor’s research summary must specify the instrument, samples, jobs, criteria, and decisions studied. One useful boundary appears in the 2023 meta-analysis of conscientiousness and job performance. Across 102 studies, it reported an overall correlation of .17, a modest association at the group level. The review also found that only about 12% of the studies used real applicants in predictive designs, and called for more multivariate research under realistic selection conditions. They do not show that any personality report predicts an individual applicant’s success, that a particular cutoff is justified, or that the association transfers to every role. The results concern one trait and set of criteria; correlations do not establish certainty about an individual. Study design also affects what a result can establish. In a predictive design, scores collected before an outcome are examined in relation to later job performance. A concurrent design relates scores and performance measured around the same period, often among current employees. It can provide relevant evidence, but current employees are not automatically interchangeable with applicants: people who were hired and remained may differ from those screened out or who left, and the work context may differ. Ask who was studied, how performance was measured, whether jobs match, and what score use the analysis supports. Research from related roles or populations may inform a judgment when the work requirements and criteria are genuinely comparable. But similarity should be demonstrated: a shared job title alone does not establish similar tasks, context, applicant pool, or consequences of error. An association for a broad trait does not automatically validate a particular scale, report band, or exclusion threshold. The chain must reach the actual score and use. Before treating the report as selection evidence, request technical documentation that names the instrument and version, the sample and job context, the criterion and study design, the reported results, and the limitations. Ask which interpretation and hiring decision the evidence supports. If the material establishes only that a trait is plausible for the role, the job analysis has done useful work, but the score’s hiring use remains unestablished. A useful review therefore follows the chain rather than collecting impressive-sounding coefficients. It checks whether the criterion represents the work the analysis identified, whether scoring and administration match the proposed process, and whether uncertainty could change how much weight the score deserves. If the documentation cannot answer these questions, the gap is evidence about the proposed use, not proof that the applicant lacks the desired tendency.

Sources: Conscientiousness and job performance: a meta-analysis; Assessment Strategy; Principles for the Validation and Use of Personnel Selection Procedures

Which method answers the job question most directly?

Choose the method that samples or predicts the analyzed requirement most directly and has evidence for the intended decision. If the requirement is to explain a policy accurately while recording an unresolved customer case, a work sample can ask an applicant to perform a comparable task. A structured interview can ask each applicant the same job-related questions and score answers against common criteria. A personality questionnaire asks applicants to describe themselves, then invites an inference about tendencies that may matter in the role. These methods provide different information; the job analysis should guide the choice.

The Office of Personnel Management’s Assessment Decision Guide describes work samples as exercises that mimic job tasks and says their content should match work identified through job analysis. The inferential path is relatively short: the applicant produces relevant work, and assessors judge it against defined criteria. In a customer-support illustration, the exercise might ask an applicant to read a policy, draft a clear response, and note what information remains unresolved. This shows performance on that exercise under its conditions, not how the person will handle every future customer or workload. Directness reduces one kind of inference, but instructions, scoring, and evidence for the decision still matter.

A structured interview samples a different thing. Consistent prompts and scoring can elicit comparable examples or ask applicants to reason through the same customer case. OPM’s guide recommends standardizing assessment so the same information is collected and used consistently. An interview can show how a person explains a decision or reports past actions, but an account is not the same as observing the task. Recall, the question, and raters’ interpretations can affect answers. Structure improves comparability; it does not make an interview a complete record of future behavior.

A personality scale concerns a less visible pattern. It may be considered when analysis identifies a defined tendency relevant to recurring work, but the response itself is not a demonstration of customer service. The inference runs from answers to an interpreted score, then to a likely tendency and possible job behavior. OPM distinguishes evidence needs: a task-mimicking sample may need evidence that its content matches the job, while a personality test intended to forecast later performance may need evidence that scores relate to subsequent performance. A scale might add information a brief task cannot capture, but that possibility does not show it improves hiring decisions.

The OPM guide’s comparison table reports estimates from a 1998 synthesis: work samples are listed at .54, structured interviews at .51, and conscientiousness tests at .31. These historical summary estimates are not a head-to-head study of this support role or evidence about a particular current questionnaire. They cannot establish a universal ranking or prove that adding a personality scale helps here. Compare methods against the same behavior: the sample shows a response to a controlled case, the interview elicits an account or explanation, and the personality report supports an inference about tendency. Ask what distinct information the scale adds and whether evidence supports that score’s proposed use. If added value is unshown, it may have no necessary selection role; relevance alone does not establish one.

Sources: Assessment Decision Guide; Assessment and Selection

Do not confuse fit, prediction, and screening

A report describing preference or organizational fit is not automatically evidence that its score predicts job performance or should screen applicants out. Fit describes a possible match between a person’s stated preferences and workplace features. Prediction asks whether a score relates to a defined work outcome. Screening uses the score to decide who advances. Evidence for one claim does not establish the others. The U.S. Office of Personnel Management’s “Job-Fit Measures” page describes tools comparing applicant information about personality, interests, values, or culture preferences with job or organization characteristics. Applicants may receive feedback and choose to withdraw if the result suggests a poor match. That can support self-selection: a person considers whether the described environment appeals to them. It does not show that those who remain perform better or those who withdraw perform poorly. Preference is not task performance. Prediction requires a further link. The team must define the performance outcome and show that the score provides useful evidence about it in an appropriate setting. “Would fit our culture” is too broad to substitute for a defined criterion. Preference alignment alone does not establish a link to service quality or another result. OPM notes that research and methodology for using job-fit measures as screen-out tools remain in their infancy. This cautions against that use; it does not show every fit measure is useless. Screening changes the stakes because the score affects access to the next stage. A report used for reflection or self-selection can be useful without ranking candidates. Once an employer uses it to exclude, the employer needs support for that selection use, not only a plausible account of organizational similarity. OPM’s “Designing an Assessment Strategy” places choices within a job-based strategy. Together, these pages suggest job analysis can identify relevant work and a fit measure can describe preferences, but evidence must connect the particular score to the hiring purpose. Consider a hypothetical customer-support role where analysis identifies explaining policy clearly and documenting unresolved cases as important. A questionnaire indicating a preference for predictable routines might prompt discussion about the role’s pace. It cannot establish that the applicant will document cases poorly, dislike every change, or underperform. Nor does it show that applicants with different responses will do better. If the team wants to assess these behaviors, it should ask what evidence samples them. The report may be a discussion aid; that does not make it a task demonstration or supported exclusion rule. Ask what action follows each result. If applicants decide whether the described environment suits them, the measure serves self-selection. If the team expects the score to indicate a work outcome, it is making a predictive claim and should identify the outcome and supporting evidence. If a threshold leads to rejection, the measure is a screen and needs evidence for that consequential use. Calling a report a conversation aid does not change its purpose when a threshold excludes applicants. Purpose is defined by how the decision-maker uses the score.

Sources: Job-Fit Measures; Assessment Strategy

Job relevance does not finish the fairness review

Even a role-relevant procedure needs a separate review of its effects, accessibility, and legal fit. In the United States, the Equal Employment Opportunity Commission (EEOC) explains that a neutral selection procedure can raise a disparate-impact concern if it disproportionately excludes people in a protected group. A documented link to work matters, but it does not settle how a test operates in practice. The EEOC’s *Employment Tests and Selection Procedures* guidance treats job-relatedness, validation, and a potentially less discriminatory alternative as distinct considerations.

After job analysis, a hiring team should define the work requirement and explain why the procedure measures or predicts it. It should also examine how the procedure is administered and what happens to applicants across the process. A personality questionnaire may use neutral wording, yet its use still belongs in this review. The question is not whether a trait sounds desirable or whether the test was developed from a job description. It is whether the procedure, as used for this job and decision, has support and produces effects that need attention.

The EEOC describes disparate impact under US federal law and notes that determining whether a procedure has such an effect ordinarily calls for statistical analysis. If disproportionate exclusion appears, the guidance raises further questions: is the procedure job-related and consistent with business necessity, and could an equally effective alternative have less adverse impact? This is a way to examine a particular selection practice, not a conclusion that every difference in outcomes proves unlawful discrimination. Job analysis supplies evidence about the work; it does not answer what effects the procedure has.

Accessibility is part of responsible use as well. The EEOC guidance says tests should reflect the factor they claim to measure rather than an applicant’s impairment, and discusses reasonable accommodation under the Americans with Disabilities Act. Format, instructions, timing, and administration may therefore matter alongside a personality scale’s content. This does not mean every questionnaire raises an accessibility problem; it shows why administration belongs in the review.

The Uniform Guidelines interpretive questions and answers add a useful boundary: job analysis should describe important work behaviors and their relative importance when supporting a content-based argument. That account of relevance is not a fairness audit or legal clearance. Ask whether the employer has examined both the link to actual work and the procedure’s effects, including accessibility and possible alternatives. These EEOC materials concern the United States; requirements elsewhere may differ, and the agency identifies its technical assistance as explanatory rather than binding law. Job analysis is necessary groundwork, not a complete approval stamp.

Sources: Employment Tests and Selection Procedures; Questions and Answers to Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures

What should you ask before acting on the report?

Before treating a personality report as hiring evidence, ask the team to complete three links in plain language. First, what important work behavior or product does the job analysis identify? The Office of Personnel Management’s “Assessment and Selection” guidance describes documenting the path from tasks to competencies and assessment content. That record should point to work the role requires, rather than a trait label. Second, how does the named scale relate to that behavior? Ask what it is intended to measure and why that tendency matters in this role. A plausible connection is a reason to investigate, not proof that a questionnaire score measures the tendency accurately or predicts performance. The EEOC’s “Employment Tests and Selection Procedures” distinguishes job-relatedness from the fact that an employer has selected a procedure. Its guidance is US-specific, so legal requirements elsewhere need local review. Third, what evidence supports this score interpretation for this decision, applicant population, and comparable work? Ask for the technical documentation, its sample and outcome, and its limits. Compare what the report adds to a structured interview or work sample addressing the same requirement. If a link is missing, the report may prompt reflection, but it has not earned a role in excluding or ranking applicants. Ask the hiring team: “Could you show me the job behavior, the scale rationale, and the evidence for using this score in selection?” For more help reading assessment claims, consult the publication’s topics library.

Sources: Assessment and Selection; Employment Tests and Selection Procedures