Under the 2014 Standards for Educational and Psychological Testing, a score is not automatically portable to a new purpose. The user must justify an interpretation that has not been validated and collect additional evidence if necessary. A new study is not required for every change: the relevance and quality of existing evidence, the similarity of the uses, and the proposed consequences all matter.
What do the Standards cover—and what do they not decide?
The 2014 Standards for Educational and Psychological Testing are professional criteria for sound testing practice. Prepared by a joint committee of the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education, they describe how evidence should support interpretations and uses of test scores. The official open-access page identifies the edition and links to its full text; that is the edition considered here. In this framework, validity means the evidence and theory supporting a particular interpretation of scores for a stated use. It does not attach universally to a questionnaire or number. A score may describe a response pattern in one setting, while another use asks it to support a different conclusion. The Standards therefore direct attention to the inference: what is being concluded from the score, about whom, and for what purpose? Readers can assess the reasoning behind a proposed interpretation instead of treating a familiar test name as proof that every use is sound. The Standards are professional guidance, not a law that enforces itself. They do not settle every policy or legal question that can arise when tests are used. A reader can ask whether evidence fits the interpretation and intended use, while recognizing that separate professional rules or laws may also matter. This keeps the scope precise: the 2014 text offers a framework for evaluating score interpretations, not universal permission or a decision about every consequence of using a personality assessment.
Sources: Standards for Educational and Psychological Testing (2014 edition); Open Access Files
What is actually being reused: the score or its meaning?
A recorded personality score can stay exactly the same while the claim made from it changes. Reusing a score for a new purpose therefore means more than carrying a number into another setting: it means asking readers to accept a new interpretation, inference, or decision based on that number. Under the 2014 Standards for Educational and Psychological Testing, that interpretation needs support for the use being proposed. The first question is what the score is now being asked to mean. It helps to separate three steps. The score is the result produced by a scoring procedure. An interpretation gives that result meaning, such as describing a response pattern as a tendency toward careful planning. A use is what someone does with the interpretation: reflect on it, discuss it in coaching, or make a decision that affects another person. These steps are connected, but they are not interchangeable. The same value can be carried from one context to another without carrying the evidence that would justify a new conclusion. Consider an unnamed, illustrative situation. A person completes a self-report questionnaire and receives a description suggesting that they prefer time to think before making decisions. In private reflection, they might treat the description as a prompt: Does it fit situations they can recall? When does it fit less well? They can compare the interpretation with observations and set it aside if it does not help. This wording may help the person notice a pattern in their responses. Now imagine someone proposes using that same score to rank applicants for a job. The recorded answer and scoring rule might be unchanged, but the interpretation has shifted. The score is now being treated as evidence about a person in a target population and context, and it is being used to support a consequential selection decision. That step requires a different argument: what does the score indicate in this setting, why is that interpretation relevant to the decision, and what evidence supports the link? This illustration does not imply that the questionnaire predicts job performance. It shows why keeping the instrument and number fixed does not keep the inference fixed. Standard 1.0 in the 2014 Standards states that each intended score interpretation for a specified use should be clearly articulated and supported by appropriate validity evidence. Validity means evidence and theory supporting a particular interpretation for a particular use. The standard directs attention away from a broad label such as “a valid personality test” and toward the claim actually being made. No test permits interpretations valid for every purpose or situation. Evidence for one interpretation may leave another unsupported; the test name alone cannot settle that question. A familiar instrument, consistent scoring, or agreement from the person reading the report may make a result feel dependable. They do not establish that a new interpretation is warranted. The existing article “How a Personality Assessment Report Should Explain Its Limitations” makes a related distinction: reliability concerns consistency under specified conditions, while validity concerns support for the interpretation and use. A score can be consistent without justifying the new conclusion drawn from it. Likewise, finding the description personally recognizable is useful information for reflection, but recognition alone does not show that the score supports a different decision claim. This distinction keeps the audit concrete. Ask what the score records, what words or inference are being attached to it, and what action follows. If the purpose changes from private reflection to a decision about someone else, the user should name the new claim rather than rely on the unchanged number as proof. Ask whether evidence and reasoning support the score’s new meaning in the population, setting, and use at hand.
Sources: Standards for Educational and Psychological Testing (2014 edition); How a Personality Assessment Report Should Explain Its Limitations
What does Standard 1.4 require when the interpretation changes?
Standard 1.4 gives a practical answer about transfer: if a score is interpreted for a use in a way that has not been validated, the user must justify that new interpretation, state a rationale, and collect new evidence if necessary. The key phrase is “if necessary.” The 2014 *Standards for Educational and Psychological Testing* do not prescribe a fresh validation study whenever a report moves to another setting. They require a reasoned judgment about whether existing evidence supports the new claim and, if not, what further evidence is needed. That distinction matters because “same score” can conceal a different inference. A personality assessment may produce an unchanged number when a person reads it privately and when an organization considers it for a decision. Yet the attached claim may shift: from “this description gives me a prompt for reflection” to “this result supports an action about this person.” Standard 1.4 concerns the interpretation for a given use, not the persistence of the score. The user should identify what the new interpretation says and what action follows before claiming prior evidence transfers. The standard neither treats every new purpose as automatically acceptable nor bans every extension beyond the developer’s recommendations. It places responsibility on the user proposing or making the new interpretation. The *Standards for Educational and Psychological Testing* says professional judgment is needed to assess how far existing validity evidence applies to the new situation or group. A user applying a score locally still has to judge whether the evidence fits that purpose. Saying a test is “validated” without naming the interpretation and use answers too little. The comment to Standard 1.4 gives two considerations that shape additional work: experience with similar prior uses or interpretations, and the amount, quality, and relevance of existing data. Similarity can make prior evidence more informative, but only if the feature that matters to the new claim is genuinely comparable. A change in audience, conditions, or decision may leave some evidence useful while weakening other parts. The standard calls for examining that fit instead of treating “similar” as a label that settles the question. A defensible transfer argument should make its reasoning visible. It can identify the earlier and proposed uses, say which evidence bears on the same interpretation, and explain where contexts differ. It should acknowledge evidence that cuts against the proposed interpretation, rather than selecting only supportive findings. The Standards’ broader validity guidance says users bear ultimate responsibility for evaluating evidence quality and relevance to the local situation. Repeating a provider’s general claim, or pointing to a consistent score, does not by itself establish that a new interpretation is justified. The *International Test Commission Guidelines on Test Use* reinforce the need to inspect technical documentation for validity evidence relevant to the required use and populations. They advise against using a test where appropriate evidence for the purpose is unavailable and against judging it solely by face value or testimonials. These guidelines do not replace Standard 1.4 or set a universal study design. Ask whether the user can point to evidence connected to this purpose and these people, and explain its limits. For a reader evaluating transfer, ask: What exactly is the new claim? Which prior evidence supports it, and for which population and conditions? What differs, and could that difference change the interpretation? What contrary findings or gaps remain? If the rationale cannot answer those questions, keep the conclusion provisional. Where a gap matters, the user should name the additional evidence needed before relying on the new meaning. Standard 1.4 allows relevant existing evidence to carry weight, but makes that weight something to demonstrate, not assume.
Sources: Standards for Educational and Psychological Testing (2014 edition); International Guidelines on Test Use
What changes when the use has little or no evidence?
Standard 9.4 addresses a narrower, more difficult situation than the general transfer rule in Standard 1.4. When a test is being used for a purpose for which little or no validity evidence is available, the user is responsible for documenting why that test was selected and obtaining evidence about the reliability or precision of its scores and the validity of the interpretation for that purpose. The distinction between 1.4 and 9.4 is about how the evidence problem is framed. Standard 1.4 covers a score interpretation for a use that has not been validated. It asks the user to justify the new interpretation, give a rationale, and collect new evidence if necessary. Standard 9.4 speaks directly to a purpose with little or no validity evidence. It makes the rationale and evidence responsibilities explicit in that circumstance. Together they require neither a fresh study for every change nor acceptance of an unsupported interpretation. The question is whether existing evidence is relevant and what more is needed. (Standards for Educational and Psychological Testing, 2014 edition, Standards 1.4 and 9.4.) The rationale should identify the intended use clearly enough to be examined. “This inventory is useful” does not explain why its scores should support a particular new conclusion. The Standards’ preceding discussion of user responsibilities also says that users must evaluate the quality and local relevance of validity evidence, including findings that do not fit the intended interpretation. A rationale must connect evidence to the actual claim, rather than simply cite a familiar scale. Reliability or precision evidence addresses a separate part of that account. Reliability concerns the consistency of scores under specified conditions; precision describes the uncertainty around a score or measurement. These details help show whether a score is stable enough, but stability does not establish meaning. A personality score could be measured consistently while still lacking evidence that it supports a new inference. This is why Standard 9.4 asks for evidence relevant to both score reliability or precision and interpretation validity. Reporting only a reliability coefficient leaves the central question unanswered: why should this score mean what the user says it means for this purpose? The International Test Commission’s International Guidelines on Test Use reinforce the practical caution: they advise using tests only for purposes where relevant and appropriate validity evidence is available, and avoiding judgments based solely on face value or testimonials. They set no numerical threshold; they support asking whether evidence fits the stated purpose rather than whether a report sounds plausible. When little evidence exists, the report or user should make that gap visible. A tentative hypothesis may still prompt questions or further inquiry, but it should be labeled tentative, as the 2014 Standards’ commentary on Standard 9.4 says, and interested parties should be told about the scores’ potential limitations. The practical conclusion is modest: document the reason for the new use, show what reliability or precision and validity evidence supports it, identify the population and conditions to which that evidence applies, and state what remains unknown. The more consequential the interpretation, the less useful a vague assurance becomes; the reader needs to see the reasoning and its limits. Until that case is made, a confident label cannot stand in for evidence, and a reader should not treat the new interpretation as established.
Sources: Standards for Educational and Psychological Testing (2014 edition); International Guidelines on Test Use
Which parts of the evidence must fit the new context?
The evidence supporting an interpretation must fit the claim now being made. The 2014 Standards for Educational and Psychological Testing frame validity around a proposed interpretation and use, not a test name in isolation. They ask users to state what a score means, for which population, and for what purpose. Transfer is therefore a comparison: identify what remains alike between earlier and new uses, then examine whether each difference weakens a premise behind the interpretation. Start with the construct, the attribute or response pattern the assessment is meant to represent. Does the new report make the same claim, or has an old description been stretched into a claim about a different capacity or outcome? Then compare the people whose scores are being interpreted. Evidence from one group may not automatically describe another; ask whether differences between the studied and intended populations matter to score meaning. The Standards’ discussion of samples and settings directs attention to how validation evidence was obtained and whether those conditions match the proposed use. A mismatch is a question to investigate, not proof that the score fails. Setting and administration matter too. Did respondents encounter the same instructions, language, item wording, privacy, time demands, and response conditions represented in the existing evidence? Changed conditions may alter how people understand or answer items. A translated or substantially adapted version, for example, raises questions about whether wording still carries the same meaning. This is a methodological question, not a claim that every translation changes scores. The Standards’ chapters on fairness and test administration treat design, administration, and scoring as relevant to valid interpretation, including whether barriers unrelated to the intended construct interfere. The International Test Commission’s Guidelines on Test Use likewise emphasize evidence users can inspect and apply responsibly. Neither source supplies a universal list of changes that automatically invalidate a result. Scoring and decision rules need a separate check. The same responses can lead to different interpretation if scoring changes, a new cutoff is introduced, or a descriptive scale sorts people into categories. A report describing tendencies for reflection makes a different claim from a procedure using a threshold to decide who advances. Record what is calculated, how responses are handled where relevant, and what action follows. This does not mean every changed display needs a separate validation study; the evidence must support the interpretation and decision attached to it. Finally, compare consequences. A private prompt that helps someone notice patterns in planning or collaboration can be treated as tentative and checked against experience. A score used to allocate opportunity makes a stronger practical claim because people may bear consequences if the inference is wrong. Consequence alone does not prove an interpretation invalid, and low stakes do not make unsupported claims true. It does change what a responsible user should scrutinize and how cautious the decision should be. These comparisons work together. If construct, population, setting, administration, scoring, and decision remain close to those represented in relevant evidence, a reasoned transfer may be defensible. If several change, or one affects the basis of the interpretation, the user should explain why the earlier evidence still applies and identify any gap needing support. This decision aid derives from the Standards’ use-specific approach; it is not a mechanical checklist they prescribe. Ask for evidence representing the people and conditions at issue, plus a clear account of what it cannot establish. “Same questionnaire” is not enough; “different context” alone is not a verdict.
Sources: Standards for Educational and Psychological Testing (2014 edition); International Guidelines on Test Use
Why does a workplace decision raise a different question?
Using the same personality score for private self-reflection and employee selection changes both the inference and the consequences. In reflection, a person might treat a description of their responses as a tentative prompt, then compare it with specific situations they remember. In selection, an employer may use a score to rank applicants or exclude someone, which makes a claim about how the score relates to a particular job. The 2014 Standards for Educational and Psychological Testing require evidence to support the interpretation for its intended use; evidence that supports one reading does not automatically establish the other. That distinction matters even if the questionnaire, scoring key, and number remain unchanged. The reflective question might be, “Does this description help me notice how I approach disagreement?” The selection question is different: “Does this score provide a sound basis for deciding who should advance for this job?” The second claim invokes work requirements, a defined decision, and people who may bear its consequences. The Standards’ workplace chapter treats employment testing as a use that requires attention to the job and the inference being drawn. It does not say that a personality score predicts performance merely because the score is consistent or useful as a conversation prompt. The Principles for the Validation and Use of Personnel Selection Procedures, Fifth Edition, supplies more specific professional guidance for this setting. It aligns its guidance with the 2014 Standards and emphasizes work analysis: understanding relevant tasks, behaviors, context, and worker requirements. Its discussion of generalizing validity evidence to another selection situation says detailed analysis of the work is needed for that strategy. That is a narrower and more demanding argument than pointing to a test’s general reputation or to evidence gathered for another purpose. The document does not validate any unnamed personality questionnaire; the link between a measure, a job-relevant interpretation, and the proposed decision still has to be supported. In the United States, employment use also sits within a legal framework. The EEOC’s Employment Tests and Selection Procedures guidance lists personality tests among procedures employers may use to screen applicants or employees. It explains that neutral selection procedures can raise Title VII disparate-impact concerns when they disproportionately exclude protected groups and are not job-related and consistent with business necessity. The guidance also discusses disability-related questions and accommodations. These are U.S. federal-law considerations, not a complete account of every jurisdiction or situation, and the Standards themselves are professional guidance rather than law. A vendor’s materials do not, by themselves, settle an employer’s responsibilities. So the practical comparison is not “informal use is always harmless, formal use is always invalid.” A self-reflection exercise can still be misleading if its limits are hidden, while an employment procedure is not automatically indefensible simply because it uses a personality measure. The question is whether the evidence and reasoning fit the actual use, population, setting, and decision. When a score can affect access to work, ask what job-related inference it is meant to support, what evidence supports that inference for the relevant work, and who reviews its fairness and limitations. Do not infer selection validity from a report’s reflective value, a familiar test name, or score consistency alone.
Sources: Standards for Educational and Psychological Testing (2014 edition); Principles for the Validation and Use of Personnel Selection Procedures, Fifth Edition; Employment Tests and Selection Procedures
What should a reader ask before accepting the transfer?
Before accepting a score’s transfer to a new purpose, ask the person using it to finish one sentence: “This score is being treated as evidence that ___ about ___, in order to ___.” The blanks matter. A statement about a response pattern used to guide private reflection makes a different claim from one used to sort people for an opportunity. The 2014 Standards for Educational and Psychological Testing tie validity to the interpretation and use being proposed, rather than to a test name in isolation. So “the assessment is validated” is incomplete unless the speaker identifies which interpretation, for whom, and for what decision. Next, compare the original and proposed uses in plain terms. Who took the assessment? Under what instructions and conditions? What did the earlier report say the score represented, and what is now being inferred from it? Is the score being used to start a conversation, guide a development activity, or influence a consequential decision? A changed purpose does not by itself prove that the evidence fails to transfer. It does make the reasoning visible: the user should explain why evidence from the earlier context bears on this particular new claim. The Standards’ Standard 1.4 makes the amount and type of additional evidence conditional on such matters as the similarity of the uses and the relevance and quality of the existing evidence; it does not set a universal study count. Then ask what evidence supports the inference and what evidence might limit it. A useful answer points to material that can be inspected, describes the people and conditions it covers, and explains how it bears on the proposed meaning. The International Test Commission’s *ITC Guidelines on Test Use* say evidence supporting score inferences should be accessible to users and open to independent scrutiny. A reader can ask whether the provider shows the basis for the claim or only repeats “validated.” If evidence comes from a different population or setting, ask what makes that difference unimportant for this interpretation. Finally, ask what remains uncertain, who is responsible for addressing the gap, and what happens while it is unresolved. The Standards place responsibility on the user proposing an unvalidated interpretation to justify it and obtain further evidence if necessary. More data do not guarantee a sound use. It means the user should distinguish established support from a plausible but untested extension, state the limits, and avoid presenting the latter as settled fact. For a consequential decision, weak support is a reason to pause or reconsider that use, not to let confident wording stand in for evidence. This sequence is a practical reading aid derived from the Standards and ITC guidance, not a checklist quoted from either document: state the claim; compare the old and new contexts; inspect relevant and contrary evidence; identify the remaining gap and its owner; then decide whether the use can proceed at the proposed level of consequence. A person using a tentative personality description for self-reflection can check it against specific situations. The description remains a prompt about reported tendencies, not a diagnosis or fixed verdict. In either setting, the reader should be able to trace the new interpretation to evidence and see where that trail ends.
Sources: Standards for Educational and Psychological Testing (2014 edition); International Guidelines on Test Use
What is the defensible next step for a new purpose?
The defensible next step is to name the new claim before deciding whether the old score can support it. Is the score being used to prompt private reflection, guide coaching, or influence a consequential decision? Then ask the person proposing the use to identify the population, setting, administration, scoring, and decision rule covered by the evidence. Compare those conditions with the proposed use, and ask what evidence supports the interpretation and what gap remains. The 2014 Standards for Educational and Psychological Testing place responsibility on the user to justify an interpretation that has not been validated, with additional evidence when necessary. They do not impose a new study for every change; the relevance and quality of existing evidence matter. If the fit is weak and the score may affect someone’s opportunity, pause that use until a reasoned basis and appropriate support are available. If the purpose is personal reflection, keep the result tentative: use it to form a question, then check that question against specific experiences. A report can describe a response pattern under particular conditions; it cannot settle a person’s capacity or future. For a reader asking about recurring work friction, the live Work Pattern Report at /assessment can organize reflection across decision and collaboration continuums. It has no norm, cutoff, type, or selection score, and it is not validated for employment decisions. Use it as a private prompt, then decide what observable pattern to discuss or change.
Sources: Standards for Educational and Psychological Testing (2014 edition)
Sources and notes
- Standards for Educational and Psychological Testing (2014 edition)
Supports use-specific validity, Standards 1.4 and 9.4, and the responsibilities for justifying new interpretations and gathering evidence when necessary.
- Open Access Files
Identifies the joint sponsoring organizations and provides access to the 2014 edition.
- How a Personality Assessment Report Should Explain Its Limitations
Provides existing publication coverage distinguishing score consistency from support for a proposed interpretation.
- International Guidelines on Test Use
Supports scrutiny of accessible evidence relevant to test use, populations, score inferences, and intended purpose.
- Principles for the Validation and Use of Personnel Selection Procedures, Fifth Edition
Supports the work-related scope of personnel-selection guidance and its emphasis on work analysis and contextual validation.
- Employment Tests and Selection Procedures
Supports the U.S. employment-law discussion of selection procedures, job-relatedness, accommodation, and potential adverse impact.
Apply it to your work
Turn recurring work friction into specific observations
From this guide: If the unresolved question is how your own decision and collaboration tendencies show up at work, compare a tentative pattern with concrete situations.
The Standards explain why a score should not be carried into a new purpose without a reasoned evidence fit. They cannot tell you how your own work patterns combine across decisions, collaboration, feedback, and change. The Work Pattern Report offers a private, low-stakes way to organize those observations. It has no norms, cutoff, type, or selection score, and it does not recommend a job.