What the 2024 NEO-PI-3 Update Changed for Multiple Raters

What changed in the 2024 Normative Update?

The 2024 NEO-PI-3 Normative Update changed the reference used to interpret scores, while PAR says the items and scoring did not change. It also added optional validity scales, reporting options, streamlined materials, and a blank profile form in the updated professional manual for clinicians to plot multiple raters’ T scores. These changes do different jobs: updated norms affect the comparison behind a score; the form displays several scores together. PAR’s public description does not say that plotted scores are averaged into one result. A norm is the reference group against which a person’s score is interpreted. PAR says the assessment converts domain and facet results to T scores using the selected normative comparison group. A T score is a standardized score on a common scale, but its meaning still depends on the selected reference. So “updated” does not mean the questions were rewritten. PAR’s FAQ says item content and scoring remain the same, while the new norms were collected in 2024. PAR describes the NEO-PI-3 as a 240-item measure of five personality domains and 30 facets. Its product page reports 2024 normative samples of 1,855 people aged 12 and above for the Self-Report Form and 1,200 for the Informant Report Form. PAR calls the sample representative of the current U.S. Census. These are publisher-reported counts and characterization; the public page does not give enough recruitment or subgroup detail to independently assess representation or precision. The new reference matters when someone compares an updated score with an older report. Since T scores depend on the chosen norm comparison, changing the reference can change relative standing even if the same answers are rescored. The public page gives no worked legacy-to-update comparison and does not state the size or direction of any individual shift. Do not assume every score changed, that a change is substantial, or that it proves personality change. Check report version and norm selection, then ask whether response data, form, and respondent are comparable. The update also makes SKK validity scales available as an option: Positive Presentation Management and Negative Presentation Management. PAR says these are optional for the Self-Report and Interpretive Report and were developed using NEO PI-R items. These optional indicators do not replace the norm reference or domain and facet scores. PAR says the materials are streamlined to three print forms: Self-Report, Informant Report–Male, and Informant Report–Female, with one form for all ages. Administration can be print or digital, while scoring and report generation use PARiConnect. Score and Interpretive Reports can include items and responses. Confirm the report option before comparing sections. The updated professional manual also includes a blank profile form that PAR says lets professionals plot T scores from multiple raters. Its launch note, “What’s Coming From PAR,” describes the same purpose. The public descriptions establish a shared display for separate profiles; they do not document averaging, weighting, a rater-agreement statistic, or a consensus score. Further manual guidance may exist beyond the public descriptions. For a side-by-side reading, keep the stable parts distinct from the changed ones: items and scoring are reported unchanged; the norm reference is new; optional scales and report choices may vary; and the form displays multiple raters’ scores together. Note version, selected norm, form, and rater before interpreting a gap. Two reports may use different reference data even when their answers match. The plotting aid makes perspectives easier to inspect, but the documented role is display. A visible difference remains a question to understand, not an automatic combined account.

Sources: NEO Personality Inventory-3 (Normative Update) | PAR product page; What’s Coming From PAR: NEO Inventories Normative Update

How can a score change if the answers did not?

A norm-referenced score expresses a person's result relative to a comparison group. If that reference changes, the reported relative standing can change even when answers and scoring rules stay the same. PAR says the 2024 NEO-PI-3 Normative Update retains legacy items and scoring while using updated norms. Its product page does not show the size or direction of a particular person's legacy-to-update shift. A changed score may reflect a changed ruler, not changed answers or a changed person.

Item responses are the recorded answers. A raw score summarizes them under the instrument's scoring rules. A standardized score, such as a T score, expresses the result on a scale derived by comparison with a reference distribution. A norm is the reference group and data used to describe its score distribution. PAR explains that domain and facet scores are converted to T scores through PARiConnect based on the selected normative comparison group. It confirms in “NEO Personality Inventory-3 (Normative Update)” that items and scoring have not changed while norms have been updated.

Identical answer patterns can therefore receive different norm-referenced scores under different reference distributions. The responses have not been rewritten; their position against the reference group may differ. This consequence of comparison does not mean every score will move, or that it will move by a particular amount or direction. The publisher provides no public worked conversion showing what an individual's legacy T score would become under the update. Do not assume the new score must be higher, lower, or closer to the middle.

Consider a hypothetical illustration, not a reported case. A person's original response data are entered for reports under two norm versions. If the comparison data differ, a plotted point might shift even though the response record is held constant. This isolates the norm reference as one possible source of a difference; it does not predict that an actual score will shift or estimate how much. In ordinary before-and-after use, the person may also have answered differently, used another form, or been compared with another selected norm group. Check these possibilities rather than assuming them away.

A norm-based point is not a direct description of how often someone behaves in an absolute sense. It shows how the scored result compares under a specified reference, not whether a behavior occurred in a particular meeting, relationship, or week. A trait interpretation may frame a tendency, but the score alone does not identify the situation behind a response or establish that the person changed. A different relative position can matter for interpretation while response content stays untouched.

Before interpreting a gap, inspect each report's labels and documentation. Record whether it is legacy or the 2024 Normative Update, which norm comparison was selected, which form was completed, and when the report was generated. Confirm whether both use the same response data or whether the person completed the assessment again. Do not treat reports as interchangeable solely because both carry the NEO-PI-3 name. PAR notes that legacy response data can be entered to generate an updated report: rescoring old answers under a new reference is possible, but it is not collecting new answers. Age and form are also relevant because the selected comparison is part of the score's basis; verify them in the report rather than inferring a match from the instrument name.

For a before-and-after reading, keep four details beside each score: instrument version, selected norm group, report date, and response source, including whether the same answers were rescored. If data are the same but the norm version differs, the result is consistent with a reference change; it does not establish a personality change. If responses and norms both differ, the shift has multiple possible explanations. Without these details, it cannot be attributed confidently to personality change.

Sources: NEO Personality Inventory-3 (Normative Update) | PAR product page

What does the new plotting form actually show?

The new form is a blank profile on which a clinician can plot T scores from multiple raters, placing separate profiles in one view. PAR’s launch note, “What’s Coming From PAR,” says the updated professional manual includes this form; the NEO Personality Inventory-3 (Normative Update) product page describes it as supplemental material for plotting multiple raters’ T scores. The public description establishes a display aid for comparison. It does not describe a calculation that turns several responses into one score. A shared scale makes it easier to see where plotted profiles look similar or differ. But the visual answers only a limited question: how do these scores compare on that scale? Close points do not prove that raters observed the same behavior or agree for the same reasons. A gap does not identify which rater is more accurate. It may point to a difference worth exploring, but the plot alone cannot say whether the difference reflects settings, interpretations, or another source of variation. These are limits of what a display can establish, not claims about any individual’s results. Three operations should remain distinct. Plotting places scores together for inspection. Aggregating combines scores under a defined rule, such as averaging or weighting. Measuring agreement estimates how consistently raters judge the same target under a specified method. PAR’s public launch note and product page document plotting. They do not describe an automatic average, weighting rule, agreement statistic, or consensus score for this form. That silence in public descriptions does not prove the professional manual contains no further instructions: the product page points to the manual and printable profile form, while the launch note gives only a brief account. A reader should not infer a calculation from a blank chart’s appearance. This distinction matters when someone summarizes a multi-rater graph. If separate points are silently collapsed, the reader loses whose perspective produced each score. An average could imply precision or consensus that the display has not established. Two close scores may come from observations in different contexts; distance between points describes their positions, not that one account should be discarded. The common scale supports side-by-side inspection, but does not settle the interpretation. A careful reading keeps each point attached to its source. Record who completed the form, whether it was Self-Report or Informant Report, which norm comparison produced the T score, and what setting or period the rater considered. PAR’s product page says domain and facet scores are converted to T scores according to the selected normative comparison group, so that choice belongs with the plotted point. Then select one meaningful difference and ask what observable behavior each rater had in mind. The graph becomes a prompt for a focused conversation instead of a summary that erases its inputs. If a professional uses averaging or another combination method, it should be documented and appropriate to the interpretation; the plotted form alone does not justify it. The practical rule is to compare separate points first, preserve their labels and context, and treat a gap as a question to investigate. Combine scores only when a documented method supports that step. On the public evidence, the new form makes multiple T-score profiles easier to inspect together; it does not establish that they should be merged into one account.

Sources: What’s Coming From PAR: NEO Inventories Normative Update; NEO Personality Inventory-3 (Normative Update) | PAR product page

Why might two plotted perspectives differ?

A difference between two plotted perspectives does not, by itself, show that one account is false. It may reflect behavior across settings, what each observer has seen, the time period or role each person considered, or measurement variation. The 1998 study “Identifying Causes of Disagreement Between Self-Reports and Spouse Ratings of Personality” offers a bounded example. In its first study, 47 married couples completed the Revised NEO Personality Inventory to describe themselves and their spouses. In a second study, the couples were interviewed about substantial disagreements; researchers analyzed the recordings. The abstract reports 16 reliably coded reasons, including different understandings of an item, different time frames or roles, and a spouse’s lack of access to covert experience. The findings concern a specific sample of married couples and an earlier NEO instrument. They do not establish how often these reasons explain differences in other relationships or in the 2024 NEO-PI-3 Normative Update. The study makes “disagreement” less like one problem with one remedy. Consider an item about comfort in groups. One respondent might think of familiar colleagues; another might picture large social events. They could interpret the prompt differently or recall different situations. This is an illustration, not a study case. Two plotted values may look comparable while referring to different experiences. Time frame can matter too. A person answering about a general pattern might weigh recent months, while an informant recalls a memorable period. The study’s abstract includes different time frames among explanations for substantial disagreements, but does not say how often this reason applied. Ask whether both people judged the same interval; treat timing as a hypothesis to check. Roles shape what an observer can see. A colleague, partner, family member, or supervisor encounters someone in a different slice of daily life. An informant may see public behavior during shared activities, while the person completing a self-report can draw on private thoughts others do not observe. This is a practical interpretation of the study’s finding about covert experience, not a measured result from the 2024 update. It does not make self-report automatically more complete or an observer less accurate. Each source has a different vantage point. For example, imagine two raters considering how someone responds when plans change. One has mostly seen routine workdays; another has seen urgent disruptions. Their scores might differ because they observed different conditions. This is illustrative, not evidence about a particular person or test result. Ask whether the report concerns routine work, unexpected change, or a broader tendency. A difference might also reflect measurement variation: scores estimate responses; they do not record every behavior. The study abstract does not quantify measurement error in the 2024 plot, so no particular gap can be called meaningful from this evidence. Its list of reasons cannot diagnose the source of a specific difference. A plot may show where perspectives diverge without identifying why. A useful follow-up stays close to observable evidence. Ask each rater what recent behavior they had in mind, where it occurred, and what time span they considered. If they disagree about a broad description, ask for an example: what happened and what did the person do? Check whether both were answering about the same setting and interval. This will not prove one interpretation, but it gives the difference a clearer subject. Keep context attached to each point. A gap can direct attention to a behavior, setting, or period worth clarifying. Without those details, it remains ambiguous: it may reflect different vantage points, interpretations, behavior across situations, or measurement uncertainty. Treating it as a question preserves what ratings can contribute without turning either into a verdict about the whole person.

Sources: Identifying Causes of Disagreement Between Self-Reports and Spouse Ratings of Personality

Why do reliability figures not settle rater agreement?

They answer different questions. Internal consistency concerns how related items are within a form; retest reliability concerns score stability across administrations. Neither, by itself, tells the reader whether self and informant ratings agree or whether a difference reflects context. PAR’s NEO Personality Inventory-3 (Normative Update) product page reports both kinds of results for its Self-Report and Informant forms, but those figures should not be read as a measure of agreement between the two kinds of report.

PAR reports Cronbach’s alpha ranges for the five domains and 30 facets on each form. Alpha is an internal-consistency coefficient: it summarizes relationships among item responses or parts of a test. It addresses whether items within a scale tend to move together in the form and sample studied. It does not tell us whether two people describing the same person would choose similar answers. The Standards for Educational and Psychological Testing explains that internal-consistency estimates use agreement among parts of one test. That is a within-form question, not a comparison of self-report with informant report.

PAR also reports intraclass correlation coefficients (ICCs) for retest reliability, separately for Self-Report and Informant forms. Retest asks how stable scores are when the assessment is administered again under the study’s conditions. It does not, by itself, say whether separate raters agree. One person completing the measure twice varies the occasion; two people completing respective forms also varies the source of the rating. The reported ICC ranges therefore cannot be treated as cross-rater agreement coefficients. PAR labels them retest results, not a comparison of self and informant scores.

The Standards for Educational and Psychological Testing says reliability coefficients can convey different information because they may include different sources of error, including items, occasions, and raters. An item-consistency coefficient may leave other variation unmeasured; an estimate based on repeated occasions may not answer a question about raters. The Standards cautions that an index addressing one kind of variability should not be treated as interchangeable with one addressing another unless their definitions of measurement error are equivalent.

For a multi-rater interpretation, ask what was repeated, who supplied each rating, and what source of variation the statistic includes. If the question is whether raters tend to give similar scores, the evidence needs to examine ratings across raters or directly analyze that variation. The Standards describes rater effects as one possible error source. PAR’s public page gives internal-consistency and retest figures, not a cross-rater agreement result in that summary.

Reliability is distinct from validity. Reliability or precision concerns score consistency under a defined replication and error model. Validity concerns whether evidence supports a particular interpretation or use. A score may be stable without supporting every conclusion drawn from it. Retest stability alone would not show that a self-informant difference represents a true difference in behavior, that one perspective is more accurate, or that combining the profiles is appropriate. Those interpretations need evidence suited to the claim. The Standards treats reliability and validity as related but separate foundations for interpretation.

PAR’s alpha and retest ICC summaries describe the publisher’s reported evidence about internal consistency and stability. They are not accuracy percentages, probabilities that an individual score is correct, or measures of how closely two raters match. Nor should alpha be compared directly with ICC as though a higher figure automatically meant better rater agreement: the coefficients address different questions.

If someone cites a reliability figure to justify combining plotted perspectives, ask whether the evidence concerns items within one form, repeat administrations, or variation across raters. Then look for a method that addresses agreement or combination directly, if that is the claim. A profile can display separate scores, but a reliability statistic for one form does not turn them into a consensus account. The Standards gives a general framework for this distinction; PAR supplies the NEO-specific figures and labels their purposes. Neither source, as presented here, warrants treating those figures as proof that raters agree.

Sources: NEO Personality Inventory-3 (Normative Update) | PAR product page; Standards for Educational and Psychological Testing; Standards for Educational and Psychological Testing, 2014 Edition

What can a multi-rater profile support—and where does its evidence stop?

A multi-rater profile can support comparison of separate reports and give a clinician and the person being assessed something concrete to discuss. Distinct scores can be viewed together rather than recalled from separate pages. PAR’s “What’s Coming From PAR” says the 2024 NEO inventories manual includes a blank profile form on which clinicians can plot T scores from multiple raters. This establishes a display function. The public description does not say that points are averaged, weighted, tested for agreement, or converted into one consensus judgment. It supports a modest claim: the form can help people inspect separate perspectives side by side. It does not establish that the resulting picture is a validated account across settings or evidence for a hiring decision. There is a reasonable case for using more than one perspective. A person completing a self-report may notice private thoughts and intentions that an observer cannot see; an observer may notice recurring conduct the person rarely considers. Looking at both could bring a useful question into focus. A shared plot may also make discussion more specific: instead of saying two reports “feel different,” participants can point to a divergence and ask what each had in mind. This is a plausible practical benefit of a common display, not a reported outcome study of the new form. PAR describes what the form permits, but does not report that using it improves accuracy, agreement, or decisions. A visual pattern can invite more certainty than its evidence warrants. Several points close together may look like confirmation, yet raters could share a limited view, use similar assumptions, or have little access to behavior outside one setting. Agreement is worth examining, but proximity alone does not show that an account is complete or correct. Conversely, points far apart do not identify which rater is right. They may reflect different observations, interpretations, or measurement variation. The plot displays the difference; it does not explain its cause. These are interpretive possibilities, not findings about a particular NEO profile. The “Standards for Educational and Psychological Testing” provides a useful general boundary. The joint AERA, APA, and NCME standards treat validity as support for specified interpretations and uses, and discuss evidence in relation to intended use and examinee population. Applied here, a profile that helps with low-stakes reflection or a professionally guided conversation does not, by that fact alone, support a higher-stakes use. A claim about selecting a candidate, for example, would need evidence relevant to that interpretation and decision. The standards are a general framework, not an evaluation of the NEO-PI-3 Normative Update or its plotting form; they cannot establish whether this specific form is suitable beyond the publisher’s stated display purpose. Treat convergence as corroboration to examine, not an automatic truth condition. If reports align, ask whether raters observed the same behavior in comparable settings and time periods. If they diverge, preserve both points long enough to find out what each represents rather than erasing the gap through an informal average. The plot can organize questions and support discussion. PAR’s public description does not show that it resolves those questions into a single validated judgment. For consequential interpretations, evidence must extend beyond the visual arrangement and fit the decision being considered.

Sources: What’s Coming From PAR: NEO Inventories Normative Update; Standards for Educational and Psychological Testing

How should you read a legacy and updated multi-rater report side by side?

Keep versions and observers separate first. Before comparing two points, identify the report version, norm reference behind each T score, form and rater, and setting each person had in view. Do not average points merely because they appear on one profile: the publisher describes a form for plotting multiple raters, not a calculation that combines them. Begin by marking whether each report uses the legacy NEO-PI-3 or the 2024 Normative Update. The publisher says items and scoring did not change, while norms were updated; scores are converted to T scores using a selected normative comparison group. So a difference between old and updated points could reflect the reference used, even if the underlying answers are the same. Do not read a version difference as evidence of personality change until the score references have been checked. Next, label each point with its source: Self-Report or Informant Report, who supplied it, and what that person could observe. “Informant” alone is too broad to explain a score. Record the relationship and setting, then choose one discrepancy that matters to the question at hand. This keeps the comparison focused instead of turning every gap into a claim about the whole person. Ask what each rater had in mind. In “Identifying Causes of Disagreement Between Self-Reports and Spouse Ratings of Personality,” two studies involved 47 married couples using the earlier Revised NEO. Interviews about substantial disagreements produced coded explanations that included different interpretations of items, time frames or roles, and private experience unavailable to a spouse. It supports asking whether two people rated the same behavior, period, and role. Invite each to give a recent observable example; keep the examples distinct if they refer to different settings. This sequence is an editorial aid, not a publisher-prescribed protocol. It is not a publisher-prescribed protocol. The *Standards for Educational and Psychological Testing* explains that reliability evidence depends on which source of variation is studied, including items, occasions, or raters. A reliability statistic alone therefore cannot settle whether two observers agree. Optional validity indicators or report options may add context, but they do not replace identifying version, reference, rater, and observation conditions. A careful conclusion can remain provisional: “These reports differ on this behavior under the conditions each rater observed.” If the comparison will influence a consequential decision, pause before treating either point, or an average, as a settled account. Check the scoring reference and clarify the observed behavior; then decide whether evidence suited to that decision is needed.

Sources: NEO Personality Inventory-3 (Normative Update) | PAR product page; Identifying Causes of Disagreement Between Self-Reports and Spouse Ratings of Personality; Standards for Educational and Psychological Testing

What should you do before acting on the plot?

Before drawing a conclusion, note each point’s NEO-PI-3 version, selected norm, and whether it came from the Self-Report or Informant form. Keep the rater attached to the score. PAR’s “NEO Personality Inventory-3 (Normative Update)” says the 2024 update changed norms while leaving items and scoring unchanged. “What’s Coming From PAR: NEO Inventories Normative Update” describes a blank form for plotting multiple raters’ T scores. Together, these sources support the verdict: the update refreshed the score reference and added a plotting aid. Their public descriptions do not document an automatic consensus calculation.

Choose one meaningful difference. Ask each rater for a recent, observable example and its setting or time period. If examples concern different situations, preserve that distinction instead of averaging points or treating one account as the whole person. Use the question for reflection or coaching. Before a consequential decision, seek evidence suited to that decision rather than relying on the plot alone.

If the unresolved issue is your recurring work pattern, the live Work Pattern Report is a separate, low-stakes self-reflection exercise about decision and collaboration tendencies. It has no norm, cutoff, type, or selection score and is not validated for hiring or job matching. It can help name a pattern to examine; read the NEO plot with its version, norm, rater, and observation context in view.

Sources: NEO Personality Inventory-3 (Normative Update) | PAR product page; What’s Coming From PAR: NEO Inventories Normative Update

Questions readers ask