1-C1 | Establishing intended uses and interpretations (cluster 1) | 0 |
1-C2 | Samples and settings used in validation (cluster 2) | 0 |
1-C3 | Specific forms of validity evidence (cluster 3) | 0 |
1.0 | Stated interpretations and supporting validity evidence | 0 |
1.1 | Developer defines score meaning, population, and construct | 0 |
1.10 | Describe conditions under which validation data were collected | 0 |
1.11 | Justify content specification and domain coverage | 0 |
1.12 | Evidence for assumed cognitive processes | 0 |
1.13 | Evidence about internal structure of the test | 0 |
1.14 | Subscore, difference, and composite interpretation evidence | 0 |
1.15 | Guidance and warnings for item-level interpretation | 0 |
1.16 | Rationale for external variables in analyses | 0 |
1.17 | Report criterion suitability and technical quality | 0 |
1.18 | Link score levels to criterion performance levels | 0 |
1.19 | Include other predictors and cross-validate models | 0 |
1.2 | Rationale and evidence summary for each interpretation | 0 |
1.20 | Report uncertainty around effect size measures | 0 |
1.21 | Report adjusted and unadjusted coefficients together | 0 |
1.22 | Check local comparability of meta-analytic evidence | 0 |
1.23 | Describe meta-analytic methods and assumptions | 0 |
1.24 | Evidence for differential treatment assignment | 0 |
1.25 | Investigate unintended consequences of test use | 0 |
1.3 | Caution users against unsupported interpretations | 0 |
1.4 | User justifies any new unvalidated interpretation | 0 |
1.5 | Outcome claims need a basis and evidence | 0 |
1.6 | Indirect benefit claims require an explicit rationale | 0 |
1.7 | Document sensitivity to practice and coaching | 0 |
1.8 | Describe validation samples and missing data handling | 0 |
1.9 | Document expert judgment and rater procedures | 0 |
10-C1 | Test user qualifications (cluster 1) | 0 |
10-C2 | Test selection (cluster 2) | 0 |
10-C3 | Test administration (cluster 3) | 0 |
10-C4 | Test interpretation (cluster 4) | 0 |
10-C5 | Test security (cluster 5) | 0 |
10.1 | Practice within demonstrated competence | 0 |
10.10 | Resist vested interests in assessment outcomes | 0 |
10.11 | Share results in understandable terms | 0 |
10.12 | Consider other influences on test performance | 0 |
10.13 | Define diagnostic terms used to appraise validity | 0 |
10.14 | Support actuarial claims with criterion evidence | 0 |
10.15 | Base diagnostic interpretation on multiple sources | 0 |
10.16 | Review publisher advice on combined test use | 0 |
10.17 | Validate computer-generated interpretations | 0 |
10.18 | Protect test materials and results | 0 |
10.2 | Know validity and reliability evidence | 0 |
10.3 | Verify competence of supervised test administrators | 0 |
10.4 | Build a battery suited to the assessment purpose | 0 |
10.5 | Match tests to test taker characteristics | 0 |
10.6 | Choose tests that separate diagnostic groups | 0 |
10.7 | Give introductory information before testing | 0 |
10.8 | Follow administration instructions and standard conditions | 0 |
10.9 | Judge when technology-based administration is appropriate | 0 |
11-C1 | Standards common to employment testing and credentialing (cluster 1) | 0 |
11-C2 | Employment testing (cluster 2) | 0 |
11-C3 | Credentialing (cluster 3) | 0 |
11.1 | Documented intended score interpretations | 0 |
11.10 | Evidence for job classification decisions | 0 |
11.11 | Extending content evidence to a new setting | 0 |
11.12 | Two links from predictor to criterion construct | 0 |
11.13 | Justified credentialing content domain | 0 |
11.14 | Consistency of credentialing decisions | 0 |
11.15 | Reported rules for combining scores | 0 |
11.16 | Passing standard tied to competent practice | 0 |
11.2 | Explicit definition of content domain | 0 |
11.3 | Demonstrated link between content and job | 0 |
11.4 | Role of each score in a decision | 0 |
11.5 | Local studies grounded in research | 0 |
11.6 | Technical feasibility of local validation | 0 |
11.7 | Criteria reflecting the performance domain | 0 |
11.8 | Artifacts affecting predictor-criterion findings | 0 |
11.9 | Carrying validity findings to a new setting | 0 |
12-C1 | Design and development of educational assessments (cluster 1) | 0 |
12-C2 | Use and interpretation of educational assessments (cluster 2) | 0 |
12-C3 | Administering, scoring and reporting educational assessments (cluster 3) | 0 |
12.1 | Mandated testing programmes: stated uses, impact and consequences | 0 |
12.10 | Major decisions rest on more than one test score | 0 |
12.11 | Defining and validating difference and growth scores | 0 |
12.12 | Comparing an individual's scores across different tests | 0 |
12.13 | Evidence linking scores to placement and service outcomes | 0 |
12.14 | Competence of those who supervise test use | 0 |
12.15 | Verifying qualification of score interpreters | 0 |
12.16 | Training, documentation and oversight for administration and scoring | 0 |
12.17 | Context for reports of group score differences | 0 |
12.18 | Interpreting scores and stating error in score reports | 0 |
12.19 | Rationale and evidence for instructional recommendations | 0 |
12.2 | Evidence for each purpose of a multi-purpose test | 0 |
12.3 | Designing every step for access to the construct | 0 |
12.4 | Alignment evidence between test and target domain | 0 |
12.5 | Local norms where interpretation needs them | 0 |
12.6 | Documentation for computer and multimedia tests | 0 |
12.7 | Guarding validity against inappropriate test preparation | 0 |
12.8 | Opportunity to learn before promotion or graduation decisions | 0 |
12.9 | Repeat opportunities or sound alternatives for mastery | 0 |
13-C1 | Designing testing programmes and indices for evaluation and accountability (cluster 1) | 0 |
13-C2 | Interpreting and using test information in evaluation and accountability (cluster 2) | 0 |
13.1 | Define population and sample representativeness | 0 |
13.2 | Report how change and gain scores are built | 0 |
13.3 | Justify accountability indices and statistical models | 0 |
13.4 | Evidence for every evaluation and accountability use | 0 |
13.5 | Promote accurate interpretation for all groups | 0 |
13.6 | Put group differences in context | 0 |
13.7 | State intended uses and expected consequences | 0 |
13.8 | Monitor impact and reduce negative consequences | 0 |
13.9 | Combine test results with other information | 0 |
2-C1 | Specifying replications of the testing procedure (cluster 1) | 0 |
2-C2 | Evaluating reliability/precision (cluster 2) | 0 |
2-C3 | Reliability/generalizability coefficients (cluster 3) | 0 |
2-C4 | Factors affecting reliability/precision (cluster 4) | 0 |
2-C5 | Standard errors of measurement (cluster 5) | 0 |
2-C6 | Decision consistency (cluster 6) | 0 |
2-C7 | Reliability/precision of group means (cluster 7) | 0 |
2-C8 | Documenting reliability/precision (cluster 8) | 0 |
2.0 | Precision evidence for each intended score use | 0 |
2.1 | Stated replication range and its rationale | 0 |
2.10 | Separate precision analyses for permitted variations | 0 |
2.11 | Precision estimates for recommended subgroups | 0 |
2.12 | Precision data by age or grade subgroup | 0 |
2.13 | Standard errors in each reported score unit | 0 |
2.14 | Conditional standard errors and cut score precision | 0 |
2.15 | Subgroup differences in conditional precision | 0 |
2.16 | Decision consistency for classification tests | 0 |
2.17 | Standard error for group mean interpretations | 0 |
2.18 | Precision analysis under matrix sampling | 0 |
2.19 | Documenting reliability methods and samples | 0 |
2.2 | Evidence aligned with replication domain | 0 |
2.20 | Reporting range restriction adjustments | 0 |
2.3 | Precision estimates for every interpreted score | 0 |
2.4 | Precision data for score differences | 0 |
2.5 | Estimation methods matched to test structure | 0 |
2.6 | Noninterchangeable reliability and generalizability indices | 0 |
2.7 | Evidence for subjective and rater based scoring | 0 |
2.8 | Local scoring precision and monitoring | 0 |
2.9 | Precision evidence for long and short versions | 0 |
3-C1 | Minimising barriers through test design, administration and scoring (cluster 1) | 0 |
3-C2 | Validity of interpretations for the intended examinee population (cluster 2) | 0 |
3-C3 | Accommodations that remove construct-irrelevant barriers (cluster 3) | 0 |
3-C4 | Safeguards against inappropriate score interpretations (cluster 4) | 0 |
3.0 | Minimize construct-irrelevant variance across the testing process | 0 |
3.1 | Design every testing step for the widest range of examinees | 0 |
3.10 | Document and monitor accommodation procedures | 0 |
3.11 | Document validity evidence for changed tests | 0 |
3.12 | Describe translation methods and document adapted test validity | 0 |
3.13 | Administer in the language most appropriate to the purpose | 0 |
3.14 | Standardize procedures when an interpreter is used | 0 |
3.15 | Support claims about use with specific subgroups | 0 |
3.16 | Restrict use where subgroup validity evidence is insufficient | 0 |
3.17 | Report subgroup aggregates with comparability evidence | 0 |
3.18 | Use multiple sources in diagnostic and placement decisions | 0 |
3.19 | Protect examinees who had no chance to learn content | 0 |
3.2 | Keep irrelevant characteristics out of the measured construct | 0 |
3.20 | Weigh subgroup differences when choosing among equal tests | 0 |
3.3 | Include relevant subgroups in preliminary studies | 0 |
3.4 | Comparable treatment in administration and scoring | 0 |
3.5 | Document provisions that remove barriers to access | 0 |
3.6 | Examine validity evidence where score meaning may differ | 0 |
3.7 | Evaluate differential prediction when samples allow | 0 |
3.8 | Report subgroup validity evidence for constructed responses | 0 |
3.9 | Provide accommodations that remove barriers without changing the construct | 0 |
4-C1 | Test specifications (cluster 1) | 0 |
4-C2 | Item development and review (cluster 2) | 0 |
4-C3 | Administration and scoring procedures and materials (cluster 3) | 0 |
4-C4 | Test revision (cluster 4) | 0 |
4.0 | Valid design and development documentation | 0 |
4.1 | Specifications state purpose, domain, and population | 0 |
4.10 | Psychometric model and item screening documentation | 0 |
4.11 | Cross-validation of empirically selected items | 0 |
4.12 | Content domain coverage evidence | 0 |
4.13 | Investigating irrelevant sources of variance | 0 |
4.14 | Speed component in timed tests | 0 |
4.15 | Replicable administration directions | 0 |
4.16 | Instructions and practice materials for test takers | 0 |
4.17 | Research-only use labelling | 0 |
4.18 | Detailed scoring procedures and criteria | 0 |
4.19 | Automated scoring of complex responses | 0 |
4.2 | Specifications define content, format, and procedures | 0 |
4.20 | Scorer selection, training, and monitoring | 0 |
4.21 | User responsibilities where users score responses | 0 |
4.22 | Specified score interpretation procedures | 0 |
4.23 | Differential item weighting rationale | 0 |
4.24 | Revising tests as conditions change | 0 |
4.25 | Informing users about test revisions | 0 |
4.3 | Documentation for algorithm-driven item selection | 0 |
4.4 | Documentation of test versions and their differences | 0 |
4.5 | Permissible variation in administration conditions | 0 |
4.6 | External expert review of test specifications | 0 |
4.7 | Documented item development and selection procedures | 0 |
4.8 | Empirical and expert review of items | 0 |
4.9 | Tryout sampling and sample description | 0 |
5-C1 | Interpretations of scores (cluster 1) | 0 |
5-C2 | Norms (cluster 2) | 0 |
5-C3 | Score linking (cluster 3) | 0 |
5-C4 | Cut scores (cluster 4) | 0 |
5.0 | Scores derived to support intended use | 0 |
5.1 | Clear explanations of scale score meaning | 0 |
5.10 | Defining group statistics and reference norms | 0 |
5.11 | Publisher duty to renorm while in print | 0 |
5.12 | Evidence for interchangeable scores across forms | 0 |
5.13 | Technical detail on equating functions and accuracy | 0 |
5.14 | Establishing and verifying group equivalence | 0 |
5.15 | Anchor test and anchor item characteristics | 0 |
5.16 | Documenting comparability under model-based scoring | 0 |
5.17 | Linking scores when tests cannot be equated | 0 |
5.18 | Describing linkings between non-parallel tests | 0 |
5.19 | Evidence when tests are shortened or rearranged | 0 |
5.2 | Documented scale construction procedures and rationale | 0 |
5.20 | Signalling non-equivalence after specification change | 0 |
5.21 | Documenting cut score rationale and procedures | 0 |
5.22 | Designing defensible judgement-based standard setting | 0 |
5.23 | Informing cut scores with empirical criterion data | 0 |
5.3 | Explicit cautions against likely misinterpretations | 0 |
5.4 | Justifying raw scores read directly | 0 |
5.5 | Rationale for criterion-referenced interpretations | 0 |
5.6 | Periodic checks that a common scale stays stable | 0 |
5.7 | Comparability evidence for changed test versions | 0 |
5.8 | Norms tied to clearly described populations | 0 |
5.9 | Content of norming study reports | 0 |
6-C1 | Test administration (cluster 1) | 0 |
6-C2 | Test scoring (cluster 2) | 0 |
6-C3 | Reporting and interpretation (cluster 3) | 0 |
6.0 | Established procedures across the testing cycle | 0 |
6.1 | Standardized administration and scoring procedures | 0 |
6.10 | Audience-appropriate score interpretation | 0 |
6.11 | Automated score interpretations and limits | 0 |
6.12 | Group-level aggregation evidence | 0 |
6.13 | Correcting material score errors | 0 |
6.14 | Retention policy and data security | 0 |
6.15 | Preserving protocols and written reports | 0 |
6.16 | Confidential transmission of individual scores | 0 |
6.2 | Advance notice of accommodation procedures | 0 |
6.3 | Documenting and reporting administration changes | 0 |
6.4 | Comfortable, distraction-free testing environment | 0 |
6.5 | Instructions, practice and test-taker support | 0 |
6.6 | Protecting score integrity from fraud | 0 |
6.7 | Securing test materials and confidential data | 0 |
6.8 | Scoring protocols and rubrics | 0 |
6.9 | Quality control for test scoring | 0 |
7-C1 | Test documents: appropriate use (cluster 1) | 0 |
7-C2 | Test documents: test development (cluster 2) | 0 |
7-C3 | Test documents: administration and scoring (cluster 3) | 0 |
7-C4 | Timely delivery of test documents (cluster 4) | 0 |
7.0 | Clear documentation of test information | 0 |
7.1 | Rationale, uses and misuse cautions | 0 |
7.10 | Scoring and interpretation for test takers | 0 |
7.11 | Diverse case studies in interpretive material | 0 |
7.12 | Evidence for predictive score use | 0 |
7.13 | Timely delivery of supporting documents | 0 |
7.14 | Revising documentation after test changes | 0 |
7.2 | Intended population and normative data | 0 |
7.3 | Citation of representative studies | 0 |
7.4 | Test development procedures and statistics | 0 |
7.5 | Records of data collection participants | 0 |
7.6 | Translation and adaptation documentation | 0 |
7.7 | Stated user qualifications | 0 |
7.8 | Administration and scoring instructions | 0 |
7.9 | Test security and score protection | 0 |
8-C1 | Rights to information before testing (cluster 1) | 0 |
8-C2 | Access to results and protection from unauthorised use (cluster 2) | 0 |
8-C3 | Fair and accurate score reports (cluster 3) | 0 |
8-C4 | Test taker conduct during testing (cluster 4) | 0 |
8.0 | Test takers' rights and responsibilities | 0 |
8.1 | Equal access to pre-test information | 0 |
8.10 | Notice of delayed score reports | 0 |
8.11 | Cancelling or withholding scores fairly | 0 |
8.12 | Fair resolution and recourse | 0 |
8.2 | Advance information about the test | 0 |
8.3 | Information on test format choices | 0 |
8.4 | Informed consent before testing | 0 |
8.5 | Release of identifiable test scores | 0 |
8.6 | Protection of stored and transmitted test data | 0 |
8.7 | Choosing and describing score category labels | 0 |
8.8 | Access to score reports and interpretation | 0 |
8.9 | Notice that cheating is unacceptable | 0 |
9-C1 | Validity of interpretations (cluster 1) | 0 |
9-C2 | Dissemination of information (cluster 2) | 0 |
9-C3 | Test security and protection of copyrights (cluster 3) | 0 |
9.0 | Know validity evidence and responsibilities across test use | 0 |
9.1 | Assign test use only to qualified individuals | 0 |
9.10 | Do not rely only on computer-generated interpretations | 0 |
9.11 | Investigate interpretation validity across language groups | 0 |
9.12 | Apply inclusion and exclusion criteria strictly | 0 |
9.13 | Interpret scores alongside other relevant information | 0 |
9.14 | Inform about accommodations and provide them when required | 0 |
9.15 | Inform interested parties about testing purposes and records | 0 |
9.16 | Report results in a timely way | 0 |
9.17 | Explain rights when score integrity is challenged | 0 |
9.18 | Explain retake options and score reporting scope | 0 |
9.19 | Protect examinee and institution privacy | 0 |
9.2 | Evaluate test materials before adopting a published test | 0 |
9.20 | Publish and consistently apply a release policy | 0 |
9.21 | Protect test security including earlier editions | 0 |
9.22 | Respect test copyrights including electronic versions | 0 |
9.23 | Remind test takers that items may not be disclosed | 0 |
9.3 | Establish a rationale for each intended test use | 0 |
9.4 | Justify and evidence use beyond validated purposes | 0 |
9.5 | Detect scoring errors and act on suspicion | 0 |
9.6 | Prevent foreseeable misinterpretation and inappropriate use of scores | 0 |
9.7 | Recheck interpretation validity after significant changes | 0 |
9.8 | Support public and policy releases with explanatory material | 0 |
9.9 | Justify changes to format, mode, instructions or language | 0 |
CH-1 | Chapter 1 overview | 0 |
CH-10 | Chapter 10 overview | 0 |
CH-11 | Chapter 11 overview | 0 |
CH-12 | Chapter 12 overview | 0 |
CH-13 | Chapter 13 overview | 0 |
CH-2 | Chapter 2 overview | 0 |
CH-3 | Chapter 3 overview | 0 |
CH-4 | Chapter 4 overview | 0 |
CH-5 | Chapter 5 overview | 0 |
CH-6 | Chapter 6 overview | 0 |
CH-7 | Chapter 7 overview | 0 |
CH-8 | Chapter 8 overview | 0 |
CH-9 | Chapter 9 overview | 0 |
INTRODUCTION | Purpose, structure and use of the Standards | 0 |