Leadership Character Architecture Institute

Assessment Framework

Assessment Validity and Reliability Standards (LCABOK™ Section 6.5)

Section 6.5 sets the validity and reliability requirements that apply to all LCA assessment instruments, including structured interview protocols, behavioral assessment instruments, organizational survey tools, and any other instrument used to generate evidence for findings. It also covers fairness, instrument evaluation, and ongoing validation. Instruments that do not meet these standards produce findings that may mislead organizational decision-making, whatever the analytical sophistication with which they are applied.

Validity

An instrument is valid for LCA purposes when it measures what it claims to measure and when its output can be used as evidence for the type of finding it is intended to support. Validity is instrument-specific and context-specific. An instrument that is valid for generating behavioral hypotheses about an individual may not be valid for generating findings about a leadership system. The practitioner must evaluate each instrument against the specific use to which it will be put.

Reliability

An instrument is reliable when independent practitioners using it with the same evidence reach the same findings. Reliability is a property of the instrument and of the training and calibration of the practitioners who use it. The Institute's credentialing program is intended to include calibration requirements, and the program is being established.

Fairness

An instrument must not produce systematically different findings for individuals from different demographic groups when those differences are not attributable to differences in character architecture. The practitioner must evaluate each instrument for known fairness concerns and must not use an instrument whose fairness properties are unknown in a high-stakes assessment context.

Ongoing validation

The Institute does not yet claim empirical validation of the assessment framework. Validation is treated as ongoing work, and the evidence standard page describes the Institute's approach to it. Practitioners should not represent the framework as empirically validated and should state its current validation status when asked.

Cross-references: Section 5.5 and Section 5.4 for assessee protections.

Standards

The LCABOK™ is the governing reference for all standards. It is open access and available as a free download.