KPIs.
This page is the canonical answer to the question every serious reader of /advocacy eventually asks: what counts as a KPI here? The answer is not a list of favored metrics. It is a posture toward measurement — a four-step pedagogy, three required components, a five-tier separation, and a Metric Passport that travels with every public number.
This page is not the public scoreboard. The scoreboard at /advocacy/scoreboard is an evidence snapshot dated 2026-05-07. It separates pre-existing policy, KTP-associated activity, and measured outcomes. This page is also not the K-12 measurement reform agenda. That agenda, at /advocacy/k12/measurement-reform, is one domain's full instantiation: the canonical implementation of the pattern named here.
What follows is the synthesis surface — the framing a reader should hold before drilling down to the ledger, the K-12 agenda, or the cross-cutting discipline in the Playbook. Get this page right, and the others stop reading like three different projects.
Metrics should make reality more legible without making the institution more gameable.
This is the design constraint every public KPI on /advocacy must satisfy. Failing the constraint is not a measurement bug — it is a substrate failure. A number that makes the institution more gameable corrupts the substrate the measurement was meant to observe. A number that does not make reality more legible is an opacity machine wearing the costume of accountability.
§01the four-step pedagogy
The /advocacy methodology runs in this order, every time. Each step is necessary; skipping the fourth turns substrate-engineering into the same theater the filter was meant to expose.
- Filter exposes the proposed intervention — the substrate-engineering test: who pays maintenance, who's defaulting?
- Category names what it fails as, when it fails — one of the twenty-two "something else" categories.
- Adjacent intervention names what would actually work — the constructive pivot.
- Measurement discipline names how we'd know it did.
The full filter and the twenty-two categories live at /advocacy/playbook. The Litmus Test on that page is the operational instantiation of step one — a deterministic, three-question rule-based classifier that returns substrate / ambiguous / something_else.
§02the three required components
Every substrate KPI on /advocacy ships with all three. Without measurement discipline, the substrate move becomes another awareness-without-action — a diagnosis with no bill paid.
Rigorous KPI for the substrate condition itself
Measure the substrate's health (interpretive capacity, attention residence, civic-decision quality), not the symptom (test scores, screen-time minutes, voter turnout). The substrate is the thing whose maintenance cost someone has to pay so everything above it can function — measure that.
Gameable KPI to AVOID
Goodhart's Law applied. Name the measure opponents will pivot to once the rigorous one becomes the target. Publishing the gameable KPI alongside the rigorous one is the anti-Goodhart move encoded in the metric itself.
Mitigation that makes the rigorous KPI usable
Typically triangulation across sources, behavioral verification, or stratified sampling that resists coaching. Without the mitigation, the rigorous KPI becomes the next gameable one.
§03the five-tier separation
Most public-policy systems collapse all five tiers into one scoreboard. Healthy systems separate them. Each tier has a different evidentiary bar and a different gaming risk. A metric licensed for one tier should not be silently used in another.
- 01Diagnosticfor understanding (protected from punitive use)
- 02Formativefor improving (protected diagnostic space)
- 03Public reportingfor transparency
- 04Accountabilityfor consequences
- 05Researchfor causal learning
Full purpose / audience / stakes / collapse-failure detail per tier lives in the K-12 measurement reform agenda at /advocacy/k12/measurement-reform.
§04the metric passport pattern
Every public KPI ships with a Metric Passport — a documented specification that travels with the number. The passport answers, in advance, the questions a serious reader would otherwise have to reverse-engineer: what is this measuring, with what instrument, against what evidence, and what is it licensed to be used for.
- Construct
- Instrument
- Population
- Reliability
- Validity evidence
- Use license
- Forbidden uses
- Known gaming risks
- Equity risks
- Update cadence
- Uncertainty display
- Audit trail
See /advocacy/k12/measurement-reform for the populated sample passport (chronic absenteeism rate) with each of the twelve fields filled against a real K-12 metric.
§05the three kpi surfaces on /advocacy
The synthesis on this page surfaces in three distinct places across /advocacy. Each plays a different role; together they form the full KPI architecture.
/advocacy/scoreboard
The May 7, 2026 snapshot records seven state policy precedents and one district policy, all predating this advocacy program. Instrument dates and status are preserved as recorded; this page has not reverified them. No KTP-associated adoption or measured outcome is recorded. Historical snapshot; no current update schedule.
Open →/advocacy/k12/measurement-reform
The full eleven-section measurement reform agenda for K-12 education. Campbell's Law as design constraint, the seven-construct map, the populated Metric Passport, the anti-Goodhart gaming table, NAEP as yardstick, opportunity-to-learn data, three protected data zones.
Public education needs a measurement constitution before it needs another reform war.
Open →/advocacy/playbook §06
The four-step pedagogy and the three required components apply to every substrate KPI proposal across all domains. Filter → Category → Adjacent → Measurement.
Open →§06what counts as a kpi here
A KPI on /advocacy is not a number. It is a number with a passport, a license, a tier assignment, a published gaming model, and a coalition that signed onto its construct definition before it became consequential. Concretely:
- Substrate condition, not symptom.
- Five-tier separation, not collapsed scoreboard.
- Metric Passport documented, not opaque.
- Anti-Goodhart gaming model published alongside.
- Protected diagnostic space preserved.
- Pluralist signature (multiple political camps can sign).
- Cited primary sources, not aggregator links.
A KPI worth building is one that survives its own use.