Chicago Public Schools On-Track indicator

What this models

This example runs on the On-track-indicator-class the student can read network: 4 components and 8 pathways between them. Every context in the Lab is a stylized model, never a reconstruction of any actual deployment, and each assumption behind it carries a provenance label.

Evidence base: 3 assumed · 1 published baseline. In the Lab, the shaded evidence band behind each headline readout draws its width from the least-established class below.

• assumed

  This is the education domain's transparency portrait, drawn as the structural opposite of the domain's opaque anchor: the checks that stay empty there are active here. The published-accuracy check is present, at a low level (about 85 percent, produced and re-studied by an external consortium), and the consortium's loop into practice is present because it demonstrably ran - the indicator is a research finding the district operationalized. The rule writes nothing and learns nothing, so there is no write-to-record pathway and no model self-loop: structural honesty, not omission. A heavy workload matched by ample capacity - every ninth grader in a giant district, met by the resourced school-level attention the record credits as the benefit's actual mechanism.

• assumed

  Contestability is by construction, and it is drawn on the staff verification edge: when the flag is a readable condition, the person it is about can check it, dispute it, and change it - the correction loop the domain's ML deployments sever is open by default, because the explanation is the flag. The rule also points at a changeable condition (freshman course performance), which the research base identifies as the reason it predicts at all - it names a lever, not a label.

• baseline

  Honesty caveat carried on the diagram: the accuracy figure and the graduation rise are associational at district scale - no randomized trial assigns schools to the indicator, and a district that adopts it is usually doing other things too. The benefit mechanism runs through the resourced intervention, not the flag: an off-track list nobody staffs is a list. Nothing here computes or claims a causal effect of the indicator alone.

• assumed

  No student outcome is modeled here. This Lab reads institutional propagation only, and students are boundary-only. The published accuracy, the graduation record, and the intervention practice live in the case file, and are never computed from anything in this diagram.

What this example does not show

• No student outcome is modeled. The Lab reads institutional propagation only; students are boundary-only, and the published accuracy, the graduation record, and the intervention practice live in the case file, never computed on this diagram.
• The accuracy figure and the graduation rise are associational at district scale - no randomized trial assigns schools to the indicator - and nothing here claims a causal effect of the indicator alone; the record's own mechanism for the benefit is the resourced intervention.

Sources and evidence

What this example rests on, claim by claim. Every entry resolves to the same ledger the Evidence Registry publishes.

• A large urban school district operationalized a transparent ninth-grade indicator - course credits earned plus no more than one core-course failure - from consortium research showing it predicts high-school graduation with about 85 percent accuracy, and wired it to school-level attention rather than to an opaque score. District graduation rates subsequently rose to record highs. The indicator is a rule anyone can read: a teacher can explain to a student exactly why they are off-track and exactly what would change it, so the contest-and-correction loop that opaque early-warning deployments sever is open by construction.

  empirical
  • Academic Allensworth, E.M., & Easton, J.Q. (2007). What Matters for Staying On-Track and Graduating in Chicago Public Schools. University of Chicago Consortium on School Research. https://consortium.uchicago.edu/publications/what-matters-staying-track-and-graduating-chicago-public-schools-focus-students

• The documented limits are as instructive as the result. The indicator's accuracy and the district's graduation rise are associational at district scale - no randomized trial assigns schools to use it - and the benefit mechanism runs through the intervention, not the flag: an indicator wired to attention still depends on the attention being resourced, and the research base's central finding is that what predicted graduation was a condition schools could act on (freshman-year course performance), not a fixed trait of the student. The rule's power is that it points at something changeable, and the district's practice is what changed it.

  empirical
  • Academic Allensworth, E.M., & Easton, J.Q. (2007). What Matters for Staying On-Track and Graduating in Chicago Public Schools. University of Chicago Consortium on School Research. https://consortium.uchicago.edu/publications/what-matters-staying-track-and-graduating-chicago-public-schools-focus-students

Where this connects

Institutional pressures in this domain

• Reviewer bottleneck — One fixed-capacity checking stage sits between AI output and consequence; everything queues behind it.
• Austerity & recovery incentives — Cost-cutting and overpayment-recovery targets tilt the system toward denial and enforcement errors.
• Compliance over substance — Paper controls (sign-offs, checklists) satisfy audits while the behavior they describe erodes.
• Data & policy drift — The world, the intake process, and the rules change under a system trained on how things used to be — two mechanisms with different remedies: the statistical properties of what the system processes move (concept drift), or the mixture of inputs arriving in deployment differs from the mixture it was trained on (covariate shift).
• Vendor opacity — The deploying institution cannot inspect the model, data, or update pipeline it is accountable for.

All of them in context on the Education AI domain page.

Levers available here and the patterns behind them

• Review on schedule — Oversight cadence & retrospectives
• Check copied records — Reconcile copied records
• Review the riskiest first — Risk-tiered oversight
• Escalate checks — State-feedback vigilance
• Mark AI-written records — Provenance labeling
• Understand the system — Understand the system

Documented case histories

• The rule a teacher can explain
• A risk label most students never needed
• A search of the home and a suspicion by group