ParamergeParamerge

Domain Atlas

Child welfare & family services

Predictive screening and profiling where the cost of both false alarms and misses lands on families — and where the human override layer has measurably mattered.

Use cases

What AI is doing here

Maltreatment call screening

Predictive

Risk scores supporting screen-in/screen-out decisions on child-maltreatment referrals.

Family risk prediction

Predictive

Longitudinal risk models over family and administrative data to prioritize investigation or services.

Early-help profiling

Predictive

Mining council/agency data to flag families for preventive outreach before crisis.

Case notes as training data

Predictive

Using narrative case records to train predictive models — importing the biases and errors those records contain.

Case files

What has gone wrong and right

Documented deployments, presented as model organizations calibrated to the evidence, with full citations.

System map

Who is in the system and what pushes on it

Who is in the system

  • Frontline workers. Caseworkers, screeners, eligibility staff — the operator network whose judgment the system augments or erodes.
  • Supervisors & QA. The institutional correction layer: overrides, second reads, quality review.
  • Agency leadership. Owns procurement, policy, and the authority map; answers for the system publicly.
  • Served people & families. Those the decisions land on. Deliberately outside the PAN dynamics — their outcomes are measured, never simulated.
  • Regulators & oversight bodies. Boards, auditors, data-protection officers, inspectorates — external correction capacity.
  • Advocates & community organizations. Surface harms institutions do not see; historically the earliest accurate signal.

Dominant pressures

  • Caseload surge. Demand outruns staffing; per-case attention shrinks and review becomes triage.
  • Deadline pressure. Statutory or managerial timeliness rules reward fast approval of machine output over slow disagreement.
  • Staff turnover. Experienced skepticism leaves; new staff calibrate their trust on the tool itself.
  • Data & policy drift. The world, the intake process, and the rules change under a system trained on how things used to be — two mechanisms with different remedies: the statistical properties of what the system processes move (concept drift), or the mixture of inputs arriving in deployment differs from the mixture it was trained on (covariate shift).
  • Compliance over substance. Paper controls (sign-offs, checklists) satisfy audits while the behavior they describe erodes.

Governance

Questions leaders should be asking

  1. 1. What does a risk score change about a worker's next action — and is that mapping written down anywhere?
  2. 2. Are overrides tracked, and does anyone know whether they are improving or degrading equity?
  3. 3. If the tool were saturating workers with alerts, how would leadership find out?
  4. 4. What would trigger discontinuation, and who holds the authority to trigger it?
  5. 5. Who receives a report that the tool has harmed someone — a family, a worker, an advocate — on what clock, and what has to happen next once they have it?

For the actions behind these questions, see the Practice Library.

Seeing your organization in this domain? Mapping its actual pathways, pressures, and correction capacity is engagement work.

Work With Paramerge

Sources & Evidence

Claims made on this page and what supports them. The full registry lives in Evidence.

ConceptualThe volume's governance chapter places two standing duties on an agency that deploys AI, both distinct from an…

The volume's governance chapter places two standing duties on an agency that deploys AI, both distinct from any pre-deployment approval. First, an incident-reporting protocol that enables timely identification and remediation of algorithmic harm - discriminatory treatment, a biased risk assessment, a misdiagnosis, a breach of confidentiality. Second, transparent channels through which both the people served and the practitioners can report concerns or unexpected effects, so the accountability loop closes after deployment rather than ending at approval. The chapter is a conceptual synthesis and is cited as one: its four-tier social-work risk taxonomy is labeled by its own author as an original construction, informed by but not derived from binding regulation. It may be cited as a framework and must never be presented as a regulatory classification of any deployment in this registry.

huang2026bAcademicSave

Huang, J., Yang, F., & Lee, J. (2026). Ethical Challenges and AI Governance in Social Work. In R. An & M. A. Lindsey (Eds.), Artificial Intelligence in Social Work: Bridging Technology and Humanity. Springer. https://doi.org/10.1007/978-3-032-18443-6_22

doi.org/10.1007/978-3-032-18443-6_22

Appears in: AI in Social Work (Springer, 2026)

Topics: ai-ethics, ai-governance, social-work