Case study 03 · Teacher development

Teachers as AI Evaluators

A 60-minute teacher workshop that moves the focus from making content with AI to judging it.

Independent CPD conceptEducator pilot not yet conducted
  1. ProblemDone
  2. DesignDone
  3. BuildNot yet
  4. ReviewNot yet
  5. ReviseNot yet

The challenge

Teachers are being asked to use AI for lesson plans, messages and resources. But polished AI material can still have errors, the wrong level for the age group, hidden assumptions or privacy risks. Teachers need a simple routine for checking it, not just another list of prompts.

My design response

The workshop uses an AI-made lesson that is flawed on purpose (I wrote it myself). Teachers hunt for the problems, score it with a practical rubric, fix it, and explain why their version works better for students. Think of it as a spot-the-mistake game for grown-ups.

60-minute run of show

TimeActivityEvidence captured
0–5 minOne-question baseline: Would you use this AI answer?Anonymous initial judgement + reason
5–15 minSpot the hidden issues in a sample AI lessonIndividual annotation
15–30 minEvaluate with Accuracy–Age–Bias–Privacy–Pedagogy rubricCompleted evaluation rubric
30–45 minRedesign one activity and compare alternativesRevised activity + rationale
45–55 minPeer review and improvementPeer comment + revision note
55–60 minExit challenge and action commitmentPost-response + next step

Teacher evaluation checklist

  • Accuracy: Can every substantive claim be verified through a trustworthy source?
  • Age appropriateness: Are vocabulary, assumptions and instructions suitable for the intended learners?
  • Bias and inclusion: Whose perspectives are missing? Are stereotypes or unfair assumptions present?
  • Privacy and safety: Does the task require sharing personal or student information?
  • Pedagogical value: Does the task make student thinking visible, or merely produce a polished output?

Looking for practical teacher development?