Stage 5 scripts
Scripts for Assessment development.
| ID | Title | Purpose |
|---|---|---|
| X-S5-01 | Concept item check | Check an assessment concept item JSON file for a malformed id, a duplicate id, or fewer than two misconceptions, then print a summary. |
| X-S5-02 | Stem plan check | Check a chapter’s stem plan JSON file against its own assessment concept items: whether each planned row’s concept-item count matches its own difficulty’s range, whether every concept item id a row names actually exists, and how far the plan’s own overall difficulty mix sits from the reference implementation’s 30/50/20 split. |
| X-S5-03 | Format rules check | Check a stems JSON file against this guide’s own format rules for a finished, assembled test question: single-best-answer only, no negative stem, no “all of the above” or “none of the above” option, a distractor named to exactly one misconception, three to four distractors, and option lengths that do not give the answer away. |
| X-S5-04 | Bank composition check | Check a bank composition file’s per-domain item counts against a blueprint’s own weights, and its bank-wide difficulty split against the reference implementation’s 30/50/20 split. |
| X-S5-05 | Answer key check | Check an answer key JSON file against a stems JSON file: every stem id in the key resolves to a real stem, and every answer letter the key uses (a correct answer or a feedback key) is a real option for that stem, matching that stem’s own real correct answer. |
| X-S5-06 | Delivery coverage check | Flag each stem a finished bank actually holds that is not assigned to any deliverable kind in a delivery manifest, and print a summary line. |