Home > Term: Unicode-based white space segmentation
Unicode-based white space segmentation
A method of tokenization that uses Unicode character properties to distinguish between token and separator characters.
- Szófaj: noun
- Ipar/Tárgykör: Software
- Kategória: Globalization software service
- Company: IBM
0
Szerzőb
- PWH617
- 100% positive feedback