Home > Term: Unicode-based white space segmentation
Unicode-based white space segmentation
A method of tokenization that uses Unicode character properties to distinguish between token and separator characters.
- Kalbos dalis: noun
- Pramonės šaka / sritis: Software
- Category: Globalization software service
- Company: IBM
0
Kūrėjas
- Harry8L
-
(V.I.P) 574128 points - 100% positive feedback
(London, United Kingdom)
