pragmatic_tokenizer 0.4.0
A multilingual tokenizer to split a string into tokens.
Gemfile:
=
instalar:
=
dependencias de Runtime (1):
unicode
>= 0