pragmatic_tokenizer 0.3.2
A multilingual tokenizer to split a string into tokens.
Gemfile:
=
安装:
=
Runtime 依赖 (1):
unicode
>= 0
A multilingual tokenizer to split a string into tokens.