Class |
RiTa |
||||
---|---|---|---|---|---|
Name |
tokenize |
||||
Description | Tokenizes a string (into words) according to the Penn Treebank conventions. |
||||
Example |
|
||||
Parameters |
|
||||
Returns |
|
||||
Related | RiTa.untokenize() | ||||
Syntax |
RiTa.tokenize(text); |
||||
Platform | Java / JavaScript | ||||