all options
bookworm  ] [  trixie  ] [  sid  ]
[ Source: r-cran-tokenizers  ]

Package: r-cran-tokenizers (0.3.0-1)

Links for r-cran-tokenizers

Screenshot

Debian Resources:

Download Source Package r-cran-tokenizers:

Maintainers:

External Resources:

Similar packages:

GNU R fast, consistent tokenization of natural language text

Convert natural language text into tokens. Includes tokenizers for shingled n-grams, skip n-grams, words, word stems, sentences, paragraphs, characters, shingled characters, lines, tweets, Penn Treebank, regular expressions, as well as functions for counting characters, words, and sentences, and a function for splitting longer texts into separate documents, each with the same number of words. The tokenizers have a consistent interface, and the package is built on the 'stringi' and 'Rcpp' packages for fast yet correct tokenization in 'UTF-8'.

Other Packages Related to r-cran-tokenizers

  • depends
  • recommends
  • suggests
  • enhances

Download r-cran-tokenizers

Download for all available architectures
Architecture Package Size Installed Size Files
amd64 641.6 kB845.0 kB [list of files]
arm64 636.3 kB861.0 kB [list of files]
armel 636.2 kB860.0 kB [list of files]
armhf 637.6 kB860.0 kB [list of files]
i386 642.9 kB847.0 kB [list of files]
mips64el 635.5 kB869.0 kB [list of files]
mipsel 635.9 kB863.0 kB [list of files]
ppc64el 642.1 kB925.0 kB [list of files]
s390x 637.7 kB849.0 kB [list of files]