Mock data that is used for unit testing of the Rosette API bindings
-
Updated
Jan 13, 2016
Mock data that is used for unit testing of the Rosette API bindings
Simple lexical analyzer to identify tokens using python3.
Resolving conflict merges with ASTs
A cross-platform tool for extracting web.config key/value pairs into JSON format, and generating tokenized versions of web.confg and other XML-based configuration files (DotNet)
Language processing interface: some tools to process different natural languages
A jQuery tool to tokenizer value on input
Text Data Mining sentiment from historical documents
Pre-trained models for tokenization, sentence segmentation and so on
Pre-trained models for tokenization, sentence segmentation and so on
POS Tagger, lemmatizer and stemmer for french language in javascript
A cross-platform command line utility for detokenization of configuration files and Madlibs. Supports multiple-token-file overrides, as well as Chef regular & encrypted data bags.
Nectar is the token used in the Antz platform
First Dapp (for BlockchainChallenge)
Simple synchronous string tokenizer using Regex
It creates a JWT token when a user login,and that token is send in each request for authentication and authorizaton.
A PHP Library to extract n-grams from a text. Simple preprocessing tools (cleaning, tokenizing) included.
Add a description, image, and links to the tokenization topic page so that developers can more easily learn about it.
To associate your repository with the tokenization topic, visit your repo's landing page and select "manage topics."