JSPM

Skyflow SDK for Node.js

Easily create payment tokens using Flex API

Basis Theory utility for decrypting Apple Pay Tokens

DeFarm SDK - Git for traceability with multi-role permissions and global item discovery for agriculture supply chain

Basis Theory utility for decrypting Google Pay Tokens

Small, fast, event-driven, fault-tolerant html tokenizer. Works in node or browsers.

text segmentation into sentences

A NLP library for Russian language

Isomorphic utilities for GPT-3 tokenization and prompt building.

Easily create keys for use in a Flex API integration and verifying Flex token contents

Tokenizing strings of text. Extracting arrays of words and optionally number, emojis, tags, usernames and email addresses from strings. For Node.js and the browser. When you need more than just [a-z] regular expressions.

API client for token processing by connecting to assca

Babel Street Analytics API Node.js client SDK

Wix Restaurants credit-cards tokenizer

SmartCal is a lightweight and powerful library for evaluating complex mathematical expressions dynamically. It supports tokenization, parsing, and interpreting mathematical formulas seamlessly, offering flexibility to integrate custom data objects for dyn

Very fast Porter Stemmer implementation written in Javascript.

English word and sentence tokenizer, for natural language processing.

OpenVINO™ Tokenizers adds text processing operations to openvino-node package

RWA Token SDK for the development of permissioned tokens on SVM blockchains.

A TypeScript library for building powerful, composable parsers using the parser combinator pattern. Parsco provides small, reusable parsing tools that can be combined to create complex grammars and interpreters, all without separate tokenization or extern

Textmate token-based language service for Visual Studio Code.

Official AstroPay client for easy frontend integration to Tokenizer

A payment system module for SIBS payments integration with card tokenization support

A high-performance wrapper around `Intl.Segmenter` for efficient text segmentation. This class resolves memory handling issues seen with large strings and can enhance performance by 50-500x. Only ~70 loc (with comments) and no dependencies.

TypeScript SDK for AddPay Cloud API - CNP payment processing

Bedrock Tokenization Engine

Bedrock VC Issuer Coordinator Storage

A Bedrock module to provide auto-rotating tokenizers

RWA Token SDK for the development of permissioned tokens on SVM blockchains.

Bedrock Tokenized Cache

Salient is a natural language processing and sentiment analysis library

text segmentation into sentences

A parser and analyzer for advanced search queries, supporting tokenization, abstract syntax tree generation, and condition extraction.

A library for natural language processing tasks including tokenization, entity recognition, anonymization, semantic chunking, and much more.

Use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.

es6 version of aaditmshah/lexer

Fat Zebra payment processing library for Next.js and standalone environments

tokenizing text by rules

Taiwanese Hokkien Transliterator and Tokeniser

Here is a README generated from the code snippet:

## How To Use

Tools for manipulating sentences

NLP (natural language processing) for server and the browser in TypeScript. All lightweight and super-fast.

Library that allows you to make payments and tokenize debit and credit cards with Niubiz.

High-performance library for tokenizing text.

A simple iterative lexer written in TypeScript

Official SDK for MAS Hub - Enterprise blockchain platform built on MasChain

Adebiet

Tokenization Service's Smart Contracts

A Bedrock module to provide auto-rotating tokenizers

A powerful and flexible text search library for JavaScript that enables you to build a simple text search engine.

Break down text into array of words.

POS tokenization of words int meaningful components usable in POS-Bayes & Elastic Search Indexes

Jawi

MCP server implementation for XRP Ledger

A tokenizer and lemmatizer for canonical terms in text

An interface to the pruf network written in javascript

TokenEX Node.js library for API

A WebAssembly binding for the charabia multilingual text tokenizer used by Meilisearch.

CLI tool to perform NLP on selected files

Well typed, string transmutation via splicing, driven by definitions of regular expressions, priority match and recursive clauses

MCP library for AI-assisted Real World Asset tokenization on XRPL

Salient is a natural language processing and sentiment analysis library

Professional SDK for tokenized assets and security tokens on blockchain

Bedrock Tokenization Engine

Define a function to execute after completing token-defined tasks.

a lexer in javascript

Multi-criteria Cantonese segmentation with dashes, intermediates, pipes, and spaces.

Basic English tokenizer

Tools for working with human language data.

package to deploy the smart contracts that associate the tokens to the various clients proportional to their contribution

This template provides a minimal setup to get React working in Vite with HMR and some ESLint rules.

A reverse engineered Node.js client for the Blackbox.ai API, supporting chat completions with streaming and aggregated responses.

a wrapper around the LunaSec CLI enabling it to be used as an NPM package

A JSON parser implemented in TypeScript

Functions for filtering SQL-like json with conjunctive normal form filters

A simple and efficient tokenizer for natural language processing tasks.

Modular backend service for tokenization and smart contracts in real estate applications

#### Description I needed the SentenceSplitter from llamaindex but had to import the entire llamaindex package which is 1GB. I pulled it out and had GPT make a standalone version. It's not exactly the same but close.

a wrapper around the LunaSec CLI enabling it to be used as an NPM package