JSPM

Found 82 results for tokenization

taibun

Taiwanese Hokkien Transliterator and Tokeniser

  • v1.1.3
  • 15.04
  • Published

charabia-js

A WebAssembly binding for the charabia multilingual text tokenizer used by Meilisearch.

  • v0.2.0
  • 14.78
  • Published

@moveyourdigital/nlp

NLP (natural language processing) for server and the browser in TypeScript. All lightweight and super-fast.

  • v0.1.4
  • 14.59
  • Published

sentence-tools

Tools for manipulating sentences

  • v4.0.0
  • 14.57
  • Published

niubiz-pay

Library that allows you to make payments and tokenize debit and credit cards with Niubiz.

  • v0.1.2
  • 14.23
  • Published

tinylex

A simple iterative lexer written in TypeScript

  • v0.7.4
  • 13.89
  • Published

adebiet

Adebiet

  • v0.0.1
  • 13.73
  • Published

bedrock-tokenizer

A Bedrock module to provide auto-rotating tokenizers

  • v6.0.0
  • 12.33
  • Published

@basd/search

A powerful and flexible text search library for JavaScript that enables you to build a simple text search engine.

  • v0.0.5
  • 12.03
  • Published

tokenize-words

Break down text into array of words.

  • v0.0.4-alpha.0
  • 11.57
  • Published

@mashub/sdk

Official SDK for MAS Hub - Enterprise blockchain platform built on MasChain

  • v1.0.1
  • 11.16
  • Published

jawi

Jawi

  • v0.0.1
  • 10.58
  • Published

pos-tokenizer

POS tokenization of words int meaningful components usable in POS-Bayes & Elastic Search Indexes

  • v1.0.0
  • 10.51
  • Published

@clipperhouse/jargon

A tokenizer and lemmatizer for canonical terms in text

  • v0.3.0
  • 9.95
  • Published

pruf-js

An interface to the pruf network written in javascript

  • v0.5.2
  • 9.65
  • Published

tokenex

TokenEX Node.js library for API

  • v0.0.2
  • 8.97
  • Published

natural-cli

CLI tool to perform NLP on selected files

    • v0.0.8
    • 8.64
    • Published

    spliceation-transmutator.typescript

    Well typed, string transmutation via splicing, driven by definitions of regular expressions, priority match and recursive clauses

    • v0.0.11
    • 8.57
    • Published

    rwa-build

    MCP library for AI-assisted Real World Asset tokenization on XRPL

    • v0.1.0
    • 8.55
    • Published

    salient_for_meteor

    Salient is a natural language processing and sentiment analysis library

    • v0.1.0
    • 8.11
    • Published

    trusset-sdk

    Professional SDK for tokenized assets and security tokens on blockchain

    • v1.0.0
    • 7.80
    • Published

    tasknization

    Define a function to execute after completing token-defined tasks.

    • v1.0.3
    • 7.11
    • Published

    jexer

    a lexer in javascript

    • v0.2.0
    • 6.84
    • Published

    ogden

    Basic English tokenizer

    • v1.0.6
    • 6.02
    • Published

    lexemic

    Tools for working with human language data.

    • v0.0.8
    • 5.66
    • Published

    @dev-extralabs/web3

    package to deploy the smart contracts that associate the tokens to the various clients proportional to their contribution

      • v0.1.2
      • 5.66
      • Published

      dips.js

      Multi-criteria Cantonese segmentation with dashes, intermediates, pipes, and spaces.

      • v0.0.2
      • 4.28
      • Published

      motuma-form

      This template provides a minimal setup to get React working in Vite with HMR and some ESLint rules.

        • v1.0.0
        • 2.67
        • Published

        lunasec-cli

        a wrapper around the LunaSec CLI enabling it to be used as an NPM package

          • v0.0.1-alpha.14
          • 2.53
          • Published

          @utiric/blackbox-ai

          A reverse engineered Node.js client for the Blackbox.ai API, supporting chat completions with streaming and aggregated responses.

            • v1.0.0
            • 2.53
            • Published

            @steadyx/aether

            A JSON parser implemented in TypeScript

            • v0.0.21
            • 0.00
            • Published

            json-tkn

            Functions for filtering SQL-like json with conjunctive normal form filters

            • v0.0.3
            • 0.00
            • Published

            brainnet-tokenizer

            A simple and efficient tokenizer for natural language processing tasks.

              • v1.0.0
              • 0.00
              • Published

              easters-crypto

              Modular backend service for tokenization and smart contracts in real estate applications

                • v1.1.0
                • 0.00
                • Published

                @bbreukelen/textsplitter

                #### Description I needed the SentenceSplitter from llamaindex but had to import the entire llamaindex package which is 1GB. I pulled it out and had GPT make a standalone version. It's not exactly the same but close.

                  • v1.2.0
                  • 0.00
                  • Published

                  @lunasec/cli

                  a wrapper around the LunaSec CLI enabling it to be used as an NPM package

                    • v1.0.8-alpha.0
                    • 0.00
                    • Published