JSPM

  • ESM via JSPM
  • ES Module Entrypoint
  • Export Map
  • Keywords
  • License
  • Repository URL
  • TypeScript Types
  • README
  • Created
  • Published
  • Downloads 86924
  • Score
    100M100P100Q176691F
  • License MIT

An NPM package to detect the encoding and language of a file

Package Exports

  • detect-file-encoding-and-language

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (detect-file-encoding-and-language) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

Detect-File-Encoding-and-Language

NPM stats

Index

  1. Functionality
  2. Installation
  3. Usage (in the browser)
  4. Usage (in Node.js)
  5. Supported Languages
  6. Used Encodings
  7. Confidence Score
  8. Known Issues
  9. License

Functionality

Determine the encoding and language of any text file!

  • Detects 40 languages as well as the appropriate encoding
  • Works best with large inputs
  • Completely free, no API key required

For reliable encoding and language detection, use files containing 500 words or more. Smaller inputs can work as well but the results might be less accurate and in some cases incorrect.

Feel free to test the functionality of this NPM package here. Upload your own files and see if the encoding and language are detected correctly!

Installation

npm install detect-file-encoding-and-language

Usage (in the browser)

// index.html

<input type="file" id="my-input-field" >

// app.js

const languageEncoding = require("detect-file-encoding-and-language");

document.getElementById("my-input-field").addEventListener("change", inputHandler);

function inputHandler(e) {
    const file = e.target.files[0];

    languageEncoding(file).then(fileInfo => console.log(fileInfo));
    // Possible result: { language: english, encoding: UTF-8, confidence: 0.97}
}

Usage (in Node.js)

// index.js

const languageEncoding = require("detect-file-encoding-and-language");

const pathToFile = "/home/username/documents/my-text-file.txt"

languageEncoding(pathToFile).then(fileInfo => console.log(fileInfo));
// Possible result: { language: japanese, encoding: Shift-JIS, confidence: 1 }

Supported Languages

  • polish
  • czech
  • hungarian
  • romanian
  • slovak
  • slovenian
  • albanian
  • russian
  • ukrainian
  • bulgarian
  • english
  • french
  • portuguese
  • spanish
  • german
  • italian
  • danish
  • norwegian
  • swedish
  • dutch
  • finnish
  • serbo-croatian
  • estonian
  • icelandic
  • malay-indonesian
  • greek
  • turkish
  • hebrew
  • arabic
  • farsi-persian
  • lithuanian
  • chinese-simplified
  • chinese-traditional
  • japanese
  • korean
  • thai
  • bengali
  • hindi
  • urdu
  • vietnamese

Used Encodings

  • UTF-8
  • CP1250
  • CP1251
  • CP1252
  • CP1253
  • CP1254
  • CP1255
  • CP1256
  • CP1257
  • GB18030
  • BIG5
  • Shift-JIS
  • EUC-KR
  • TIS-620

Confidence Score

The confidence score ranges from 0 to 1. It is based on the amount of matches that were found for a particular language and the frequency of those matches.

Known Issues

  • Unable to detect Shift-JIS encoded Japanese text files when using Node.js

License

This project is licensed under the MIT License

License