JSPM

  • Created
  • Published
  • Downloads 214840
  • Score
    100M100P100Q172630F
  • License SEE LICENSE IN LICENSE.md

StrongLoop Globalize - CLI and API

Package Exports

  • strong-globalize
  • strong-globalize/package.json

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (strong-globalize) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

strong-globalize

StrongLoop Globalize CLI and API

Architecture

strong-globalize is built on top of two foundation layers: Unicode CLDR and jquery/globalize. The Unicode CLDR provides key building blocks for software to support the world's languages, with the largest and most extensive standard repository of locale data available. jquery/globalize is a JavaScript library for internationalization and localization that leverages the Unicode CLDR JSON data. The library works both for the browser and as a Node.js module.

strong-globalize is a JavaScript library for internationalization and localization (globalization in one word) of a Node.js package built on top of jquery/globalize. strong-globalize provides these features:

As shown in the Demo section of this README(bottom of the page), the globalized code using strong-globalize is simpler and easier to read than the original code written without strong-globalize; and more importantly, you get all the features at no extra effort.

  • supported Node.js versions: 0.10, 0.12, 4.0, 5.0
  • supported cldr version: 28.0.3
  • out-of-box supported languages: de, en, es, fr, it, ja, ko, pt, ru, zh-Hans, and zh-Hant.

You can customize (add/remove) any languages supported by the Unicode CLDR in your strong-globalize installation.

Language Config Customization

Out of box, one CLDR gz file is inculuded in strong-globalize/cldr directory. CLDR standas for Common Locale Data Repository. The gz file contains CLDR data for the languages: de, en, es, fr, it, ja, ko, pt, ru, zh-Hans, and zh-Hant. In the installation of strong-globalize in your package for your production deployment, you can replace the out-of-box gz file entirely, or add extra CLDR data to the cldr directory. There are approximtely 450 locales (language/culture variations) defined in the Unicode CLDR v28. Among them, there are 40+ variations of French and 100+ variations of English.

strong-globalize provides a utility tool under util directory. The tool assembles and compresses only the languages you need to support in your strong-globalize installation. For example, the out-of-box gz file for the 11 languages is 134KB. See README of the utility under util directory.

In runtime, string-globalize dynamically loads to memory just the CLDR data required for the specific language by setDefaultLanguage(). First, it examines all the gz files under cldr directory in alphabetical order, then searches for the language. If the language is defined in two or more gz files, duplicate objects will be overwritten in the examination order.

Message String Resource

English string resource files must exsit under intl/en directory. Translated string resource files are stored on each language sub-directory under intl If a message is not found in the translated resource files, the correspoinding English message is displayed.

CLDR data has no dependencies on string resources. For example, you can load 100 langauge CLDR data and no translated string resources but the English string resource. However, if there is a translated non-English string resource exists for langage xx under intl/xx the CLDR data for xx must be loaded.

CLI - extract, lint, and translate

npm install -g strong-globalize

You can safely ignore these warnings because strong-globalize statically bundles cldr-data for production use.

npm WARN EPEERINVALID globalize@1.1.1 requires a peer of cldr-data@>=25 but none was installed.
npm WARN EPEERINVALID cldrjs@0.4.4 requires a peer of cldr-data@>=25 but none was installed.

You can safely ignore this warning on Node.js 0.12, 4.0 or 5.0.

npm WARN engine node-zlib-backport@0.11.15: wanted: {"node":">=0.10 <0.11"} ...

usage: slt-globalize [options]

Options:

  • -e,--extract [black list] Extract resource strings to en/messages.json except for directories on [black list] separated by a space.
  • -h,--help Print this message and exit.
  • -l,--lint Check validity of string resource.
  • -t,--translate Translate string resource.
  • -v,--version Print version and exit.

lib/local-credentials.json

To access Globalization Pipeline on Bluemix service for machine translation, credentials should be provided in one of the two ways:

(1) By lib/local-credentials.json

Copy from the service dashboard and paste something like the following into lib/local-credentials.json.

{ "credentials": { "url": "https://gp-beta-rest.ng.bluemix.net/translate/rest", "userId": "6e41ceac9f14b493faxxxxxxxxxxxxxx", "password": "vLbqlkjPhJiwJlkjwou8woO82hk2huku", "instanceId": "6888888888888e6d2f458b1b4b5fd010" } }

(2) By environment variables

For example,

BLUEMIX_URL="https://gp-beta-rest.ng.bluemix.net/translate/rest" BLUEMIX_USER=6e41ceac9f14b493faxxxxxxxxxxxxxx BLUEMIX_PASSWORD=vLbqlkjPhJiwJlkjwou8woO82hk2huku BLUEMIX_INSTANCE=6888888888888e6d2f458b1b4b5fd010 slt-globalize -t

API - Set system defaults

var g = require('strong-globalize');

g.setRootDir(rootPath)

  • rootPath : {string} App's root directory full path. All resources under this directory including dependent modules are loaded in runtime. setRootDir must be called once and only once. If called multiple times with different root directories, runtime message resuorces will be loaded in different memory spaces, which will result in 'message not found' errors. In that case, strong-globalize falls back to English.

g.setDefaultLanguage(lang)

  • lang : {string} (optional) Language ID such as de, en, es, fr, it, ja, ko, pt, ru, zh-Hans, and zh-Hant. If omitted, strong-globalize tries to use the OS language, then falls back to 'en' It must be called at least once. Can be called multiple times.

g.setHtmlRegex(regex, regexHead, regexTail)

  • regex : {RegExp} to extract the whole string out of the HTML text
  • regexHead : {RegExp} to trim the head portion from the extracted string
  • regexTail : {RegExp} to trim the tail portion from the extracted string

Most clients do not need to setHtmlRegex. See the Globalize HTML Templates section for details.

API - Formatters

g.formatMessage(path, variables)

  • path {string} The message key
  • variables {object} (optional, default: null) List of placeholder key and content value pair

g.t(path, variables)

alias of formatMessage

g.m(path, variables)

alias of formatMessage

g.formatCurrency(value, currencySymbol, options)

  • value {number} integer or float
  • currencySymbol {string} ISO 4217 three-letter currency code such as 'USD' for US Dollars
  • options {object} (optional) Strongly recommended to set NO options and let strong-globalize use the StrongLoop default for consistency across StrongLoop products.

g.c(value, currencySymbol, options)

alias of formatCurrency

g.formatDate(value, options)

  • value {Date object} Date
  • options {object} (optional) Strongly recommended to set NO options and let strong-globalize use the StrongLoop default for consistency across StrongLoop products.

g.d(value, options)

alias of formatDate

g.formatNumber(value, options)

  • value {number} integer or float
  • options {object} (optional) Strongly recommended to set NO options and let strong-globalize use the StrongLoop default for consistency across StrongLoop products.

g.n(value, options)

alias of formatNumber

API - Wrappers

%s place folders are supported. Intended to directly globalize strings embedded in the first parameter of Error, console.error, console.log, etc. and util.format by simply replacing console or util with require('strong-globalize').

g.Error(path, ...)(capital Error)

returns Error with a formatted message.

g.format(path, ...)

returns the result message from formatMessage. intended to replace util.format.

g.f(path, ...)

alias of format

g.ewrite(path, ...)

passes the result message from formatMessage to process.stderr.write, and log to file with error level if persistent logging is set.

g.owrite(path, ...)

passes the result message from formatMessage to process.stdout.write, and log to file with info level if persistent logging is set.

g.write(path, ...)

alias of owrite

Wrappers for RFC 5424 Syslog Message Severities

g.emergency(path, ...)

passes the result message from formatMessage to console.error, and log to file with emergency level if persistent logging is set.

g.alert(path, ...)

passes the result message from formatMessage to console.error, and log to file with alert level if persistent logging is set.

g.critical(path, ...)

passes the result message from formatMessage to console.error, and log to file with critical level if persistent logging is set.

g.error(path, ...)(small error)

passes the result message from formatMessage to console.error, and log to file with error level if persistent logging is set.

g.warning(path, ...)

passes the result message from formatMessage to console.error, and log to file with warning level if persistent logging is set.

g.notice(path, ...)

passes the result message from formatMessage to console.log, and log to file with notice level if persistent logging is set.

g.informational(path, ...)

passes the result message from formatMessage to console.log, and log to file with informational level if persistent logging is set.

g.debug(path, ...)

passes the result message from formatMessage to console.log, and log to file with debug level if persistent logging is set.

Wrappers for Node.js Console

g.warn(path, ...)

passes the result message from formatMessage to console.error, and log to file with warn level if persistent logging is set.

g.info(path, ...)

passes the result message from formatMessage to console.log, and log to file with info level if persistent logging is set.

g.log(path, ...)

passes the result message from formatMessage to console.log, and log to file with log level if persistent logging is set.

Wrappers for Misc Logging Levels

g.help(path, ...)

passes the result message from formatMessage to console.log, and log to file with help level if persistent logging is set.

g.data(path, ...)

passes the result message from formatMessage to console.log, and log to file with data level if persistent logging is set.

g.prompt(path, ...)

passes the result message from formatMessage to console.log, and log to file with prompt level if persistent logging is set.

g.verbose(path, ...)

passes the result message from formatMessage to console.log, and log to file with verbose level if persistent logging is set.

g.input(path, ...)

passes the result message from formatMessage to console.log, and log to file with input level if persistent logging is set.

g.silly(path, ...)

passes the result message from formatMessage to console.log, and log to file with silly level if persistent logging is set.

Usage Examples

var g = require('strong-globalize');

use g.f for util.format

before:

    Error(util.format('Directory %s does not exist', workingDir));

after:

    Error(g.f('Directory %s does not exist', workingDir));

or

    g.Error('Directory %s does not exist', workingDir);

use g.write for process.stdout.write

before:

    // don't concatenate string. word order varies from language to language.
    process.stdout.write('Directory ' + workingDir + ' does not exist...');

wrong: (don't concatenate words; word order varies from language to language)

    process.stdout.write(g.t('Directory ') + workingDir + g.t(' does not exist...'));

correct:

    g.write('Directory %s does not exist...', workingDir);

place holders

You can use place holders and parameters in one of these four ways if you'd like:

before:

    util.format('Deploy %s to %s failed: %s', what, url, err);

after

    // 1 (recommended; simply replace `util` with `g`)
    g.f('Deploy %s to %s failed: %s', what, url, err);
    // 2
    g.f('Deploy {0} to {1} failed: {2}', [what, url, err]);
    // 3
    g.f('Deploy {0} to {1} failed: {2}', {0: what, 1: url, 2: err});
    // 4
    g.f('Deploy {what} to {url} failed: {err}', {what: what, url: url, err: err});

When you put placeholders in help txt and msg messages, named or ordered placeholders should be used. Named placeholder is something like {userName}. Ordered placeholder is {0}, {1}, {2}, etc. which should be zero-base.

double curly braces not to translate

Use double curly braces {{ }} as "don't translate" indicator.

before:

    console.error('Invalid usage (near option \'%s\'), try `%s --help`.', option, cmd);

after:

    g.error('Invalid usage (near option \'%s\'), try {{`%s --help`}}.', option, cmd);

help txt files

before:

    var help = fs.readFileSync(require.resolve('./help.txt'), 'utf-8');

after:

    var help = g.t('help.txt');

and store help.txt file under intl/en.

help txt files and msg keys

They must be uniquely named because they are used as-is in runtime message database where the messages come from other modules will be merged. In case there are duplicate .txt or msg, it could be overwritten by other module(s) with the same name whichever is loaded later. Best practice is to use your package name as part of the name. For example, msgMyPackage_ErrorMessage.

The rule of thumb is strong-globalize extracts messages from JS and HTML template files and creates the messages.json file (or appends extracted messages to the messages.json if it exists), but does not edit the help txt files, msg messages, or JS/HTML files provided by the client.

Note that strong-globalize supports multiple *.txt and multiple *.json files under intl/en.

manually add message strings

slt-globalize -e command extracts message strings from your source JS files and HTML templates. In case translation is needed for strings which are not in the source files, you can manually add them to the resource JSON files. To manually add message strings to the resource file, use a key: msg* such as msgPortNumber. Those keys are kept intact in auto-extraction and the value text will be properly translated.

Demo

To quickly switch the locale, change the OS's system locale or set STRONGLOOP_GLOBALIZE_APP_LANGUAGE environment variable to one of the supported languages such as ja for Japanese, zh-Hans for Simplified Chinese, or de for German.

For example, on OSX:

    cd gmain
    LANG=ja node index.js

gsub/index.js

before:

    var fs = require('fs');
    var util = require('util');

    exports.getHelpText = getHelpText;
    exports.getUserName = getUserName;

    function getUserName() {
      var userName = util.format('user: %s', process.env.USER);
      return userName;
    }

    function getHelpText() {
      var helpText = fs.readFileSync(require.resolve('./gsub.txt'), 'utf-8');
      return helpText;
    }

after:

  • var g = require('strong-globalize');
  • replace util with g
  • replace readFile *.txt with simply g.t and move ./gsub.txt to ./intl/en/gsub.txt
  • then, run slt-globalize -e to extract and slt-globalize -t to machine translate the string resource.
    var g = require('strong-globalize');

    exports.getHelpText = getHelpText;
    exports.getUserName = getUserName;

    function getUserName() {
      var userName = g.f('user: %s', process.env.USER);
      return userName;
    }

    function getHelpText() {
      return g.t('gsub.txt');
    }

gmain/index.js

before:

    var express = require('express');
    var request = require('request');
    var app = express();
    var util = require('util');
    var gsub = require('gsub');

    app.get('/', function(req, res) {
      var helloMessage = util.format('%s Hello World', new Date());
      res.end(helloMessage);
    });

    var port = process.env.PORT || 8123;
    app.listen(port, function() {
      console.log('Listening on %s by %s.', port, gsub.getUserName());
    });

    setInterval(function(){
        process.stdout.write('Sending request to ' + port + '...');
        request('http://localhost:' + port,
            function(error, response, body) {console.log(body);});
    },1000);

    console.log(gsub.getHelpText());

after:

  • var g = require('strong-globalize');
  • replace util with g
  • replace console with g
  • replace process.stdout with g
  • wrap new Date() with g.d()
  • then, run slt-globalize -e to extract and slt-globalize -t to machine translate the string resource.
    var express = require('express');
    var request = require('request');
    var app = express();
    var g = require('strong-globalize');
    var gsub = require('gsub');

    app.get('/', function(req, res) {
      var helloMessage = g.f('%s Hello World', g.d(new Date()));
      res.end(helloMessage);
    });

    var port = process.env.PORT || 8123;
    app.listen(port, function() {
      g.log('Listening on %s by %s.', port, gsub.getUserName());
    });

    setInterval(function(){
        g.owrite('Sending request to %s ...', port);
        request('http://localhost:' + port,
            function(error, response, body) {console.log(body);});
    },1000);

    console.log(gsub.getHelpText());

Globalize HTML Templates

Many UI strings are included in HTML templates. slt-globalize -e supports string extraction from the HTML templates as well as JS files. Once extracted, slt-globalize -t can be used to translate the resource JSON.

In the following example, the two strings {{StrongLoop}} History Board and History board shows the access history to the e-commerce web site. are extracted to JSON.

    <div class="board-header section-header">
        <h2>{{{{StrongLoop}} History Board | globalize}}</h2>
    </div>
    <div role="help-note">
        <p>
            {{ History board shows the access history to the e-commerce web site. | globalize }}
        </p>
    </div>

strong-globalize supports {{ <string to be localized> | globalize }} out of box. In case you need other pattern matching rule for your template engine, you can set custom RegExp by setHtmlRegex API.

The string extraction works for CDATA as well. Text in cdata is extracted in the following example:

    <![CDATA[
        {{Text in cdata | globalize }}
    ]]>

Persistent Logging

strong-globalize provides 'persistent logging' by passing all the localized messages as well as the original English messages to client-supplied callback function.

g.setPersistentLogging(logCallback, disableConsole)

logCallback is called when a user message is sent to stdout or stderr to show to the user. Two arguments passed to logCallback are: level (string) and msg (object) which has three properties: message (UTF8 string) which is the localized message shown to the user, orig (UTF8 string) the corresponding original English message with placeholder(s), and vars (an array of argument(s) for the placeholder(s)).

    {
        message: 'ホスト:localhostのポート:8123へ送っています。',
        orig: 'Sending to host: %s, port: %d ...',
        vars: ['localhost', 8123],
    }

disableConsole (default: false) is a boolean to specify whether to send the messsage to stdout or stderr. disableConsole should be set to true in case the client controls the user communication. For example, if the client uses winston file transport for logging, the client code would look like this:

Client:

    var g = require('strong-globalize'); // strong-globalize handle
    var w = require('winston'); // winston handle

    g.setRootDir(__dirname);
    g.setDefaultLanguage();
    initWinston(w);
    // let strong-globalize to show it to the user
    var disableConsole = false;
    g.setPersistentLogging(w.log, disableConsole);

    function initWinston(w) {
      var options = {
        filename: __dirname + '/system.log',
        maxsize: 1000000,
        maxFiles: 10,
        zippedArchive: true,
      };
      w.add(w.transports.File, options);
      // let strong-globalize to show it to the user
      w.remove(w.transports.Console);
    }

Persistent Logging Demo gmain/index.js

    var express = require('express');
    var request = require('request');
    var app = express();
    var g = require('strong-globalize'); // strong-globalize handle
    var gsub = require('gsub');
    var w = require('winston'); // winston handle

    g.setRootDir(__dirname);
    g.setDefaultLanguage();
    initWinston(w); // see the Client initialization
    var disableConsole = false;
    g.setPersistentLogging(w.log, disableConsole);

    app.get('/', function(req, res) {
      var helloMessage = g.f('%s Hello World', g.d(new Date()));
      w.info(helloMessage); // write only to the log file with 'info' level
      res.end(helloMessage);
    });

    var port = process.env.PORT || 8123;
    app.listen(port, function() {
      g.log('Listening on %s by %s.', port, gsub.getUserName());
    });

    setInterval(function(){
        g.owrite('Sending request to %s ...', port);
        request('http://localhost:' + port,
            function(error, response, body) {console.log(body);});
    },1000);

    g.info(gsub.getHelpText()); // write to both console and the log file with 'info' level

Note: w.info(helloMessage) directly calls the winston API info and write helpMessage to the log file. g.info(gsub.getHelpText()) writes the localized help text to both console and the log file with info level. The other strong-globalize API calls, i.e., g.log and g.owrite also write the localized message to both console and the log file with info level.