JSON5 – JSON for Humans

Notice

This repository contains a fork maintained by GerHobbelt. The original JSON5 work is available at json5/json5.

For an overview of all changes (fixes and features), see the section What's New or Different? further below.

The JSON5 Data Interchange Format (JSON5) is a superset of JSON that aims to alleviate some of the limitations of JSON by expanding its syntax to include some productions from ECMAScript 5.1.

This JavaScript library is a derivative of the official reference implementation for JSON5 parsing and serialization libraries, where this derivative includes a few extra features: these extras are marked with XXXXXXXXX in the feature list further below.

Why

JSON isn’t the friendliest to write. Keys need to be quoted, objects and arrays can’t have trailing commas, and comments aren’t allowed — even though none of these are the case with regular JavaScript today.

That was fine when JSON’s goal was to be a great data format, but JSON’s usage has expanded beyond machines. JSON is now used for writing configs, manifests, even tests — all by humans.

There are other formats that are human-friendlier, like YAML, but changing from JSON to a completely different format is undesirable in many cases. JSON5’s aim is to remain close to JSON and JavaScript.

Summary of Features

The following ECMAScript 5.1 features, which are not supported in JSON, have been extended to JSON5.

Objects

• Object keys may be an ECMAScript 5.1 IdentifierName.
• Objects may have a single trailing comma.

Arrays

• Arrays may have a single trailing comma.

Strings

• Strings may be single quoted.
• Strings may span multiple lines by escaping new line characters.
• Strings may include character escapes.

Numbers

• Numbers may be hexadecimal.
• Numbers may have a leading or trailing decimal point.
• Numbers may be IEEE 754 positive infinity, negative infinity, and NaN.
• Numbers may begin with an explicit plus sign.

Comments

• Single and multi-line comments are allowed.

White Space

• Additional white space characters are allowed.

Short Example

{
  // comments
  unquoted: 'and you can quote me on that',
  singleQuotes: 'I can use "double quotes" here',
  lineBreaks: "Look, Mom! \
No \\n's!",
  hexadecimal: 0xdecaf,
  leadingDecimalPoint: .8675309, andTrailing: 8675309.,
  positiveSign: +1,
  trailingComma: 'in objects', andIn: ['arrays',],
  "backwardsCompatible": "with JSON",
}

Specification

For a detailed explanation of the JSON5 format, please read the official specification.

Installation

Node.js

npm install @gerhobbelt/json5

const JSON5 = require('@gerhobbelt/json5')

Browsers

<script src="https://unpkg.com/@gerhobbelt/json5@2.0.1-35"></script>

This will create a global JSON5 variable.

API

The JSON5 API is compatible with the JSON API.

JSON5.parse()

Parses a JSON5 string, constructing the JavaScript value or object described by the string. An optional reviver function can be provided to perform a transformation on the resulting object before it is returned.

Syntax

JSON5.parse(text[, reviver])

Parameters

• text: The string to parse as JSON5.
• reviver: If a function, this prescribes how the value originally produced by parsing is transformed, before being returned.

Return value

The object corresponding to the given JSON5 text.

JSON5.stringify()

Converts a JavaScript value to a JSON5 string, optionally replacing values if a replacer function is specified, or optionally including only the specified properties if a replacer array is specified.

Syntax

JSON5.stringify(value[, replacer[, space[, circularRefHandler]]])
JSON5.stringify(value[, options])

Parameters

• value: The value to convert to a JSON5 string.

• replacer: A function that alters the behavior of the stringification process, or an array of String and Number objects that serve as a whitelist for selecting/filtering the properties of the value object to be included in the JSON5 string. If this value is null or not provided, all properties of the object are included in the resulting JSON5 string.

• space: A String or Number object that's used to insert white space into the output JSON5 string for readability purposes. If this is a Number, it indicates the number of space characters to use as white space; this number is capped at 10 (if it is greater, the value is just 10). Values less than 1 indicate that no space should be used. If this is a String, the string (or the first 10 characters of the string, if it's longer than that) is used as white space. If this parameter is not provided (or is null), no white space is used. If white space is used, trailing commas will be used in objects and arrays.

• circularRefHandler: A callback function which is invoked for every element which would otherwise cause JSON5.stringify() to throw a "converting circular structure to JSON5" TypeError exception.

  The callback returns the value to stringify in its stead. When this value happens to contain circular references itself, then these will be detected by JSON%.stringify() as encoded as '[!circular ref inside circularRefHandler!]' string values instead.

  Callback function arguments: (value, circusPos, stack, keyStack, key, err), where

  • value: The circular reference value.
  • circusPos: Index into the stack[] and keyStack[] arrays, indicating the parent object which is referenced by the value circular reference value.
  • stack: The stack of parents (objects, arrays) for this value. The first entry (index 0) is the root value. The array is a snapshot (shallow clone) to ensure user code can simply store this reference value directly without risking JSON5-internal closure problems which would ensue when we wouldn't have provided you with a snapshot/clone.
  • 'keyStack': The stack of keys, one for each parent, which describe the path to the offending circular reference value for the root value down. The first entry (index 0) is the root value. Useful when you wish to display a diagnostic which lists the traversal path through the object hierarchy in the root value towards the circular reference value at hand, for instance.
    The array is a snapshot (shallow clone) to ensure user code can simply store this reference value directly without risking JSON5-internal closure problems which would ensue when we wouldn't have provided you with a snapshot/clone.
  • key: Direct parent key of the current value. Same as keyStack[keyStack.length - 1].
  • err: The TypeError produced by JSON5.stringify(): provided here so your user-defined callback code can deside to throw that circular reference error anyway.

• options: An object with the following properties:

  • replacer: Same as the replacer parameter.
  • space: Same as the space parameter.
  • quote: A String representing the quote character to use when serializing strings.
  • circularRefHandler: A callback function which is invoked for every element which would otherwise cause JSON5.stringify() to throw a "converting circular structure to JSON5" TypeError exception. See the circularRefHandler argument description above for more info.

Return value

A JSON5 string representing the value.

Node.js require() JSON5 files

When using Node.js, you can require() JSON5 files by adding the following statement.

require('json5/lib/register')

Then you can load a JSON5 file with a Node.js require() statement. For example:

const config = require('./config.json5')

CLI

Since JSON is more widely used than JSON5, this package includes a CLI for converting JSON5 to JSON and for validating the syntax of JSON5 documents.

Installation

npm install --global @gerhobbelt/json5

Usage

json5 [options] <file>

If <file> is not provided, then STDIN is used.

Options:

• -s, --space: The number of spaces to indent or t for tabs
• -o, --out-file [file]: Output to the specified file, otherwise STDOUT
• -v, --validate: Validate JSON5 but do not output JSON
• -V, --version: Output the version number
• -h, --help: Output usage information

Contributing

Development

git clone https://github.com/GerHobbelt/json5
cd json5
npm install

When contributing code, please write relevant tests and run npm test and npm run lint before submitting pull requests. Please use an editor that supports EditorConfig.

Issues

To report bugs or request features regarding the JSON5 data format, please submit an issue to the official specification repository.

To report bugs or request features regarding the JavaScript implentation of JSON5, please submit an issue to this repository.

Contributors

Githubbers

What's New or Different?

Here's a comprehensive list of features and fixes compared to the original

• added support for ES2015-style `...` multiline string template literals, e.g.

  { str: `multiline
          example
          string value!` 
  }

• added support for heredoc string values, which must start with << immediately followed by a marker, e.g. EOT or some other alphanumeric identifier, which, when used on a line alone, will signal the end of the 'heredoc' string.

  For example:

  { str: <<EOT
          multiline EOT
          example \n
          string value!
  EOT
  }

  will have encoded the literal string

          multiline EOT
          example \n
          string value!

  i.e. none of the content of the heredoc will be treated as escaped! (The \n in there would thus read as JavaScript string "\\n".)

• JSON5.stringify() comes with a fourth argument: an optional callback method which will be invoked for each value in the value-to-stringify which would cause a 'cyclical reference' error to be thrown otherwise. The user-specified can deliver an alternative value to encode in its stead or throw the error exception after all.

  Interface definition:

  TODO

• ... TBD ...

License

MIT. See LICENSE.md for details.

Credits

Assem Kishore founded this project.

Michael Bolin independently arrived at and published some of these same ideas with awesome explanations and detail. Recommended reading: Suggested Improvements to JSON

Douglas Crockford of course designed and built JSON, but his state machine diagrams on the JSON website, as cheesy as it may sound, gave us motivation and confidence that building a new parser to implement these ideas was within reach! The original implementation of JSON5 was also modeled directly off of Doug’s open-source json_parse.js parser. We’re grateful for that clean and well-documented code.

Max Nanasy has been an early and prolific supporter, contributing multiple patches and ideas.

Andrew Eisenberg contributed the original stringify method.

Jordan Tucker has aligned JSON5 more closely with ES5, wrote the official JSON5 specification, completely rewrote the codebase from the ground up, and is actively maintaining this project.