JSPM

  • Created
  • Published
  • Downloads 17932
  • Score
    100M100P100Q128131F
  • License MIT

Request an http url and scrape its metadata.

Package Exports

  • url-metadata

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (url-metadata) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

url-metadata

Request an http url and scrape its metadata. Many of the metadata fields returned are Open Graph Protocol (og:) so far.

Usage

Install via npm to use in a Node.js project:

npm install url-metadata --save`

Then in your project file:

const urlMetadata = require('urlMetadata')
urlMetadata('http://bit.ly/2ePIrDy', options).then(
  function (metadata) { // success handler
    console.log(metadata)
  },
  function (error) { // failure handler
    console.log(error)
  })

Options

Defaults are the values below that you may want to override:

{
  userAgent: 'UrlMetadata', // name the bot that will make url request
  fromEmail: 'example@example.com', // your email
  maxRedirects: 8,
  encoding: 'utf8',
  timeout: 10000, // 10 seconds
  descriptionLength: 750, // number of chars to truncate description to
  ensureSecureImageRequest: true,
  encodeFields: false,
  sourceMap: {} // example: https://github.com/LevelNewsOrg/source-map
}

Returns

Returns a promise that gets resolved with the following url metadata if the url request response returns successfully. Note that the url field returned below will be the last hop in the request chain. So if you passed in a url that was generated by a link shortener, for example, you'll get back the final destination of the link as the url.

{
  'url'                  : '',
  'title'                : '',
  'image'                : '',
  'author'               : '',
  'description'          : '',
  'source'               : '',
  'og:url'               : '',
  'og:locale'            : '',
  'og:locale:alternate'  : '',
  'og:title'             : '',
  'og:type'              : '',
  'og:description'       : '',
  'description'          : '',
  'og:determiner'        : '',
  'og:site_name'         : '',
  'og:image'             : '',
  'og:image:secure_url'  : '',
  'og:image:type'        : '',
  'og:image:width'       : '',
  'og:image:height'      : ''
}

Additional fields are also returned if the url has an og:type set to article. These fields are:

'article' : {
  'article:published_time'     : '',
  'article:modified_time'      : '',
  'article:expiration_time'    : '',
  'article:author'             : '',
  'article:section'            : '',
  'article:tag'                : '',
  'og:article:published_time'  : '',
  'og:article:modified_time'   : '',
  'og:article:expiration_time' : '',
  'og:article:author'          : '',
  'og:article:section'         : '',
  'og:article:tag'             : ''
}