JSPM

mrspider-validator

1.1.0
  • ESM via JSPM
  • ES Module Entrypoint
  • Export Map
  • Keywords
  • License
  • Repository URL
  • TypeScript Types
  • README
  • Created
  • Published
  • Downloads 1
  • Score
    100M100P100Q44736F
  • License ISC

mrspider middleware to validate data that has been extracted.

Package Exports

  • mrspider-validator

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (mrspider-validator) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

mrspider-validator

middleware for mrspider typically used after data extraction middlware such as regex data extractor, css image extraction and css data extractor before any persistence middleware such as mongodb persister.

Its purpose is to clean up extracted data removing any fields not included in the validation and converting types to those specified in the validation. Also marks the page.valid property true or false to avoid persisting invalid data.

Install

npm i -S mrspider-validator

Usage

var spider = require('mrspider');
var mrspiderValidator = require('mrspider-validator');
var validRules = {
            name: {
                type: 'string',
                required: true,
                message: 'name is required'
            },
            age: {
                type: 'number',
                required: true,
                message: 'supposed to be a number'
            }
        };
spider.use(mrspidervalidator(validRules));