JSPM

Simple, lightweight and expressive web scraping with Node.js

🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.

A typescript WebGL game engine.

Xcrap Transformer is the data transformation package extracted from the Web Scraping framework Xcrap.

Converts all websites to JSON data

🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.

Opensource Framework Crawler in Node.js

Xcrap Axios Client is a package of the Xcrap framework that implements an HTTP client using the Axios library.

🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.

Xcrap Core is the core package of the Xcrap framework for web scraping, offering tools such as HttpClient, BaseClient, Randomizer, Rotator, and support for proxies and pagination.

分布式爬虫

Scrapoxy is a proxy for scrapers

Web crawler in NodeJS

Xcrap Parser is a package of the Xcrap framework, it was developed to take care of the data extraction part of text files (currently supporting only HTML and JSON) using declarative models.

Framework to scrape data from web pages

Web scraping/crawling framework built on top of headless Chrome

基于nodejs平台下使用的Scrapy模型框架组件

A Node.js wrapper for working with the Scrapyd API

A set of utility classes for node.js to make scrapping the web easier.

lightweight scrapy with node.js

Xcrap Puppeteer Client is a package of the Xcrap framework that implements an HTTP client using the Puppeteer library.

Scrapy Framework implemented by nodejs.

NodeJs crawling & scraping framework heavily inspired by Scrapy (Pyhton)

Interfaces for Scrapy

A development kit for casperjs

node.js web crawler

基于nodejs平台下使用的Scrapy模型框架组件

🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.

Node.js crawler frame.

Parser for Airbnb. Update calendars, reviews, descriptions, photos. Is free!

Simple and flexible module to work with de Scrapinghub API with Node.js and derivatives.

Puppeteer integration to Scrapy library

The most advanced web crawler for JavaScript

a node spider framework

This module is propose to scrapy website pages and extract information from doms which selected by jQuery-like selectors

Scrapyjs-compatible jsdom-based rendering service

模仿scrapy的node爬虫框架

Crawl data or download files from website with custom rules

more convenient scraper for node.js