Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. Scraping should be simple and fun!

crawling-typer

Transform your text with dynamic typing animations! crawling-typer lets you display an array of strings one at a time, each with its own color. Customize typing speed, delete speed, and pauses between strings. Enjoy full control with loop counts, post-loo

magnet-getter

An API to get magnet links using Puppeteer.

spider-stealth-core

A Node.js scraping framework built on puppeteer-extra (to use a headless Chrome/Chromium browser). Has the ability to solve reCaptcha. The core module without browser installation

@jonnyprof/headless-chrome-crawler

Distributed web crawler powered by Headless Chrome

dynamic-crawling

Tem o objetivo de executar rotinas de CRAWLING a partir de um arquivo JSON utilizando xpath mas aceitando para cada passo uma função callback que recebe o valor e pode passar esse valor para um próximo passo.

planisphere

A straightforward sitemap generator written in TypeScript.

robinbot

robin web crawling engine with nodejs

@a-parser/webperl

imdb-scrapi

An API to get data off of IMDB using Puppeteer.

declarative-scraper

Simple & Human-Friendly HTML Scraper with Json-ld support

miniscraper

Minimalist Node.js web scraper and crawler working with under-the-hood JSDOM

@satankebab/scraping-utils

Set of utils and queues to make web scraping easy.

twitter-crawler

NodeJS Crawler for Twitter

fiend

The most advanced web crawler for JavaScript

@stacksleuth/browser-agent

StackSleuth in-house browser automation agent for debugging and user simulation

crawler-by-sunbirder

Crawler Second-system effect,the second development

keyworm

keyword mention 크롤러

billboard-chart-api

billboard chart crawling module

style-crawl

Package to find style links from the site you want

@karthikmam/job-manager

A Simple Job Manager

crawler-mod

based on node-crawler

instagram-crawling

Simple Instagram Crawling without using public API

jason-the-miner

Harvesting data at the <html> mine.

skrap

Easily scrap web pages by providing json recipes

crawline

Web crawler

node-pool-scraper

Node.js web scraping utility powered by puppeteer pool

node-crawling-framework

NodeJs crawling & scraping framework heavily inspired by Scrapy (Pyhton)

ccht

A simple command0line tool to crawl and test your website

kick-off-crawling

make web scraping easy

wight-backend-web

A Wight backend for fetching static web pages

spamlet

spamlet is an efficient and simple crawler for playwright

crt-scrapper

Easily create a scraper api with the @web/scrapper library, which includes a scraper and advanced events for your website.

detect-crawling-react

This is the React Component for Detect Crawling

gumo

A web-crawler and scraper that extracts data from a family of nested dynamic webpages with added enhancements to assist in knowledge mining applications.

commodidolores

Web crawler for Node.js

@vladfrangu-dev/crawlee-utils

A set of shared utilities that can be used by crawlers

hcr

Easy To Use Web Crawler

@subtitles/providers

Providers are the core of applications, where the subtitles are collected. Each provider exports a unique strategy for gathering data. From legendastv's web scraping from opensubtitle API usage, you can collect subtitles from your favorite tv shows and mo