Found 1810 results for scraper

studi-scraper

Scrape your exam data from your university.

miniscraper

Minimalist Node.js web scraper and crawler working with under-the-hood JSDOM

steamscrapper

Quickly find app ids corresponding to an app you want to search for and extract all steam market page info about apps by passing their id.

webmiddle-client

> Connects to a webmiddle-server, allowing remote services execution.

tum-conf-scraper

This is a scraper written in Node.js and using Puppeteer that gets the videos served on TUM conf (zoom)

scrape-links

Scrape links recursively from a URL (CLI)

@regedit-msc/manga_raw_scraper

A scraper for manga raw.

@systemfsoftware/apify

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

node-crawling-framework

NodeJs crawling & scraping framework heavily inspired by Scrapy (Pyhton)

scrapper_news

Module to scrap any news from webpage in Indonesia

google-http-scraper

This modules scrapes google serps using http requests with proxy support

web-scraper-bc

Simple and efficient web scraper for Node.js projects, eliminating the need for API calls with updated states.

webmiddle-component-resume

> A component that makes a task resumable by caching the result.

imagegrab

Given a URL, fetches a list of all images in that webpage using Node.js

ph-dl

Very complete scrapper for the famous porn website pornhub

flamescraper

Deep web scraper with recursive subpages for each param and unknown-pagination loop

google-trend-scraper

Provide trend names, get trend data over time

google-search-scraper-fake-user-agent

Google search scraper with captcha solving support and fake user agent

crawlarchiver

crawl and archive a website and all its pages as plain HTML files organized in directories to match the URL structure of the website

JSON Driven Site Scraper (Scavater). It is useful when you want to extract some information from a site when the extraction process may not require any complex logic, only xpath patterns of the elements that contain the information are sufficient.

@explodingcamera/website-scraper

Download website to a local directory (including all css, images, js, etc.)

dmhy-get-api-unofficial

Yet another DMHY scraper

wp-api-ripper

Devora APIs REST de WordPress y extrae JSON puro y funcional. | El susurro del caos, quebrantando el orden celestial.

dat-hansard

Scrapes data.openaustralia.org to dump data into a dat

esana-news-scraper

A simple API and scraper for fetching Sinhala news articles from Esana.com.lk.

amazon-lupa

Amazon Scraper. You can scrape products from amazon search result and you can also scrape reviews from a specific product

@ytracker/ytinitialdata

This package simplifies the extraction of useful metadata from the global `ytInitialData` variable, accessible on YouTube- video and channel pages.

@aetherzcode/scraper

Browserless scraper module

n-scraper

scraper: crawl + download

pdf-scrape

PDF Text Scraping

mandu

Scrapes a url and extracts its metadata

@harshad1011/product-scraper

Web scraper for E-Commerce platforms like Grofers, Big Basket, Nature's Basket. Returns product details given product's URL.

wpdl

Scrape data from a WordPress instance.

imut-jwch-scraper

解析内蒙古工业大学教务处公告的 Node.js 模块。

youtube-video-scraper

A nodejs package to scrape video data from youtube automatically.

@haqq/app-store-scraper

Scrape data from the itunes app store

webwrangler

WebWrangler is a NodeJS library which allows to scrape and interact with websites using Puppeteer with YAML (NODE12 Support for Meteor)

server-queryselector

Library for building dom from html and searching node in it.

google-play-scraper-mba

scrapes app data from google play store

@ewsdk/scraper

website scraper

@vladfrangu-dev/crawlee-http

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

nothing-ydls

A simple YouTube video downloader for audio and video formats with resolusi and quality.

@tidytiny/twitter-scraper

A port of n0madic/twitter-scraper to Node.js.

zemil

nodejs scrape/check websites by list

mokka-iswordpress

Scraper for Wordpress Sites - Via Meta Tag

tastyspleen-stats-scraper

Scrapes Quake2 player stats from http://tastyspleen.net.

spr-site-scraper

A site scraping tool to help folks gather the data they need.\

@microwavedev/twitter-scraper

A port of n0madic/twitter-scraper to Node.js.

@mangalert/scraper

Manga scraper for several providers.

scraper-box

ScraperBox Made By ZSofttt

email-scraper-puppeteer-2024

A tool that uses Puppeteer to scrape email addresses

stellarscrape-client

The apiWrapper for the StellarScrape API

gumo

A web-crawler and scraper that extracts data from a family of nested dynamic webpages with added enhancements to assist in knowledge mining applications.

linkedin-reader

A node module that can be used to automate reading LinkedIn pages

@vladfrangu-dev/apify

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

scrapew-node-sdk

Scrapew Node SDK

scrapwave

A lightweight and powerful web scraping library for Node.js with TypeScript support.

x-ray-wrapper

structure any website

@gopherd/opensea-scraper

Scraping data from opensea.

scrapie

Simple and light framework to scraping data.

fetch-phone-numbers

Fetch free US phone numbers from receive-sms-free.cc

skaut

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

twitter-puppeteer

download all twitter data by scraping without api token using puppeteer.

node-crawler-wallstreetcn

A node crawler using [cheerio](https://github.com/cheeriojs/cheerio) & [nightmare](https://github.com/segmentio/nightmare) to scrape the news & the article of news from [wallstreetcn](https://wallstreetcn.com/news/global), and save the data to json file.

severus-scrape

Use ~~magic~~JavaScript to build website scrapers.

google-data-scraper

Data scraper for scraping google's website

youtube-comments-scraper

A nodejs package to fetch comments of youtube video automatically.

tweet-scraper

A nodejs package to scrape tweet data from twitter automatically.

product-scraperjs

cheerio-based scraper for e-commerce websites

spider-stealth-core

A Node.js scraping framework built on puppeteer-extra (to use a headless Chrome/Chromium browser). Has the ability to solve reCaptcha. The core module without browser installation

slackmojis

Slackmojis downloader

project-scraper

A script to generate a project structure report and collect file contents.

youtube-info-ant

Fetch meta information about YouTube videos

@manishrawat4u/x-ray

structure any website

@tradle/x-ray-crawler

x-ray's crawler

@subtitles/providers

Providers are the core of applications, where the subtitles are collected. Each provider exports a unique strategy for gathering data. From legendastv's web scraping from opensubtitle API usage, you can collect subtitles from your favorite tv shows and mo

scraperpal

Scrapper Google

instagram-crawling

Simple Instagram Crawling without using public API

@vladfrangu-dev/crawlee-cheerio

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

all-news-scraper

news scraper

jscraper

A powerful website scraper used for training language models.

@sparanoid/eop-sender-go-qchttp

Send processed data to go-qchttp

@disqada/scraper

Very simple and easy to use web scraper

gismeteo

Gismeteo weather (unofficial)

crawlforge-mcp-server

CrawlForge MCP Server - Professional Model Context Protocol server with 16+ comprehensive web scraping, crawling, and content processing tools.

scrapester

JavaScript SDK for Scrapester API

@themarcba/amazon-web-scraper

Library to web-scrape data from Amazon to find out the status of an item at Amazon

query-sdk

The SDK that is used to create query.hornung.dev scrapers.

@vladfrangu-dev/crawlee-cli

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

zoopla-scraper

Easily scrape zoopla property data.

search-this

Search for something on google and get a easy to read JSON response.

google-place-reviews-lib

A library to scrape Google reviews using place ID

jimov_scraper

API for scraping multimedia content such as anime, movies, series, and manga

@diondredev/url-metadata

Request an http(s) url and scrape its metadata.

hugopoi-webcrawler

Web crawling tool

scrape-zillow

Scrape any html with zillow data on it.

node-moodle-scraper

Scrape data from a moodle website. Only testet with BU Weimar.

tiktokdl-core

tiktok video downloader without watermark, slide photo, audio.

job-o-scraper

A simple tool to easily scrap Job offers from websites and get instant notifications.

ml-scraper

Scraper de productos

@soymaycol/maysite

Descarga sitios web completos como archivos ZIP usando wget

youtube-comment-downloader

Simple script for downloading Youtube comments without using the Youtube API

olxba-scraper

A web scraper for the Bosnian listings site olx.ba

@sanv/apify

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

allrecipes-scraper

A library to search and scrape recipes from allrecipes.com

@yongteng/cheerio

Tiny, fast, and elegant implementation of core jQuery designed specifically for the server

npm_scraper_test

npm scraper package

youtube-auto-search

A nodejs package to search keyword on youtube and get search results automatically.

@cassidyai/crawlee-root

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

parser_airbnb

Parser for Airbnb. Update calendars, reviews, descriptions, photos. Is free!

@syntaxteam/ytdl-syntax

YouTube video downloader in pure javascript.

kp-scraper

A web scraper for the Serbian listings site KupujemProdajem

instagrams

Instagram Metadata Scraper!

@tradle/x-ray

structure any website

tenshi

Website scraper

yt-scrape-metadata

A YouTube search scraper to fetch video metadata.

quiz_builder_js

Generate quizes from PDFs, Text,and URLs using gpt. Saves as a .json file.

garfieldbot-api-scraper

A package for downloading Facebook videos using the bochilteam/scraper

rafaelytdll

Scraping data from YouTube using a custom downloader API

@j0r6it0/lyricsfinder

Find the lyrics of a song in Genius and Google.

paginated-listings-scraper

Extract listings data from paginated web pages

cheerio-fork

The fast, flexible & elegant library for parsing and manipulating HTML and XML.

@gabegabegabe/rtscraper

A Rotten Tomatoes scraper

webbscraper

package to scrape images or links from url

@jfxlycyv/orange-api

Very complete scrapper for the famous porn website pornhub

spotify-playlist-scraper

A simple CLI tool to scrape Spotify playlists, export the songs' informations to a JSON file and download them from YouTube using yt-dlp.

@siputzx/scraper

Free Scraper

google-events-scraper

Scraper to gather data from google events using Crawlee.

@spykesocial/react-native-opengraph-scrapper

React Native scraper module for Open Graph and Twitter Card info

@relouders1188/google-play-scraper-hotfix-mapping

scrapes app data from google play store

mercadolibre-car-scraper

TypeScript-based web scraper for MercadoLibre car listings with foreign currency prices

@promptordie/siphon-knowledge

AI-powered documentation generation system for AI Coding Agents.

@cdirks4/insta-scraper

Instagram profile scraper using Puppeteer

beervana-scraper

just a scraper for beervana.sk web page

ts-ray

structure any website

@bryanfm/scraper

Scraper makes your days easier!

crawl-links

takes an array of urls and crawls the urls for links

@jaymun723/unfurl.js

Scraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based

google-play-scraper-juy

scrapes app data from google play store

@leny/twitter-scraper

A simple scraper to gather users' stats from twitter profile.

pixelcanvas-scraper

A pixelcanvas.io scraper

@thegu5/x-ray

structure any website

darinv-agent-twitter-client

A twitter client for agents

muninn-detect

It parses the html and collects the requested data as desired.

nevt-api

Simple Api Nevt

@sesamestrong/json-scraper

A tool to allow for quick running of JSON-based scrapers using request-promise and jsonframe-cheerio.

spinney

A simple and nimble web scraper.

scdl-node

A SoundCloud Downloader made with Node and Typescript

open-graph-scraper-bypasshtmlcheck

A fork of open-graph-scraper: Node.js scraper module for Open Graph and Twitter Card info

@mzazimhenga/providers

Package that contains all the providers of p-stream

headless-chrome-crawler-framework

Distributed web crawler powered by Headless Chrome

youtube-data-scraper

Fetch YouTube data without API

@pingid/shears

Functional web scraping in typescript

@ddn/x-ray

structure any website

app-store-scraper-ts

TypeScript rewrite of app-store-scraper with throttling, retries, and strong typing.

n8n-nodes-xclient

n8n node to scrape tweets from Twitter/X profiles