An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: distributed-scraper

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

Language: Go - Size: 20.5 MB - Last synced at: 2 days ago - Pushed at: 15 days ago - Stars: 1,297 - Forks: 189

MorvanZhou/easy-scraping-tutorial

Simple but useful Python web scraping tutorial code.

Language: Jupyter Notebook - Size: 3.26 MB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 800 - Forks: 548

queue-xec/master

Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper

Language: JavaScript - Size: 9.12 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 19 - Forks: 4

ZhuoYitao/poems

基于Scrapy的分布式爬虫,用于抓取诗词

Language: Python - Size: 254 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

aaldaber/Distributed-Multi-User-Scrapy-System-with-a-Web-UI

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

Language: Python - Size: 4.97 MB - Last synced at: over 1 year ago - Pushed at: almost 7 years ago - Stars: 108 - Forks: 46

nemo/scrape

Distributed Scraper

Language: JavaScript - Size: 6.84 KB - Last synced at: about 1 year ago - Pushed at: about 8 years ago - Stars: 65 - Forks: 7