An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: distributed-scraping

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

Language: Go - Size: 20.7 MB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 2,065 - Forks: 238

queue-xec/master

Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper

Language: JavaScript - Size: 9.12 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 19 - Forks: 4

codeuniversity/smag-mvp 📦

Social Record - Distributed scraping and analysis pipeline for a range of social media platforms

Language: JavaScript - Size: 7.29 MB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 19 - Forks: 6