GitHub topics: scraper-engine
metatube-community/metatube-sdk-go
MetaTube SDK & API Server in Golang
Language: Go - Size: 8.03 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 657 - Forks: 127

warifp/Shopee-Scrape
Shopee Scrape is a tool that functions to collect data - the data needed, such as finding data from photos, prices, names, store locations and others.
Language: PHP - Size: 559 KB - Last synced at: 2 days ago - Pushed at: over 3 years ago - Stars: 90 - Forks: 27

Machine-Learning-Labs/GathererImageGatherer Fork of devonmurphy/GathererImageGatherer
Builds a database of Magic the Gathering card images with card name, set, and perceptual hash of artwork.
Language: Python - Size: 18.7 MB - Last synced at: 5 days ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 1

santhoshse7en/news-fetch
A Python Package which helps to scrape all news details from any news websites
Language: Python - Size: 49.8 KB - Last synced at: 15 days ago - Pushed at: 6 months ago - Stars: 197 - Forks: 110

TufayelLUS/LinkedIn-Scraper
A LinkedIn Scraper to scrape up to 1k LinkedIn profiles(due to LinkedIn limit) from company profile links and save their e-mail addresses if available! (actively maintained, if anything doesn't work, open an issue in the repo)
Language: Python - Size: 12.1 MB - Last synced at: 10 days ago - Pushed at: 6 months ago - Stars: 227 - Forks: 63

RahulSDevloper/GoSearch-Search-Engine-Scraper
Get search results from google, bing, duckduckgo, etc easily using GoSearch
Language: Go - Size: 8.79 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

fredwu/crawler
A high performance web crawler / scraper in Elixir.
Language: Elixir - Size: 385 KB - Last synced at: 9 days ago - Pushed at: 10 months ago - Stars: 950 - Forks: 90

1x-eng/chart_data_extractor
This webservice will help scrape data out of chart(s) presented on any given website. (At this moment, I only support scrape from HighCharts and AmCharts. Other libraries, maybe next time).
Language: Python - Size: 79.1 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 10 - Forks: 9

fernandod1/ProductHunt-scraper
Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.
Language: Python - Size: 9.77 KB - Last synced at: 16 days ago - Pushed at: almost 3 years ago - Stars: 24 - Forks: 8

scrape-do/node-client
Scrape.do's official http client for node.js
Language: TypeScript - Size: 129 KB - Last synced at: 26 days ago - Pushed at: 5 months ago - Stars: 7 - Forks: 0

fozbek/scrawler
Simple, schema based scraping tool
Language: PHP - Size: 75.2 KB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 0

TufayelLUS/LinkedIn-CV-Downloader
A Python based GUI automation software for downloading bulk LinkedIn CV / LinkedIn Resume from a list of profile links
Language: Python - Size: 33.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

labteral/bluebird 📦
Unofficial Python client for Twitter
Language: Python - Size: 112 KB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 43 - Forks: 14

philipperemy/japanese-street-addresses-scraper
Scraper for Japanese street addresses (住所).
Language: Python - Size: 7.02 MB - Last synced at: 22 days ago - Pushed at: about 3 years ago - Stars: 6 - Forks: 2

serping/express-scraper
Language: HTML - Size: 1.25 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 4 - Forks: 1

flulemon/sneakpeek
Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis
Language: Python - Size: 19.7 MB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 37 - Forks: 0

MuhammadAhmed-0/search-scraper
This Python-based tool scrapes Google search results and presents the top 10 results along with their URLs. Useful for SEO optimization and content writing.
Language: Python - Size: 20.5 KB - Last synced at: 17 days ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 3

MrSentex/0day.today-API
Unofficial API for 0day.today database | Supported languages: Python and PHP
Language: PHP - Size: 17 MB - Last synced at: 11 months ago - Pushed at: over 5 years ago - Stars: 13 - Forks: 8

Vitcesar/plugin.video.anitube
Add-on para AniTube, famoso site que ofereceu uma gigantesca biblioteca de animes para assistir online e de graça.
Language: Python - Size: 17 MB - Last synced at: 26 days ago - Pushed at: over 5 years ago - Stars: 8 - Forks: 3

breakpointninja/spiderjuice
Language: Python - Size: 64.5 KB - Last synced at: about 1 year ago - Pushed at: about 8 years ago - Stars: 0 - Forks: 0

DaveSimoes/Web-Scraping
The goal of this project is to provide a basic structure for web scraping HTML pages and collecting specific data. The main script (main.py) initializes a WebScraper object and calls the scrape() method to collect data from a specific URL.
Language: Python - Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

obetomuniz/tatooine
A powerful scraper for JavaScript Developers.
Language: TypeScript - Size: 1.76 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 88 - Forks: 3

vinayakmp007/Car-folio-scraper
Scrapes car details from carfolio.com to a xml file
Language: Python - Size: 2.93 KB - Last synced at: over 1 year ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 0

kingzbauer/scraperlang
A DSL aimed at making writing web scrapers/crawlers a breeze
Language: Go - Size: 1.77 MB - Last synced at: 10 months ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 0

lukluk/scraper-engine
Async Scraper Framework Based Nodejs
Language: JavaScript - Size: 2.85 MB - Last synced at: 17 days ago - Pushed at: almost 9 years ago - Stars: 11 - Forks: 7

animeshkundu/pyscrape
Lightweight headless web scraper with javascript rendering in python with http api
Language: Python - Size: 9.77 KB - Last synced at: about 1 month ago - Pushed at: over 8 years ago - Stars: 4 - Forks: 0

fazxid/shopee-product-scraper
Scrape Data & Images From Marketplace Shopee
Language: JavaScript - Size: 17.6 KB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 1

techieforfun/web-scraper
:microscope: Scraper for the web
Language: PHP - Size: 261 KB - Last synced at: almost 2 years ago - Pushed at: about 5 years ago - Stars: 4 - Forks: 0

dasileker/scraper_project
This project is a capstone project for the Microverse program Ruby, it's a scraper code that searches any torrent name you input.
Language: Ruby - Size: 22.1 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

RBEGamer/OP1.FUN-SCRAPER
Scrapes all Packages from the Op1.fun Site
Language: Python - Size: 32.2 KB - Last synced at: 7 days ago - Pushed at: about 5 years ago - Stars: 1 - Forks: 1

vreddi/DotaScraper
🚽 Scraper for Dota
Language: C# - Size: 133 KB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

seralexger/filmaffinity-scraper
Unofficial class for scrap and recollect info from Filmmaffinity
Language: Python - Size: 14.6 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 2

soulomoon/HotelScraper
A very slow hotel scraper for airbnb, booking, using selenium, beautifulsoup4
Language: Python - Size: 23.4 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0
