fredwu/crawler

A high performance web crawler / scraper in Elixir.

Language: Elixir - Size: 384 KB - Last synced: 4 days ago - Pushed: 7 months ago - Stars: 920 - Forks: 89

santhoshse7en/news-fetch

A Python Package which helps to scrape all news details from any news websites

Language: Python - Size: 53.7 KB - Last synced: 11 days ago - Pushed: 10 months ago - Stars: 168 - Forks: 110

metatube-community/metatube-sdk-go

MetaTube SDK/Web Server in Golang

Language: Go - Size: 1.4 MB - Last synced: 20 days ago - Pushed: 20 days ago - Stars: 554 - Forks: 82

RBEGamer/OP1.FUN-SCRAPER

Scrapes all Packages from the Op1.fun Site

Language: Python - Size: 32.2 KB - Last synced: 24 days ago - Pushed: about 4 years ago - Stars: 1 - Forks: 1

soulomoon/HotelScraper

A very slow hotel scraper for airbnb, booking, using selenium, beautifulsoup4

Language: Python - Size: 23.4 KB - Last synced: 26 days ago - Pushed: over 6 years ago - Stars: 1 - Forks: 0

fozbek/scrawler

Simple, schema based scraping tool

Language: PHP - Size: 75.2 KB - Last synced: 26 days ago - Pushed: 27 days ago - Stars: 9 - Forks: 0

flulemon/sneakpeek

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

Language: Python - Size: 19.7 MB - Last synced: 19 days ago - Pushed: 9 months ago - Stars: 35 - Forks: 0

TufayelLUS/LinkedIn-CV-Downloader

A Python based GUI automation software for downloading bulk LinkedIn CV / LinkedIn Resume from a list of profile links

Language: Python - Size: 33.6 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0

breakpointninja/spiderjuice

Language: Python - Size: 64.5 KB - Last synced: about 2 months ago - Pushed: about 7 years ago - Stars: 0 - Forks: 0

TufayelLUS/LinkedIn-Scraper

A LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!

Language: Python - Size: 463 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 152 - Forks: 50

DaveSimoes/Web-Scraping

The goal of this project is to provide a basic structure for web scraping HTML pages and collecting specific data. The main script (main.py) initializes a WebScraper object and calls the scrape() method to collect data from a specific URL.

Language: Python - Size: 7.81 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 1 - Forks: 0

obetomuniz/tatooine

A powerful scraper for JavaScript Developers.

Language: TypeScript - Size: 1.76 MB - Last synced: 25 days ago - Pushed: 12 months ago - Stars: 88 - Forks: 3

labteral/bluebird

Unofficial Python client for Twitter

Language: Python - Size: 112 KB - Last synced: 5 days ago - Pushed: over 3 years ago - Stars: 43 - Forks: 12

vinayakmp007/Car-folio-scraper

Scrapes car details from carfolio.com to a xml file

Language: Python - Size: 2.93 KB - Last synced: 4 months ago - Pushed: about 7 years ago - Stars: 1 - Forks: 0

philipperemy/japanese-street-addresses-scraper

Scraper for Japanese street addresses (住所).

Language: Python - Size: 7.02 MB - Last synced: 8 days ago - Pushed: over 2 years ago - Stars: 7 - Forks: 2

Vitcesar/plugin.video.anitube

Add-on para AniTube, famoso site que ofereceu uma gigantesca biblioteca de animes para assistir online e de graça.

Language: Python - Size: 17 MB - Last synced: about 2 months ago - Pushed: over 4 years ago - Stars: 7 - Forks: 3

kingzbauer/scraperlang

A DSL aimed at making writing web scrapers/crawlers a breeze

Language: Go - Size: 1.77 MB - Last synced: 4 months ago - Pushed: over 2 years ago - Stars: 2 - Forks: 0

1x-eng/chart_data_extractor

This webservice will help scrape data out of chart(s) presented on any given website. (At this moment, I only support scrape from HighCharts and AmCharts. Other libraries, maybe next time).

Language: Python - Size: 77.1 KB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 8 - Forks: 9

lukluk/scraper-engine

Async Scraper Framework Based Nodejs

Language: JavaScript - Size: 2.85 MB - Last synced: 1 day ago - Pushed: almost 8 years ago - Stars: 11 - Forks: 7

animeshkundu/pyscrape

Lightweight headless web scraper with javascript rendering in python with http api

Language: Python - Size: 9.77 KB - Last synced: about 16 hours ago - Pushed: over 7 years ago - Stars: 4 - Forks: 0

fazxid/shopee-product-scraper

Scrape Data & Images From Marketplace Shopee

Language: JavaScript - Size: 17.6 KB - Last synced: 12 months ago - Pushed: about 3 years ago - Stars: 6 - Forks: 1

warifp/Shopee-Scrape

Shopee Scrape is a tool that functions to collect data - the data needed, such as finding data from photos, prices, names, store locations and others.

Language: PHP - Size: 559 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 68 - Forks: 27

fernandod1/ProductHunt-scraper

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

Language: Python - Size: 9.77 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 12 - Forks: 7

MrSentex/0day.today-API

Unofficial API for 0day.today database | Supported languages: Python and PHP

Language: PHP - Size: 17 MB - Last synced: 11 months ago - Pushed: over 4 years ago - Stars: 11 - Forks: 8

techieforfun/web-scraper

:microscope: Scraper for the web

Language: PHP - Size: 261 KB - Last synced: about 1 year ago - Pushed: about 4 years ago - Stars: 4 - Forks: 0

dasileker/scraper_project

This project is a capstone project for the Microverse program Ruby, it's a scraper code that searches any torrent name you input.

Language: Ruby - Size: 22.1 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 1 - Forks: 0

Machine-Learning-Labs/GathererImageGatherer Fork of devonmurphy/GathererImageGatherer

Builds a database of Magic the Gathering card images with card name, set, and perceptual hash of artwork.

Language: Python - Size: 18.7 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

vreddi/DotaScraper

🚽 Scraper for Dota

Language: C# - Size: 133 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

seralexger/filmaffinity-scraper

Unofficial class for scrap and recollect info from Filmmaffinity

Language: Python - Size: 14.6 KB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 0 - Forks: 2