lvxhnat/pyetfdb-scraper

Scrape ETF data for free - a python wrapper for scraping ETFDB

Language: Python - Size: 174 KB - Last synced: 4 days ago - Pushed: 5 days ago - Stars: 32 - Forks: 1

ahmadrafidev/jobs-scraper-backend

backend-side of the jobs listing app

Language: Python - Size: 10.9 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 0 - Forks: 0

Jimut123/Scrapers

All Scrapers that I'll build

Language: JavaScript - Size: 5.11 MB - Last synced: 7 days ago - Pushed: about 5 years ago - Stars: 2 - Forks: 0

SilentDemonSD/FZBypassBot

A Elegant Fast Multi Threaded Bypass Bot for Bigger Deeds. Try Now !!

Language: Python - Size: 281 KB - Last synced: 10 days ago - Pushed: 10 days ago - Stars: 65 - Forks: 145

palewire/studs-terkel-podcast

Selections from the WFMT collection of Terkel’s radio interviews, delivered each Friday

Language: HTML - Size: 56.9 MB - Last synced: 16 days ago - Pushed: 17 days ago - Stars: 3 - Forks: 0

Fasteroid/chromium-console-scripts

Debugging scripts for chrome console.

Language: JavaScript - Size: 125 KB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 4 - Forks: 0

scrapehero-code/amazon-review-scraper

A basic python 3 based web scraper for extracting reviews from Amazon. Built using Selectorlib and requests

Language: Python - Size: 12.7 KB - Last synced: 20 days ago - Pushed: 3 months ago - Stars: 51 - Forks: 48

DiegoCaraballo/Email-extractor

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Language: Python - Size: 111 KB - Last synced: 15 days ago - Pushed: about 1 year ago - Stars: 174 - Forks: 71

angeljunior/instagram-scraper

Instagram scraper, with support for users, medias, tags, comments and locations. Proxified by Residential Proxies.

Language: PHP - Size: 26.4 KB - Last synced: 24 days ago - Pushed: about 3 years ago - Stars: 1 - Forks: 0

xbmc/repo-scrapers

Official source repository for Kodi scraper add-ons

Size: 12 MB - Last synced: 25 days ago - Pushed: 25 days ago - Stars: 47 - Forks: 79

oxylabs/Web-Scraping-With-Selenium

In this guide on how to web scrape with Selenium, we will be using Python 3. The code should work with any version of Python above 3.6

Language: Python - Size: 58.6 KB - Last synced: 26 days ago - Pushed: 26 days ago - Stars: 22 - Forks: 10

recommend-games/board-game-scraper

Board game data scraper

Language: Python - Size: 1.35 MB - Last synced: 16 days ago - Pushed: 3 months ago - Stars: 25 - Forks: 5

openstates/openstates-scrapers

source for Open States scrapers

Language: Python - Size: 29.5 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 833 - Forks: 456

normalset/novel-dl

A python script to automatically scrape and compress web novels into an Epub file for eReaders. Now with a working UI !

Language: Python - Size: 76.5 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 2 - Forks: 0

alltheplaces/alltheplaces

A set of spiders and scrapers to extract location information from places that post their location on the internet.

Language: Python - Size: 20.8 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 524 - Forks: 186

needmorecowbell/sniff-paste Fork of dmuhs/pastebin-scraper

Pastebin OSINT Harvester

Language: Python - Size: 232 KB - Last synced: 23 days ago - Pushed: about 5 years ago - Stars: 312 - Forks: 39

flulemon/sneakpeek

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

Language: Python - Size: 19.7 MB - Last synced: 26 days ago - Pushed: 9 months ago - Stars: 35 - Forks: 0

josephlimtech/linkedin-profile-scraper-api

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

Language: TypeScript - Size: 10.8 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 466 - Forks: 133

ShinChven/iris

Internet scraper

Language: TypeScript - Size: 213 KB - Last synced: about 2 months ago - Pushed: about 2 years ago - Stars: 1 - Forks: 0

rtunazzz/Craper

Collection of product scrapers for various websites.

Language: Python - Size: 726 KB - Last synced: 30 days ago - Pushed: almost 3 years ago - Stars: 15 - Forks: 3

amoudgl/short-jokes-dataset

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

Language: Python - Size: 33.7 MB - Last synced: 2 months ago - Pushed: over 3 years ago - Stars: 259 - Forks: 74

danitechid/scraper

Scraper for JSON & IMAGE API or WhatsApp Bot

Language: JavaScript - Size: 555 KB - Last synced: 8 days ago - Pushed: 8 months ago - Stars: 3 - Forks: 1

ArkaNiightt/scraper_vagas_bot

Este repositório contém um script para varrer um site específico em busca de vagas de emprego. O script coleta e organiza informações sobre oportunidades disponíveis neste site, facilitando a busca por emprego para os candidatos interessados. Os usuários podem personalizar a busca de acordo com suas preferências e qualificações específicas.

Language: Python - Size: 73.2 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 1 - Forks: 0

api-dojo/api-dojo

API Dojo is always ready for you. With 15+ years of experience, data acquisition and scraping is never been that easy. **Cheapest** prices with high availability.

Size: 256 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

bomzj/automation-tools-for-linkedin-and-emails

Automation tools for Linkedin and emails

Language: Python - Size: 67.4 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

stackblogger/link-meta-extractor

Link Meta Extractor. Extract Metadata from Http Links. Pass a url string and get all the available metadata in object.

Language: TypeScript - Size: 234 KB - Last synced: 21 days ago - Pushed: 6 months ago - Stars: 6 - Forks: 1

OpenByteDev/SourceScraper 📦

Simple library which helps you to retrieve the source of various video streaming sites.

Language: TypeScript - Size: 4.62 MB - Last synced: 24 days ago - Pushed: over 4 years ago - Stars: 65 - Forks: 19

shashwatah/instahunter

CLI OSINT app that can fetch data from Instagram's Web API without authentication.

Language: Python - Size: 1.28 MB - Last synced: 3 months ago - Pushed: 4 months ago - Stars: 51 - Forks: 8

NizarPirzada/RealEstateScraper

Multiple Scraping Techniques embedding Selenium and Web requests. Using Anti Captcha and Proxies. Scraps European Real Estate Listings

Language: Python - Size: 14.8 MB - Last synced: 20 days ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

philshem/gmaps_popular_times_scraper

Scraper for Google Maps "Popular Times" for place entries

Language: Python - Size: 30.3 KB - Last synced: 3 months ago - Pushed: almost 2 years ago - Stars: 73 - Forks: 21

AlexMathew/scrapple

A framework for creating semi-automatic web content extractors

Language: Python - Size: 1.13 MB - Last synced: 2 months ago - Pushed: 7 months ago - Stars: 494 - Forks: 41

crawlbase/proxycrawl-java 📦

ProxyCrawl Java library for scraping and crawling

Language: Java - Size: 13.7 KB - Last synced: 4 months ago - Pushed: 10 months ago - Stars: 4 - Forks: 0

999root/scrapers

webscrapers very good

Language: Python - Size: 19.5 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0

santhoshse7en/imdby

imdby is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies.

Language: Python - Size: 584 KB - Last synced: 1 day ago - Pushed: almost 4 years ago - Stars: 7 - Forks: 1

alash3al/scraply

Scraply a simple dom scraper to fetch information from any html based website

Language: Go - Size: 47.9 KB - Last synced: 2 months ago - Pushed: almost 2 years ago - Stars: 126 - Forks: 11

RealEstateWebTools/property_web_scraper

Web based UI to make scraping data from real estate websites super simple

Language: JavaScript - Size: 16.1 MB - Last synced: 4 months ago - Pushed: about 1 year ago - Stars: 76 - Forks: 19

vassilidev/fff-clubs

Just a simple scrapers to get all FFF Clubs

Language: JavaScript - Size: 2.21 MB - Last synced: 4 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0

xtream1101/scraperx

Library for scraping websites or apis at any scale

Language: Python - Size: 304 KB - Last synced: 11 days ago - Pushed: 3 months ago - Stars: 53 - Forks: 11

codercurious/indeed-scraper

Scrape indeed jobs and companies details including website, positions open, salary offered, etc.

Size: 98.6 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 3 - Forks: 0

rasmod/Simplaza-Scraper

A simple scraper for Simplaza to archive torrents incase the site goes down some day

Language: Python - Size: 9.77 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0

mariazevedo88/imdb-scraper

IMDB webscraper with Request-Promise, Cheerio and Nightmare.js

Language: JavaScript - Size: 1.09 MB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 6 - Forks: 1

muhamed-didovic/ccdown

Scraper and downloader for codecourse.com

Language: JavaScript - Size: 2.07 MB - Last synced: 5 days ago - Pushed: 3 months ago - Stars: 8 - Forks: 2

Berkanktk/StockChecker

A simple stock checker made in selenium with Python.

Language: Python - Size: 7.81 KB - Last synced: 16 days ago - Pushed: almost 2 years ago - Stars: 1 - Forks: 1

Antheta/falcon-php

🌎 An intermediary for web scrapers with built-in parsers.

Language: PHP - Size: 541 KB - Last synced: about 2 months ago - Pushed: 6 months ago - Stars: 0 - Forks: 0

salemandreus/web-scrapers

Minimalistic python scrapers that perform a very basic scraping function. Utilizes Python 3.12.

Language: Python - Size: 8.79 KB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 1 - Forks: 0

audiomnia/audiomnia

A global bioacoustics map featuring birds and marina megafauna

Language: Python - Size: 12.8 MB - Last synced: 14 days ago - Pushed: over 1 year ago - Stars: 7 - Forks: 1

Austerius/CybBet-scrapers

Scrapy and BeautifulSoup based scripts for scraping e-sport betting data from CybBet.com site

Language: Python - Size: 3.91 KB - Last synced: 7 months ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0

robertciotoiu/fundanl-home-alert

Sends notifications when new apartments are available on Funda.nl for a given search.

Language: Java - Size: 97.7 KB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 0 - Forks: 0

sup-Udh/Scraper-io

📈 A visual & terminal based web scraper

Language: TypeScript - Size: 210 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 37 - Forks: 4

crawlbase/proxycrawl-php 📦

ProxyCrawl PHP library for scraping and crawling websites

Language: PHP - Size: 34.2 KB - Last synced: 23 days ago - Pushed: 11 months ago - Stars: 19 - Forks: 5

Vitcesar/plugin.video.anitube

Add-on para AniTube, famoso site que ofereceu uma gigantesca biblioteca de animes para assistir online e de graça.

Language: Python - Size: 17 MB - Last synced: 2 months ago - Pushed: almost 5 years ago - Stars: 7 - Forks: 3

TheAdnan/sunnah-com-scraper

Hadith scraper from sunnah.com

Language: Python - Size: 1000 Bytes - Last synced: 9 months ago - Pushed: over 7 years ago - Stars: 0 - Forks: 1

TheAdnan/Memebase-Image-Scraper

Python script for downloading images from Memebase

Language: Python - Size: 1000 Bytes - Last synced: 9 months ago - Pushed: over 7 years ago - Stars: 2 - Forks: 1

TheAdnan/ImgurDescScrapper

Language: Python - Size: 2.93 KB - Last synced: 9 months ago - Pushed: over 7 years ago - Stars: 0 - Forks: 0

alexcamargos/ZapImoveisScraper

A scraper that gathers data from Zap Imóveis website using BeautifulSoup.

Language: Python - Size: 46.9 KB - Last synced: 9 months ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

crawlbase/proxycrawl-node 📦

ProxyCrawl Node library for scraping and crawling

Language: JavaScript - Size: 91.8 KB - Last synced: 3 months ago - Pushed: 11 months ago - Stars: 21 - Forks: 5

ezramizrahi/banshee

telegram bot that lets me know what movies are playing at my local cinema today.

Language: JavaScript - Size: 1 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0

nstevens1040/PSTwitter-Media-Scraper

PowerShell script used to scrape media off of Twitter

Language: PowerShell - Size: 56 MB - Last synced: 10 months ago - Pushed: over 3 years ago - Stars: 1 - Forks: 0

patgdut/GoogleMapsScraper

By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.

Size: 4.88 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

SevenworksDev/GDProxy

Geometry Dash Proxy with some stupid useless configuration.

Language: PHP - Size: 32.2 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 2 - Forks: 0

omardelarosa/pitchfork-npm

An Unofficial Pitchfork Music API client for Node.js

Language: JavaScript - Size: 48.8 KB - Last synced: 22 days ago - Pushed: about 6 years ago - Stars: 49 - Forks: 7

shallvhack/The-Hacker-News-Scraper

Automate Hacker News updates. Scrape thehackernews.com and send real-time articles to your Discord channel.😀

Language: Python - Size: 5.86 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 1 - Forks: 1

RomeroRodriguezD/AmaPress-Amazon-vs-AliExpress-Scraper

Prices comparator between Amazon and AliExpress, based on keywords.

Language: Python - Size: 8.45 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0

yuis-ice/jseval

Evaluate JavaScript on a URL through headless Chrome browser.

Language: JavaScript - Size: 2.93 KB - Last synced: 6 months ago - Pushed: almost 3 years ago - Stars: 22 - Forks: 1

robertciotoiu/mobile-de-car-data-collector

Crawl, scrape and persist Mobile.de car listings data in a smart & responsible way

Language: Java - Size: 515 KB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 4 - Forks: 1

GeeKboy2/EVE-Online_deals_finder-web-scraping-

This repository will have different deal finders for EVE Online, offering players ways to discover in-game opportunities like finding rare items, resources and trade routes. With multiple options available, players can optimize their gameplay and achieve their goals.

Language: Python - Size: 68.4 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

luevano/mangal-scrapers Fork of NotPhantomX/mangal-scrapers

A collection of custom scrapers for mangal.

Language: Lua - Size: 30.3 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 0 - Forks: 0

iluxonchik/olx-phone-number-scraper

OLX phone number scraper scrapes phone numbers from OLX listings.

Language: HTML - Size: 81.1 KB - Last synced: 11 months ago - Pushed: over 6 years ago - Stars: 5 - Forks: 3

mariazevedo88/airbnb-scraper

Web scraper/crawler of Airbnb Brazilians page

Language: JavaScript - Size: 1.53 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 7 - Forks: 0

Redrrx/WikimediaScrap

This is a Python script that can be used to scrape large amounts of images from Wikimedia Commons using a keyword

Language: Python - Size: 14.6 KB - Last synced: 24 days ago - Pushed: about 1 year ago - Stars: 2 - Forks: 0

Restuta/little-scraper

🚂 Little Node Scraper That Could. With simple, but powerful async flow control goodness.

Language: JavaScript - Size: 849 KB - Last synced: about 1 month ago - Pushed: over 1 year ago - Stars: 3 - Forks: 2

BloodyToolzz/GPT-Proxy-Scraper

Fully ChatGPT written proxy scraper.

Language: Python - Size: 2.93 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 3 - Forks: 0

breck7/truecrawler

Crawlers for extracting data from the web for TrueBases.

Language: TypeScript - Size: 163 KB - Last synced: about 1 month ago - Pushed: about 1 year ago - Stars: 4 - Forks: 0

sallamy2580/python-web-scrapping

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Language: Python - Size: 1.56 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 8 - Forks: 0

thedarkkid/awoof-laravel

Awoof, a price comparison website built with Laravel to scrape electronic products from Nigerian E-commerce stores.

Language: HTML - Size: 19.3 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 3 - Forks: 2

kadnan/airflow-scraping

Using Apache Airflow to schedule web scrapers

Language: Python - Size: 28.3 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 38 - Forks: 11

thomaspaulin/snc-scraper 📦

Scraping the Auckland SNC Hockey website one symbol at a time. (http://www.aucklandsnchockey.com)

Language: Python - Size: 132 KB - Last synced: about 1 month ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

Seng-Jik/QwQ 📦

Anime Wallpaper Downloader.

Language: F# - Size: 226 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 7 - Forks: 0

sidharthrajaram/scrapers

Simple tutorials for web scraping in Python

Language: Python - Size: 36 MB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 3 - Forks: 3

paulpierre/twig

twig.py - a twitter web3 influencer truffle pig used for finding engaged users

Language: Python - Size: 440 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 1

AgentANAKIN/Google-Web-Scraper

This Python code scrapes Google search results then applies sentiment analysis, generates text summaries, and ranks keywords.

Language: Python - Size: 5.86 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 18 - Forks: 7

asimpson/nodejs-web-scraper-cookbook

📝 Resources for web scraping with node.js

Size: 4.88 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 31 - Forks: 1

paddyjclancy/spotify_scraper

Web scraper application integrated with Spotify For Developer API. Project aims to provide user with track data from any given playlist URI (personal project).

Language: Python - Size: 1.56 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 3 - Forks: 0

sasivatsal7122/GitHubScraper

Language: Jupyter Notebook - Size: 3.91 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

freelancerwebro/scraping-with-Guzzle

Practice scraping techniques with Guzzle framework and DomCrawler

Language: PHP - Size: 755 KB - Last synced: 3 months ago - Pushed: over 6 years ago - Stars: 4 - Forks: 2

Yuri-Neko/Shiori-Multi-Device

By Kyouka Official & ZaBot-MD

Language: JavaScript - Size: 21.5 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 4 - Forks: 1

octoparse/Scraping-YouTube

Scrape Data from YouTube

Size: 27.3 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 7 - Forks: 0

jamesbower/Reddit-Scraper

Reddit Scraper is a Python script that utilizies the PRAW Python library to interact with Reddit's API.

Language: Python - Size: 5.86 KB - Last synced: about 1 year ago - Pushed: over 6 years ago - Stars: 12 - Forks: 1

atwright147/scraper-tsb

Use Google Puppeteer to access and scrape account data from your TSB account.

Language: JavaScript - Size: 17.6 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 1 - Forks: 0

naveengerold/news_Scraper

This a scraper which can be used to scrap data from News websites.

Language: Python - Size: 365 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 1

jvidalv/python-scrapers

Python scrapers for all my apps

Language: Python - Size: 3.89 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

mariazevedo88/reddit-scraper

Web scraper/crawler of Reddit page

Language: JavaScript - Size: 1.18 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 5 - Forks: 1

xdlyy404/databasee

kopel_

Size: 23.4 KB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 1 - Forks: 1

info3g/Faceboo-page-post-comments-scrapper

Facebook Page posts comments scrapper is Facebook graph API based tools which extract all your Facebook data into convertable excel format

Language: Python - Size: 57.6 KB - Last synced: about 1 year ago - Pushed: almost 5 years ago - Stars: 2 - Forks: 1

FoxInFlame/matomari

Unofficial MAL API.

Language: PHP - Size: 2.8 MB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 12 - Forks: 0

anotender/generic-scraper

Generic scraper is a library that gives a possibility to scrap the HTML website data into the POJO object

Language: Java - Size: 52.7 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

ntaheij/prntsc_scraper

prnt.sc website scraper made with Python.

Language: Python - Size: 99.6 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

jerdude/biz-status-api

Site scraper used to validate a business name and address against Google Places.

Language: C# - Size: 1.54 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 2 - Forks: 0

LABHDUFBA/anpuh-scraper Fork of ericbrasiln/anpuh-scraper

Raspador dos Resumos dos Simpósios Anuais da História da Anpuh (2013-2021)

Language: Python - Size: 33.3 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 2 - Forks: 0

minarc/watcha-scraper

🎬 와챠(Watch) 평점 스크래핑

Language: Python - Size: 749 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 0 - Forks: 0