GitHub topics: web-scrapper
adrijshikhar/scraper-ql
This is a web scrapper based on the recursive feature of GraphQL
Language: TypeScript - Size: 1.01 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

narkhedesam/Proxy-List-Scrapper
Proxy List Scrapper
Language: Python - Size: 526 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 101 - Forks: 19

Ziel88/Web-Scraper-for-E-commerce
A Python-based scraper for collecting product data from e-commerce sites.
Size: 1000 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

siddheshrm/StalkStock
Effortlessly track product availability and stay updated with email alerts. Built with PHP, MySQL, and cURL for web scraping, StalkStock automates product tracking on popular e-commerce platforms like Amazon, Tata Cliq, and more. Supports guest and registered user roles, secure password recovery, CAPTCHA validation, and responsive design.
Language: PHP - Size: 1.1 MB - Last synced at: 15 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

ujen5173/airbnb-clone
Airbnb clone using Nextjs. It has some exciting custom functions / libraries you need to explore. It has awesome animations, and also has a custom date picker. For maps i have used react-leaflet. Do not forget to visit the live demo. Though it is not a full stack but its worth to explore :)
Language: JavaScript - Size: 69.6 MB - Last synced at: 18 days ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 3

JatinAgrawal0/Web_Scrapper
Web Text Scraper empowers users to effortlessly extract text elements from web pages with advanced customization options. Its robust error handling ensures a smooth scraping process, enabling efficient data gathering with a human-friendly interface.
Language: Python - Size: 13.7 KB - Last synced at: 22 days ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 0

HouGroup/mdgo
A codebase for classical molecular dynamics (MD) simulation setup and results analysis.
Language: Python - Size: 40.1 MB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 24 - Forks: 17

Abidsyed25/ScrapQuest
ScrapQuest is your go-to solution for effortlessly extracting data from websites. It's a powerful web scraper built with Next.js, TypeScript, and Puppeteer with Browserless. With ScrapQuest, you can quickly gather valuable information from any website without hassle.
Language: TypeScript - Size: 707 KB - Last synced at: 1 day ago - Pushed at: 8 months ago - Stars: 19 - Forks: 37

amarlearning/InternetBots
:part_alternation_mark: Internet bots and web scrappers that will save a lot of your time!
Language: Python - Size: 12.7 KB - Last synced at: 10 days ago - Pushed at: over 7 years ago - Stars: 7 - Forks: 3

krishpranav/InstaInfo
A simple python tool for getting a information about a instagram user
Language: Python - Size: 15.6 KB - Last synced at: 7 days ago - Pushed at: over 4 years ago - Stars: 8 - Forks: 5

yakuza8/coronavirus-timeseries-predictor
Timeseries analyzer for coronavirus with recurrent neural network
Language: Python - Size: 121 KB - Last synced at: 12 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 2

Valda1/web_scaper
Web scraper in PHP
Language: PHP - Size: 1.95 KB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

LGUCC/medicine-crawler Fork of zain-ul-din-zafar/medicine-crawler
A crawler to scrap all data from dawaai.pk. Used by me in my FYP.
Language: TypeScript - Size: 34.8 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

BenSFGamer/Meta-Web-Scraper
A web scraper
Size: 2.93 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

ibenlems/JobNotifier
Automated jobs web scrapping using Python
Language: Python - Size: 340 KB - Last synced at: 11 months ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 0

HayatiYrtgl/wiki_art_crap
Asynchronous web scraper for downloading painting images.
Size: 40.7 MB - Last synced at: 13 days ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

voiceinthedark/webscrapper_python
Web scrapper
Language: Python - Size: 19.5 KB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

LawrenceQuarshie/DataScience
This is a repository of plotting, charting, data visualization, manipulation, analytics and anything about data in typical engineering setting.
Language: HTML - Size: 3.91 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

marekdano/nodejs-email-server
Email nodeJS server which send an email when something is "change" on an observe website.
Language: JavaScript - Size: 133 KB - Last synced at: about 1 year ago - Pushed at: over 9 years ago - Stars: 1 - Forks: 0

KnowledgeNerd/rust_web_scrapper
My playing around with a Rust Web Scrapper
Language: Rust - Size: 20.5 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

DanielArian/JuniaPocket-API
API de l'application JuniaPocket
Language: JavaScript - Size: 339 KB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0

gentildpinto/rails-web-scrapper 📦
O Rails WEB SCRAPER é um projeto com a finalidade de extrair dados de filmes do site YIFY Torrents - YTS.
Language: Ruby - Size: 89.8 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 1

unproducts/magzyne
News aggregator meta framework. ✌️
Language: TypeScript - Size: 1000 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

nitishabharathi/Google-Maps-Review-Scraper
Web scrapper that scraps reviews based on a place ID
Language: Python - Size: 41 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 11 - Forks: 7

knifecake/labseps
A tool to check which labs are available at EPS@UAM.
Language: Python - Size: 22.5 KB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

karabirkan/pricehistory
🔥 "Price History Tracker": Seamlessly monitor and analyze the price history of Amazon products. Your go-to tool for tracking and understanding price fluctuations over time!
Language: TypeScript - Size: 2.89 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Polytech-Paris-Saclay/polytech-discord-bot
Bot pour le Discord Polytech Paris-Saclay | Scrapper des notes sur Oasis (profil étudiant) et alerte pour les nouvelles via un bot Discord
Language: Python - Size: 222 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

rocktimsaikia/page-scrapper
:package: node.js scrapper that pulls out all links and images of a given site.
Language: JavaScript - Size: 161 KB - Last synced at: 7 days ago - Pushed at: about 4 years ago - Stars: 12 - Forks: 1

duhizjame/pjn_scrapper
simple web scrapper for Serbian public purchases site
Language: Python - Size: 260 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

HybridShivam/Pokemon
The highest quality Pokemon Images and Assets.
Language: Python - Size: 1.32 GB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 137 - Forks: 40

Abhisheks-Workspace/ShopCrawler
developed a dynamic ReactJS application that seamlessly scraped and displayed real-time data from various e-commerce stores, revolutionizing online shopping by providing users with up-to-the-minute product information and pricing from multiple sources in one place.
Language: JavaScript - Size: 298 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

e-hengirmen/metu-NTE-scraper
Language: Python - Size: 7.22 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 3

delineas/podcast-ranking-web-scraping
#desafíoPython https://www.danielprimo.io/blog/web-scrapping-con-python-primeros-pasos-desafiopython
Language: HTML - Size: 134 KB - Last synced at: 11 months ago - Pushed at: over 6 years ago - Stars: 5 - Forks: 3

EstebanMqz/Web-scrapper
HTML HTTP GET requests for dynamic/client-sided web-scrapping purposes other than traditional static caching protocols.
Language: HTML - Size: 947 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

opportus/web-scraper
A web scraper taking as arguments a list of URLs and a list of XPath queries to perform on each document. Returns an instance of DataInterface.
Language: PHP - Size: 11.7 KB - Last synced at: about 2 months ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

AadiJo/Web-Scraper
Language: Python - Size: 1000 Bytes - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

TalhaFarook/WebDiver
WebDiver: Delving Deep into the Web to Uncover and Extract Data
Language: Python - Size: 13 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

tarikyayla/mangareaderlib 📦
Up to date online manga scrapper with export as JSON option.
Language: Python - Size: 1.45 MB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

HRN-Projects/AVA---Accessibility-Virtual-Assistant
It is an open source accessibility tool created for better usability and interactivity with you computer system using just voice commands. It is a two way communicating virtual assistant developed in python. It is currently under development.
Language: Python - Size: 8.08 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 7

abdus/scrape-web
A simple web scrapper for Node.js
Language: JavaScript - Size: 25.4 KB - Last synced at: 27 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

ammarfaizi2/newsScraper
News Scraper
Language: PHP - Size: 991 KB - Last synced at: 8 days ago - Pushed at: almost 6 years ago - Stars: 8 - Forks: 1

shayan-azizi/TV-Show-Downloader
I was a little lazy in downloading the series I wanted. So I made it automatic.
Language: Python - Size: 85 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 0

Dana299/FullStats
Language: Python - Size: 25.4 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

aosousa/go-hltb-lookup
CMD Tool to look up game play time data through scraping the How Long to Beat website.
Language: Go - Size: 6.84 KB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

h26k2/node-gui-scraper
A GUI Based Web-Scraper for scraping e-commerce website using NodeJS
Language: JavaScript - Size: 151 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 2

tlemenestrel/Mining_Food_Supply_Chain_Data
A multi-threaded Web Scraper to mine 1M+ food supply chain data points using Beautiful Soup and pandas in Python.
Language: Jupyter Notebook - Size: 11 MB - Last synced at: 5 months ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 1

ReaperZ0v/csgo-stats-scraper
A web scraper coded in python for scraping the gaming stats for counter strike global offensive (CSGO) and exporting to CSV
Language: Python - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 1

dumebi/scrapper
Web scrapper in nodejs
Language: JavaScript - Size: 2.57 MB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

dialex/WebDataFetcher 📦
Fetches data from the web
Language: Java - Size: 34.4 MB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

hex-plex/DFSites 📦
This is tool help full in webscrapping
Language: Python - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

TerranKartikTellus/Web-Scraping
All about scraping domains from the 'World Wide Web'
Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

Lakshay-Dhingra/Criagslist-Scrapper
A Full-Stack Responsive Website that displays and allows to search for classified ads from criagslist.org with an attractive and user friendly UI.
Language: Python - Size: 1.89 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

hritikbhandari/Online-Courses-Dataset
A web scrapping project to extract the course details from various online course providing websites.
Language: Python - Size: 181 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 5 - Forks: 3

slopezpereyra/puppy-adopter
A program that automatically downloads images from a customizable list of websites on multiple independent galeries.
Language: Python - Size: 205 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 1

rishabhmanu/Web-Scrapping
A Web-Scrapping script
Language: Python - Size: 1000 Bytes - Last synced at: about 2 years ago - Pushed at: almost 8 years ago - Stars: 1 - Forks: 1

scrape-do/scrape.do-dotnet-example
Best Rotating Proxy & Scraping API Alternative. C# Example.
Language: C# - Size: 15.6 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 0

duttong/postal-history.com-web-scrapper
Simple web scrapper to find postal history items for auction at http://www.postal-history.com/
Language: Jupyter Notebook - Size: 19.5 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 1

SON-OF-EDDY/GPU_Prices_Webscraper
Scrapes cheapest GPU prices from 'NewEgg.com'
Language: Python - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

narkhedesam/python-sample Fork of scrape-do/python-sample
Best Rotating Proxy & Scraping API Alternative
Language: Python - Size: 123 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 0

CoodingPenguin/remote-work-crawler
✂️ Remote Developer Recruitment Crawler with Python, Beautifulsoup4
Language: Python - Size: 159 KB - Last synced at: 27 days ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

aquib-sh/ImageScrapper
scrape and download 35 images with one key press... !
Language: Python - Size: 7.76 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

aditipolkam/sih-web-scrapper
a simple web scrapper to scrape all the problem statements available on the SIH portal for SIH2022
Language: Python - Size: 172 KB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

alirezaeftekhari/Search-Tree
Simultaneous search on three search engines Google, Bing and Yahoo
Language: PHP - Size: 1.53 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 0

intezzz/Jnet-Scrapper
A calendar that compiles artists' schedules from Johnny's Association, through web scrapping.
Language: Python - Size: 36.1 KB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

Upasanadhameliya/Advocate-Scrape-Selenium
Scraping websites using selenium python. The lawyers websites would get scraped by using Chrome Webdriver along with Windows OS
Language: Python - Size: 25.4 KB - Last synced at: about 2 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

kodegrenade/web-scraper
A web scraper application
Language: JavaScript - Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

ieferrari/selenium-scrapper-and-pipeline-to-db
Web Scrapper of tourist accommodation price data, and a pipeline to database-storage.
Language: Jupyter Notebook - Size: 36.1 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

Sowmik23/Data-Science
This repository contains Data Science assignments and lab works specially web scrapting like extract data from github repositories or extract data from a weather website and processing the data in pandas and analysis by making plot or graph of the data. These tasks are really interesting.
Language: Python - Size: 24.7 MB - Last synced at: about 2 years ago - Pushed at: about 5 years ago - Stars: 2 - Forks: 0

8Bts/Web-Scrapper
This project is about scraping a website that is listing the IP addresses of game servers. The application parses IP addresses from the web page and outputs them sorted by Ping. Built with Ruby
Language: Ruby - Size: 65.4 KB - Last synced at: 19 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

Si0n/web-parser
Web parser (Getting unique urls from given link with leveling)
Language: PHP - Size: 21.5 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

projjal1/Youtube_video_downloader
This is a web scrapper tool that downloads Youtube .mp4 and .mp3 files in highest possible resolution. This can download entire channel, playlist and individual content.
Language: Python - Size: 21.9 MB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

andgom97/GDS
A python web scraper to get the desired videogame prices and highlight the discounted ones
Language: Python - Size: 172 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

antv199/enjin-store-bot
This is a Web Scrapper written in Python that tries to replace the DonationCraft method of getting user purchases
Language: Python - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

ttavni/PyWebScraper
A set of functions and classes to help web scraping and simple web audits
Language: Python - Size: 45.6 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

johnnyqdp/steam_achievements
Sistema de scraping para carregar em tempo real todos os achievements de um usuário Steam em uma página só. Back-end em PHP, Front-end com jQuery.
Language: JavaScript - Size: 1.21 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

ShreyasSubhedar/Codechef-BOT
Codechef BOT:- It is a web scrapper which scrap the requested user's recent activity on codechef in just single click.
Language: Python - Size: 3.76 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

Siddharthsuresh92/YouTube-viral-trends-COVID
An analysis of trending videos across the world during a pandemic
Language: Jupyter Notebook - Size: 5.94 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

d-sanderson/rick-and-morty-quote-scrapper
web scrapper for rick and morty quotes
Language: JavaScript - Size: 180 KB - Last synced at: 30 days ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

itsayushthada/Scrappers
Small Python scripts for scrapping the data from various sources like Twitter.
Language: Jupyter Notebook - Size: 114 KB - Last synced at: almost 2 years ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 0

general-labs/News-and-Weather
News and weather feed based on Serverless NodeJs 10 (AWS stack).
Language: JavaScript - Size: 606 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

jpsarkar/Android_appcrawl_from_google_play_store
Written in Python using web crawling of google play store to get app category
Language: Python - Size: 7.81 KB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 1

DaneDupont/PoE-WebScraper
This is a simple web-scraper using Python, BeautifulSoup, and Numpy for market analysis of poe.trade
Size: 3.91 KB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

BlueSquid1/Account-hunter
Language: TypeScript - Size: 115 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

ozluy/web-scrapping-with-python
Web scrapping with python and writing to excel
Language: Python - Size: 130 KB - Last synced at: 2 months ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

mihirbhatia999/dcmme
Language: Python - Size: 92.8 KB - Last synced at: 8 months ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

DahlitzFlorian/R-web-scraper
A small web scraper to get the latest articles of a given topic from Techcrunch.com
Language: R - Size: 1000 Bytes - Last synced at: about 2 months ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

mihirbhatia999/Web-scrapping Fork of D4pika/Web-scraping
Scrapper for WHIN
Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 8 months ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

salif-04/WallHaven-Scrapper
A web scrapper that downloads a random wallpaer of the given tag from https://alpha.wallhaven.cc/
Language: Python - Size: 598 KB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

jonathansamines/node-asp-scrapper
A little tool for manging web scrapping of asp web forms applications.
Language: JavaScript - Size: 97.7 KB - Last synced at: about 2 years ago - Pushed at: almost 10 years ago - Stars: 1 - Forks: 0

shrinivas93/web-scrapper
Language: Java - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: about 8 years ago - Stars: 0 - Forks: 0
