An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: web-scrapper

adrijshikhar/scraper-ql

This is a web scrapper based on the recursive feature of GraphQL

Language: TypeScript - Size: 1.01 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

narkhedesam/Proxy-List-Scrapper

Proxy List Scrapper

Language: Python - Size: 526 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 101 - Forks: 19

Ziel88/Web-Scraper-for-E-commerce

A Python-based scraper for collecting product data from e-commerce sites.

Size: 1000 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

siddheshrm/StalkStock

Effortlessly track product availability and stay updated with email alerts. Built with PHP, MySQL, and cURL for web scraping, StalkStock automates product tracking on popular e-commerce platforms like Amazon, Tata Cliq, and more. Supports guest and registered user roles, secure password recovery, CAPTCHA validation, and responsive design.

Language: PHP - Size: 1.1 MB - Last synced at: 15 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

ujen5173/airbnb-clone

Airbnb clone using Nextjs. It has some exciting custom functions / libraries you need to explore. It has awesome animations, and also has a custom date picker. For maps i have used react-leaflet. Do not forget to visit the live demo. Though it is not a full stack but its worth to explore :)

Language: JavaScript - Size: 69.6 MB - Last synced at: 18 days ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 3

JatinAgrawal0/Web_Scrapper

Web Text Scraper empowers users to effortlessly extract text elements from web pages with advanced customization options. Its robust error handling ensures a smooth scraping process, enabling efficient data gathering with a human-friendly interface.

Language: Python - Size: 13.7 KB - Last synced at: 22 days ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 0

HouGroup/mdgo

A codebase for classical molecular dynamics (MD) simulation setup and results analysis.

Language: Python - Size: 40.1 MB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 24 - Forks: 17

Abidsyed25/ScrapQuest

ScrapQuest is your go-to solution for effortlessly extracting data from websites. It's a powerful web scraper built with Next.js, TypeScript, and Puppeteer with Browserless. With ScrapQuest, you can quickly gather valuable information from any website without hassle.

Language: TypeScript - Size: 707 KB - Last synced at: 1 day ago - Pushed at: 8 months ago - Stars: 19 - Forks: 37

amarlearning/InternetBots

:part_alternation_mark: Internet bots and web scrappers that will save a lot of your time!

Language: Python - Size: 12.7 KB - Last synced at: 10 days ago - Pushed at: over 7 years ago - Stars: 7 - Forks: 3

krishpranav/InstaInfo

A simple python tool for getting a information about a instagram user

Language: Python - Size: 15.6 KB - Last synced at: 7 days ago - Pushed at: over 4 years ago - Stars: 8 - Forks: 5

yakuza8/coronavirus-timeseries-predictor

Timeseries analyzer for coronavirus with recurrent neural network

Language: Python - Size: 121 KB - Last synced at: 12 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 2

Valda1/web_scaper

Web scraper in PHP

Language: PHP - Size: 1.95 KB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

LGUCC/medicine-crawler Fork of zain-ul-din-zafar/medicine-crawler

A crawler to scrap all data from dawaai.pk. Used by me in my FYP.

Language: TypeScript - Size: 34.8 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

BenSFGamer/Meta-Web-Scraper

A web scraper

Size: 2.93 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

ibenlems/JobNotifier

Automated jobs web scrapping using Python

Language: Python - Size: 340 KB - Last synced at: 11 months ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 0

HayatiYrtgl/wiki_art_crap

Asynchronous web scraper for downloading painting images.

Size: 40.7 MB - Last synced at: 13 days ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

voiceinthedark/webscrapper_python

Web scrapper

Language: Python - Size: 19.5 KB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

LawrenceQuarshie/DataScience

This is a repository of plotting, charting, data visualization, manipulation, analytics and anything about data in typical engineering setting.

Language: HTML - Size: 3.91 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

marekdano/nodejs-email-server

Email nodeJS server which send an email when something is "change" on an observe website.

Language: JavaScript - Size: 133 KB - Last synced at: about 1 year ago - Pushed at: over 9 years ago - Stars: 1 - Forks: 0

KnowledgeNerd/rust_web_scrapper

My playing around with a Rust Web Scrapper

Language: Rust - Size: 20.5 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

DanielArian/JuniaPocket-API

API de l'application JuniaPocket

Language: JavaScript - Size: 339 KB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0

gentildpinto/rails-web-scrapper 📦

O Rails WEB SCRAPER é um projeto com a finalidade de extrair dados de filmes do site YIFY Torrents - YTS.

Language: Ruby - Size: 89.8 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 1

unproducts/magzyne

News aggregator meta framework. ✌️

Language: TypeScript - Size: 1000 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

nitishabharathi/Google-Maps-Review-Scraper

Web scrapper that scraps reviews based on a place ID

Language: Python - Size: 41 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 11 - Forks: 7

knifecake/labseps

A tool to check which labs are available at EPS@UAM.

Language: Python - Size: 22.5 KB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

karabirkan/pricehistory

🔥 "Price History Tracker": Seamlessly monitor and analyze the price history of Amazon products. Your go-to tool for tracking and understanding price fluctuations over time!

Language: TypeScript - Size: 2.89 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Polytech-Paris-Saclay/polytech-discord-bot

Bot pour le Discord Polytech Paris-Saclay | Scrapper des notes sur Oasis (profil étudiant) et alerte pour les nouvelles via un bot Discord

Language: Python - Size: 222 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

rocktimsaikia/page-scrapper

:package: node.js scrapper that pulls out all links and images of a given site.

Language: JavaScript - Size: 161 KB - Last synced at: 7 days ago - Pushed at: about 4 years ago - Stars: 12 - Forks: 1

duhizjame/pjn_scrapper

simple web scrapper for Serbian public purchases site

Language: Python - Size: 260 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

HybridShivam/Pokemon

The highest quality Pokemon Images and Assets.

Language: Python - Size: 1.32 GB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 137 - Forks: 40

Abhisheks-Workspace/ShopCrawler

developed a dynamic ReactJS application that seamlessly scraped and displayed real-time data from various e-commerce stores, revolutionizing online shopping by providing users with up-to-the-minute product information and pricing from multiple sources in one place.

Language: JavaScript - Size: 298 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

e-hengirmen/metu-NTE-scraper

Language: Python - Size: 7.22 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 3

delineas/podcast-ranking-web-scraping

#desafíoPython https://www.danielprimo.io/blog/web-scrapping-con-python-primeros-pasos-desafiopython

Language: HTML - Size: 134 KB - Last synced at: 11 months ago - Pushed at: over 6 years ago - Stars: 5 - Forks: 3

EstebanMqz/Web-scrapper

HTML HTTP GET requests for dynamic/client-sided web-scrapping purposes other than traditional static caching protocols.

Language: HTML - Size: 947 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

opportus/web-scraper

A web scraper taking as arguments a list of URLs and a list of XPath queries to perform on each document. Returns an instance of DataInterface.

Language: PHP - Size: 11.7 KB - Last synced at: about 2 months ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

AadiJo/Web-Scraper

Language: Python - Size: 1000 Bytes - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

TalhaFarook/WebDiver

WebDiver: Delving Deep into the Web to Uncover and Extract Data

Language: Python - Size: 13 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

tarikyayla/mangareaderlib 📦

Up to date online manga scrapper with export as JSON option.

Language: Python - Size: 1.45 MB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

HRN-Projects/AVA---Accessibility-Virtual-Assistant

It is an open source accessibility tool created for better usability and interactivity with you computer system using just voice commands. It is a two way communicating virtual assistant developed in python. It is currently under development.

Language: Python - Size: 8.08 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 7

abdus/scrape-web

A simple web scrapper for Node.js

Language: JavaScript - Size: 25.4 KB - Last synced at: 27 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

ammarfaizi2/newsScraper

News Scraper

Language: PHP - Size: 991 KB - Last synced at: 8 days ago - Pushed at: almost 6 years ago - Stars: 8 - Forks: 1

shayan-azizi/TV-Show-Downloader

I was a little lazy in downloading the series I wanted. So I made it automatic.

Language: Python - Size: 85 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 0

Dana299/FullStats

Language: Python - Size: 25.4 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

aosousa/go-hltb-lookup

CMD Tool to look up game play time data through scraping the How Long to Beat website.

Language: Go - Size: 6.84 KB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

h26k2/node-gui-scraper

A GUI Based Web-Scraper for scraping e-commerce website using NodeJS

Language: JavaScript - Size: 151 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 2

tlemenestrel/Mining_Food_Supply_Chain_Data

A multi-threaded Web Scraper to mine 1M+ food supply chain data points using Beautiful Soup and pandas in Python.

Language: Jupyter Notebook - Size: 11 MB - Last synced at: 5 months ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 1

ReaperZ0v/csgo-stats-scraper

A web scraper coded in python for scraping the gaming stats for counter strike global offensive (CSGO) and exporting to CSV

Language: Python - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 1

dumebi/scrapper

Web scrapper in nodejs

Language: JavaScript - Size: 2.57 MB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

dialex/WebDataFetcher 📦

Fetches data from the web

Language: Java - Size: 34.4 MB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

hex-plex/DFSites 📦

This is tool help full in webscrapping

Language: Python - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

TerranKartikTellus/Web-Scraping

All about scraping domains from the 'World Wide Web'

Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

Lakshay-Dhingra/Criagslist-Scrapper

A Full-Stack Responsive Website that displays and allows to search for classified ads from criagslist.org with an attractive and user friendly UI.

Language: Python - Size: 1.89 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

hritikbhandari/Online-Courses-Dataset

A web scrapping project to extract the course details from various online course providing websites.

Language: Python - Size: 181 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 5 - Forks: 3

slopezpereyra/puppy-adopter

A program that automatically downloads images from a customizable list of websites on multiple independent galeries.

Language: Python - Size: 205 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 1

rishabhmanu/Web-Scrapping

A Web-Scrapping script

Language: Python - Size: 1000 Bytes - Last synced at: about 2 years ago - Pushed at: almost 8 years ago - Stars: 1 - Forks: 1

scrape-do/scrape.do-dotnet-example

Best Rotating Proxy & Scraping API Alternative. C# Example.

Language: C# - Size: 15.6 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 0

duttong/postal-history.com-web-scrapper

Simple web scrapper to find postal history items for auction at http://www.postal-history.com/

Language: Jupyter Notebook - Size: 19.5 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 1

SON-OF-EDDY/GPU_Prices_Webscraper

Scrapes cheapest GPU prices from 'NewEgg.com'

Language: Python - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

narkhedesam/python-sample Fork of scrape-do/python-sample

Best Rotating Proxy & Scraping API Alternative

Language: Python - Size: 123 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 0

CoodingPenguin/remote-work-crawler

✂️ Remote Developer Recruitment Crawler with Python, Beautifulsoup4

Language: Python - Size: 159 KB - Last synced at: 27 days ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

aquib-sh/ImageScrapper

scrape and download 35 images with one key press... !

Language: Python - Size: 7.76 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

aditipolkam/sih-web-scrapper

a simple web scrapper to scrape all the problem statements available on the SIH portal for SIH2022

Language: Python - Size: 172 KB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

alirezaeftekhari/Search-Tree

Simultaneous search on three search engines Google, Bing and Yahoo

Language: PHP - Size: 1.53 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 0

intezzz/Jnet-Scrapper

A calendar that compiles artists' schedules from Johnny's Association, through web scrapping.

Language: Python - Size: 36.1 KB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

Upasanadhameliya/Advocate-Scrape-Selenium

Scraping websites using selenium python. The lawyers websites would get scraped by using Chrome Webdriver along with Windows OS

Language: Python - Size: 25.4 KB - Last synced at: about 2 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

kodegrenade/web-scraper

A web scraper application

Language: JavaScript - Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

ieferrari/selenium-scrapper-and-pipeline-to-db

Web Scrapper of tourist accommodation price data, and a pipeline to database-storage.

Language: Jupyter Notebook - Size: 36.1 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

Sowmik23/Data-Science

This repository contains Data Science assignments and lab works specially web scrapting like extract data from github repositories or extract data from a weather website and processing the data in pandas and analysis by making plot or graph of the data. These tasks are really interesting.

Language: Python - Size: 24.7 MB - Last synced at: about 2 years ago - Pushed at: about 5 years ago - Stars: 2 - Forks: 0

8Bts/Web-Scrapper

This project is about scraping a website that is listing the IP addresses of game servers. The application parses IP addresses from the web page and outputs them sorted by Ping. Built with Ruby

Language: Ruby - Size: 65.4 KB - Last synced at: 19 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

Si0n/web-parser

Web parser (Getting unique urls from given link with leveling)

Language: PHP - Size: 21.5 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

projjal1/Youtube_video_downloader

This is a web scrapper tool that downloads Youtube .mp4 and .mp3 files in highest possible resolution. This can download entire channel, playlist and individual content.

Language: Python - Size: 21.9 MB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

andgom97/GDS

A python web scraper to get the desired videogame prices and highlight the discounted ones

Language: Python - Size: 172 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

antv199/enjin-store-bot

This is a Web Scrapper written in Python that tries to replace the DonationCraft method of getting user purchases

Language: Python - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

ttavni/PyWebScraper

A set of functions and classes to help web scraping and simple web audits

Language: Python - Size: 45.6 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

johnnyqdp/steam_achievements

Sistema de scraping para carregar em tempo real todos os achievements de um usuário Steam em uma página só. Back-end em PHP, Front-end com jQuery.

Language: JavaScript - Size: 1.21 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

ShreyasSubhedar/Codechef-BOT

Codechef BOT:- It is a web scrapper which scrap the requested user's recent activity on codechef in just single click.

Language: Python - Size: 3.76 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

Siddharthsuresh92/YouTube-viral-trends-COVID

An analysis of trending videos across the world during a pandemic

Language: Jupyter Notebook - Size: 5.94 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

d-sanderson/rick-and-morty-quote-scrapper

web scrapper for rick and morty quotes

Language: JavaScript - Size: 180 KB - Last synced at: 30 days ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

itsayushthada/Scrappers

Small Python scripts for scrapping the data from various sources like Twitter.

Language: Jupyter Notebook - Size: 114 KB - Last synced at: almost 2 years ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 0

general-labs/News-and-Weather

News and weather feed based on Serverless NodeJs 10 (AWS stack).

Language: JavaScript - Size: 606 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

jpsarkar/Android_appcrawl_from_google_play_store

Written in Python using web crawling of google play store to get app category

Language: Python - Size: 7.81 KB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 1

DaneDupont/PoE-WebScraper

This is a simple web-scraper using Python, BeautifulSoup, and Numpy for market analysis of poe.trade

Size: 3.91 KB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

BlueSquid1/Account-hunter

Language: TypeScript - Size: 115 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

ozluy/web-scrapping-with-python

Web scrapping with python and writing to excel

Language: Python - Size: 130 KB - Last synced at: 2 months ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

mihirbhatia999/dcmme

Language: Python - Size: 92.8 KB - Last synced at: 8 months ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

DahlitzFlorian/R-web-scraper

A small web scraper to get the latest articles of a given topic from Techcrunch.com

Language: R - Size: 1000 Bytes - Last synced at: about 2 months ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

mihirbhatia999/Web-scrapping Fork of D4pika/Web-scraping

Scrapper for WHIN

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 8 months ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

salif-04/WallHaven-Scrapper

A web scrapper that downloads a random wallpaer of the given tag from https://alpha.wallhaven.cc/

Language: Python - Size: 598 KB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

jonathansamines/node-asp-scrapper

A little tool for manging web scrapping of asp web forms applications.

Language: JavaScript - Size: 97.7 KB - Last synced at: about 2 years ago - Pushed at: almost 10 years ago - Stars: 1 - Forks: 0

shrinivas93/web-scrapper

Language: Java - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: about 8 years ago - Stars: 0 - Forks: 0