An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: scrape-websites

warifp/Shopee-Scrape

Shopee Scrape is a tool that functions to collect data - the data needed, such as finding data from photos, prices, names, store locations and others.

Language: PHP - Size: 559 KB - Last synced at: about 13 hours ago - Pushed at: over 3 years ago - Stars: 90 - Forks: 27

yusuzech/r-web-scraping-cheat-sheet

Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.

Language: R - Size: 2.89 MB - Last synced at: 1 day ago - Pushed at: over 2 years ago - Stars: 393 - Forks: 104

cassidoo/scrapers

A list of scrapers from around the web.

Size: 58.6 KB - Last synced at: 23 days ago - Pushed at: 2 months ago - Stars: 660 - Forks: 104

joelbarmettlerUZH/Scrapeasy

Scraping in python made easy - receive the content you like in just one line of code

Language: Python - Size: 63.5 KB - Last synced at: 2 days ago - Pushed at: 2 months ago - Stars: 101 - Forks: 51

GreenTreeTeam/WebScraper

A simple tool made with server-side and client-side for Scraping Websites and downloading them.

Language: TypeScript - Size: 420 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 15 - Forks: 6

TufayelLUS/LinkedIn-CV-Downloader

A Python based GUI automation software for downloading bulk LinkedIn CV / LinkedIn Resume from a list of profile links

Language: Python - Size: 33.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

nmaties/google-emails-scraper

Node.js Google email addresses scraper using puppeteer.

Language: JavaScript - Size: 15.6 KB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

AkeBoss-tech/ESL-Worksheet

an app to generate worksheets for ESL students

Language: Jupyter Notebook - Size: 5.44 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

ohmybahgosh/FONTS_DOT_COM_RIPPER

Script to extract entire font families from Fonts.com, rips them as woff2 and final output includes woff2 and ttf files

Language: Shell - Size: 18.6 KB - Last synced at: 4 days ago - Pushed at: over 3 years ago - Stars: 24 - Forks: 1

x1ao4/tvdb-scraper

通过 python 脚本使用 lxml 从 tvdb 上获取剧集信息及封面 / get episode information and covers from tvdb via python script using lxml

Language: Python - Size: 23.4 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

tomaszcekalo/UfcComScraper

Scraper for ufc.com site

Language: C# - Size: 60.5 KB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

paradoxcyx/South-African-Tax-Tool

South African Tax Tool

Language: C# - Size: 114 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ryne/phas-scrape

Scrape dynamic ghost data from Phasmophobia Fandom page into app-friendly JSON.

Language: JavaScript - Size: 987 KB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

Ashwagandhae/evidencer

Debate card cutting chrome extension

Language: TypeScript - Size: 1.09 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

stressosaurus/raw-data-state-of-the-union

Scrape and tabulate the United States of America State of the Union speeches (SOTU).

Language: Python - Size: 3.78 MB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

d1ddle/GameTDB-Bot

GameTDB and Khinsider Game Title + OST Discord Bot. Scrapes Box Art, metadata and Game OST's using Python and Discord-py

Language: Python - Size: 160 KB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 2 - Forks: 0

juneate/notify-on-changes

Pandemic lockdown re-opening, needed a haircut. Solution!

Language: JavaScript - Size: 240 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

MagdaleneHo/Predicting-Forex-with-Sentiment-Analysis

An undergraduate research in predicting Forex movement with sentiment analysis of news headlines.

Language: Jupyter Notebook - Size: 287 KB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 1

g-bhagwanani/py-trains

Scraping data from railyatri.in to find trains for a given source and destination on a given date

Language: Python - Size: 2.69 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 1

nycolop/web-scraper-api

A web scraper api that it's a microservice

Language: JavaScript - Size: 44.9 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

zeetec20/ScrapeInsta

Language: CSS - Size: 135 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

harpreetvirkk/Scrape-Amazon-Flipkart

Python Scripts to Scrape Amazon & Flipkart Websites

Language: Jupyter Notebook - Size: 813 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

jinudaniel/reddit-post-classification

Scrape Reddit for posts related to popular front frameworks like React, Angular and Vue and build ML/DL models for classifying these posts.

Language: Jupyter Notebook - Size: 584 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 0

pratik007kumar/php-open-url

Scrape html page using PHP Laravel

Language: PHP - Size: 1.95 KB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

dantheman3333/scrape-async

Scrape websites with chrome & selenium in an asynchronous fashion (scala).

Language: Scala - Size: 14.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

Dkreitzer/Mars_Weather_Dashboard

Mars Dashboard - Scrape numerous NASA websites to get the latest info on Mars!

Language: Jupyter Notebook - Size: 3.72 MB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0