GitHub topics: webscraper
ptrumpis/snap-lens-web-crawler
JavaScript library to crawl and download Snap Lenses from lens.snapchat.com with ease.
Language: JavaScript - Size: 244 KB - Last synced at: about 19 hours ago - Pushed at: about 20 hours ago - Stars: 7 - Forks: 4

jaypyles/Scraperr
Self-hosted webscraper.
Language: TypeScript - Size: 2.46 MB - Last synced at: about 23 hours ago - Pushed at: about 23 hours ago - Stars: 3,313 - Forks: 142

shibisuriya/indian-e-commerce-scapers
Scrape products from various Indian e-commerce web sites and export it as csv.
Language: Python - Size: 2.03 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 19 - Forks: 6

Sisoodiya/AI_Webscraper
Simple webscraper that will utilize your local LLM to get a personalized result from scrapped website.
Language: Python - Size: 7.3 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 1

mtttech/catch
A web scraper for the UFC website.
Language: Python - Size: 68.4 KB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

laptopklm/WebExtractor
## WebExtractor WebExtractor is a Python tool for OSINT and ethical hacking that extracts email addresses, phone numbers, and links from target websites. It runs on Linux and Termux, providing a simple CLI interface for cybersecurity professionals to gather critical intelligence. 🐙💻
Language: Python - Size: 18.6 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1 - Forks: 0

s-r-e-e-r-a-j/WebExtractor
WebExtractor is a powerful OSINT and ethical hacking tool developed in Python. It is used to extract email addresses, phone numbers, and links (both visible and hidden) from a target website
Language: Python - Size: 28.3 KB - Last synced at: 2 days ago - Pushed at: 7 days ago - Stars: 32 - Forks: 6

surenjanath/YTS_Movie_Webscraper
This script is automated. It rans and add first 10k movies to db. if you need it to run more u need to delete optional code in the script.
Language: Python - Size: 23.2 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 4 - Forks: 2

AliAkhtari78/SpotifyScraper
Spotify Scraper to extract all the information from spotify, download mp3 with cover of the song
Language: PowerShell - Size: 1.06 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 154 - Forks: 18

techdomegh/ai-news-scraper
AI News Scraper & Semantic Search: A Python application that scrapes news articles, uses GenAI to generate summaries and identify topics, and provides semantic search capabilities through vector embeddings
Language: Python - Size: 258 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

foreandr/hyperSel
HyperSel is a Python-based framework for web automation and data scraping. It simplifies crawling, automating interactions, and data extraction from web pages. It is built with various robust tools to handle dynamic and complex web interactions efficiently, offering features such as headless browsing, proxy support, and API sniffing.
Language: Python - Size: 17 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 0

nameer-rizvi/scrapefrom
scrapefrom is a webscraper that can be used to get data from any publicly accessible html webpage.
Language: TypeScript - Size: 506 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 4 - Forks: 0

brittojo7n/WebScrap-TT2UserDetails
Totem Tribe 2 Jotun User details (ids and account names) dataset and script for scraping and updating the dataset.
Language: Python - Size: 14.6 MB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

zo0o0ot/prospect-scraper-mddb-2022 Fork of Leagify/prospect-scraper-mddb-2022
Scraping information on consensus big boards.
Language: Jupyter Notebook - Size: 9.08 MB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

homeinfogmbh/aha-webscraper
Web Scraper to get garbage collection information from https://www.aha-region.de/
Language: Python - Size: 106 KB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

kcsoc/society-email-scrape
Scrapes Every Email Address of Every Society in Every University
Language: Python - Size: 964 KB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 24 - Forks: 4

lykmapipo/US-Gas-Prices
Python scripts that scrape US gas prices
Language: Python - Size: 2.03 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 3 - Forks: 1

Mis1-rkstudio/Frono_Scraping
This is a Automation script that scrapes website and download reports.
Language: Python - Size: 3.05 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

S-L1/ti_scraper
Highly configurable scripts for a web scraper intended to be used for cyber threat intelligence
Language: Python - Size: 2.2 MB - Last synced at: 4 days ago - Pushed at: 6 days ago - Stars: 7 - Forks: 1

KhoaLon/scrapedo-scrapers
Web scraping scripts with Scrape.do 😎
Size: 1000 Bytes - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0

any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Language: TypeScript - Size: 816 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 10 - Forks: 0

scrapfly/scrapfly-scrapers
Scalable Python web scraping scripts for +40 popular domains
Language: Python - Size: 4.78 MB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 526 - Forks: 128

dxnielperez/mma-events-api
MMA events API
Language: JavaScript - Size: 44.9 KB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

nmcassa/letterboxdpy
A letterboxd webscraper
Language: Python - Size: 2 MB - Last synced at: 5 days ago - Pushed at: 3 months ago - Stars: 77 - Forks: 14

scrape-do/scrapedo-scrapers
Web scraping examples with Scrape.do 😎
Language: Python - Size: 38.1 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 6 - Forks: 0

kyriosaa/ditto-bot
A multifunctional Discord bot that automates moderation and provides automatic news updates related to Pokémon.
Language: Python - Size: 49.8 KB - Last synced at: 5 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

Jumitti/r.sine-easter_eggs
Just a python script to find “all” easter eggs from r.sine (https://r.sine.com/index or https://sine.com/index)
Language: HTML - Size: 16.6 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0

troutlytics/troutlytics-backend
Backend support to provide updated information about trout stocking in Washington state. This repository contains all the essential backend components of the project, including database management, Web API, and a web scraper.
Language: Python - Size: 7.63 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

anaskhan96/soup
Web Scraper in Go, similar to BeautifulSoup
Language: Go - Size: 99.6 KB - Last synced at: 12 days ago - Pushed at: over 1 year ago - Stars: 2,200 - Forks: 168

JonathanVusich/pcpartpicker
This is an unofficial API for the website pcpartpicker.com.
Language: Python - Size: 148 KB - Last synced at: 5 days ago - Pushed at: 7 months ago - Stars: 102 - Forks: 8

frixaco/anitrack
Watch, stream, download and track anime from your terminal. Build with Go and Bubbletea
Language: TypeScript - Size: 8.63 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

Paul-Smith13/GEWebscraper
Scrapes GE URL, gets GE data, writes to file: item name, URL, Dates, Daily Avg Prices, Trends
Language: Java - Size: 15.6 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0

GeekDruggist/1mg.com_data_scraper
A simple web scraper in Python and Jupyter Notebook
Language: Jupyter Notebook - Size: 4.88 KB - Last synced at: 16 days ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 1

DevEnterpriseSoftware/scrapi-sdk-dotnet
The only web scraping service you'll ever need that offers advanced features that are simple to use for efficient data extraction.
Language: C# - Size: 70.3 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 1 - Forks: 0

TBosak/mkfd
RSS feed builder created with Bun🥖 and Hono🔥- builds from webpages, email folders, and REST API calls.
Language: TypeScript - Size: 485 KB - Last synced at: 15 days ago - Pushed at: 18 days ago - Stars: 171 - Forks: 1

angelplusultra/job-shell
JobShell is a command-line tool that takes the hassle out of job searching for software engineers by scraping job postings from companies you care about. Whether you prefer the interactive CLI experience or automated Discord updates, JobShell keeps you ahead of the curve.
Language: Rust - Size: 831 KB - Last synced at: 14 days ago - Pushed at: about 2 months ago - Stars: 49 - Forks: 2

salimk/Rcrawler
An R web crawler and scraper
Language: R - Size: 597 KB - Last synced at: 17 days ago - Pushed at: about 3 years ago - Stars: 355 - Forks: 92

lykmapipo/ProductHunt-Python-Scrapy-Scraper
Python Scrapy spiders that scrapes data from producthunt.com
Language: Python - Size: 81.1 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1

Brelage/Bazaar
Webscraper and Database of supermarket websites to track price changes in a time-series and create statistics
Language: Python - Size: 19.9 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

SuppliedOrange/WebscrapeCounting
Counting by webscraping.
Language: TypeScript - Size: 455 KB - Last synced at: 2 days ago - Pushed at: 20 days ago - Stars: 2 - Forks: 1

EchterAlsFake/PHUB
A lightweight API for Pornhub
Language: Python - Size: 7.54 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 87 - Forks: 24

Pinkvinus/CS2-demo-scraper
Counter-Strike share code scraper
Language: Jupyter Notebook - Size: 6.33 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 0 - Forks: 0

daijro/EssayGen
Essay generator
Language: Python - Size: 28.2 MB - Last synced at: 8 days ago - Pushed at: about 3 years ago - Stars: 53 - Forks: 7

benibela/xidel
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Language: Pascal - Size: 2.09 MB - Last synced at: 11 days ago - Pushed at: 4 months ago - Stars: 803 - Forks: 44

milad-rasouli/ticket-notifier
A Golang-based Telegram bot for real-time ticket price alerts and availability notifications.
Language: Go - Size: 1.16 MB - Last synced at: 21 days ago - Pushed at: 22 days ago - Stars: 2 - Forks: 0

R4INYIS/polymarket-elections-predictor
Language: Python - Size: 8.79 KB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

R4INYIS/google-images-downloader
Language: Python - Size: 5.86 KB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

R4INYIS/trustpilot-scraper
Language: Python - Size: 0 Bytes - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

R4INYIS/walmart-scraping
Language: Python - Size: 9.77 KB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

pandyah5/Form_Filler_AutoBot
This is a web automation program that helps to fill in online forms given the preset database of information.
Language: Python - Size: 4.1 MB - Last synced at: 8 days ago - Pushed at: almost 5 years ago - Stars: 6 - Forks: 0

brandonrobertz/autoscrape-py
An automated, programming-free web scraper for interactive sites
Language: HTML - Size: 1.12 MB - Last synced at: about 17 hours ago - Pushed at: almost 2 years ago - Stars: 111 - Forks: 17

arham2003/Web-Scraper-Pro
Web Content and Image Scraper built with Python - Beautiful Soap & Selenium
Language: HTML - Size: 5.07 MB - Last synced at: 7 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

oiweiwei/lastfmq
command-line tool/web scraper to query Last.fm artist information
Language: Go - Size: 6.84 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

rohan-bhautoo/Python-Web-Scraper
A python web scaper to extract content and data from a website.
Language: Python - Size: 46.9 KB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 2

realholgi/untisPlan
Scrape the WebUntis API to display a timetable for today and tomorrow
Language: JavaScript - Size: 44.9 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 0

kwgws/we1s_chomp
WE1S Chomp: A Digital Humanities Web Scraper
Language: Python - Size: 7.76 MB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 4 - Forks: 3

iulspop/slack-web-scraper 📦
Puppeteer configured to scrape the posts and threads of any channel on Slack.
Language: HTML - Size: 6.91 MB - Last synced at: 2 days ago - Pushed at: 9 months ago - Stars: 74 - Forks: 23

RGGH/scrapeX
Rust Web Scraper
Language: Rust - Size: 37.1 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

roark-xoxo/roark-privacy-analyser
A Node.js application that scrapes websites and checks for GDPR privacy violations.
Language: JavaScript - Size: 162 KB - Last synced at: 2 days ago - Pushed at: 12 months ago - Stars: 5 - Forks: 0

almondhouse27/harvest-notebook
Data generator
Language: Jupyter Notebook - Size: 74.2 KB - Last synced at: 5 days ago - Pushed at: 29 days ago - Stars: 0 - Forks: 0

daniel-debrun/Tkinter-Desktop-Widgets-py-
Tkinter Desktop Widgets (py)
Language: Python - Size: 582 KB - Last synced at: 27 days ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

jg585Username/vancouver-ski-live
RESTful API that combines Cypress, Grouse, and Seymour live updates in one place
Language: HTML - Size: 54.7 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 1

daijro/SearchifyX
Fast flashcard searcher tool
Language: Python - Size: 498 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 70 - Forks: 8

toby-p/rightmove_webscraper.py
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
Language: Python - Size: 3.36 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 266 - Forks: 115

andredisa/AI_WebScraper
🕵️♂️ Welcome to AI Web Scraper Agent, a powerful and user-friendly app to scrape websites using natural language via OpenAI or Llama 3.2 (Ollama).
Language: Python - Size: 7.81 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

limagabri/nba-official-stats-scraper
This is a Python script to scrape NBA player ans teams statistics data from the official NBA website.
Language: Python - Size: 159 KB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

MichaelYochpaz/iSubRip
A Python command-line tool for scraping and downloading subtitles from AppleTV and iTunes movie pages.
Language: Python - Size: 505 KB - Last synced at: 22 days ago - Pushed at: 3 months ago - Stars: 152 - Forks: 17

MichaelRCruz/web-scraper
A web scraping tool to detect statically and dynamically rendered content on a web page.
Language: Python - Size: 3.17 MB - Last synced at: 8 days ago - Pushed at: about 8 years ago - Stars: 2 - Forks: 2

SohamJoshi25/PuneFarmersMarket-API
A API which exposes a quantity and prices of all local farmer's market products daily by scraping a Government Website. Database is daily updated using github actions' cron job scheduler.
Language: Python - Size: 1.18 MB - Last synced at: 25 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

PadishahIII/SecretScraper
SecretScraper is a web scraper that crawl through target websites, scrape from http response and extract secret information via regular expression.
Language: Python - Size: 739 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 58 - Forks: 1

DZ-ABDLHAKIM/website-regexscraper-api
🚀 300 Free reqs/mo – Our Web Scraper API extracts text, images, emails, phone numbers, and social links from any website. Perfect for developers building data tools or businesses gathering leads—fast, accurate, and free to start.
Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

arshem/webNovelScraper
A simple nodeJS script to download webnovels and convert them to epub format automatically.
Language: JavaScript - Size: 108 KB - Last synced at: about 20 hours ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

StevenNaliwajka/TVWSDataScraper
(Beta 1.0) Selenium based WebScraper for 'GWS5000' TVWS unit to collect data for burried antenna Directed Study
Language: Python - Size: 743 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

Decodo/Scrapy
Scrapy proxy authentication example for Decodo
Language: Python - Size: 36.1 KB - Last synced at: 25 days ago - Pushed at: about 1 month ago - Stars: 5 - Forks: 0

sven-seyfert/github-commit-watcher
Get notifications (WebEx webhook) about new commits been pushed into different repositories.
Language: AutoIt - Size: 916 KB - Last synced at: 4 days ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 0

Decodo/Web-Scraping-API
Web Scraping API code examples for Python, PHP and Node.js
Language: JavaScript - Size: 77.1 KB - Last synced at: 23 days ago - Pushed at: about 2 months ago - Stars: 24 - Forks: 9

mghmm/allecijfers-scraper
This script automatically downloads the “250 onderwerpen” tables for every Dutch municipality from AlleCijfers.nl and saves each set of tables into a separate Excel workbook.
Language: Python - Size: 1.95 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

dimitryzub/ecommerce-scraper-py
Scrape ecommerce websites such as Amazon, eBay, Walmart, Home Depot, Google Shopping from a single module in Python🐍
Language: Python - Size: 147 KB - Last synced at: 28 days ago - Pushed at: almost 2 years ago - Stars: 12 - Forks: 1

Abhishekn1947/SamGov-Scraper
Automated Python scraper for sam.gov contracts
Language: Python - Size: 2.47 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

AnthonyBloomer/rcp
Python client for RealClearPolitics.
Language: Python - Size: 9.77 KB - Last synced at: 26 days ago - Pushed at: over 2 years ago - Stars: 29 - Forks: 9

CuriousLearner/GeeksForGeeksScrapper
Scrapes g4g and creates PDF
Language: Python - Size: 147 KB - Last synced at: 9 days ago - Pushed at: about 5 years ago - Stars: 147 - Forks: 65

Decodo/trustpilot_python_scraper
Scrape Trustpilot utilising Decodo's Web Scraping API
Language: Python - Size: 24.4 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 8 - Forks: 0

lhfmartin/lihkg-scraper
Download LIHKG posts with images
Language: Python - Size: 85 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 1

yawnbo/movers
Watch movies from the terminal :)
Language: Rust - Size: 225 KB - Last synced at: 18 days ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

sakan811/Find-Osaka-And-Japan-Average-Hotel-Price
Showcase visualizations about Osaka and Japan Average Hotel Price. The data was collected from Booking.com
Language: Python - Size: 27.5 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

JamesN-dev/Scroll-Scribe
ScrollScribe is a Python tool designed to scrape internal URLs from targeted website, read those URLs from a text file, scrape the content of each URL using `crawl4ai`, and generate cleaned Markdown output suitable for ingestion into RAG (Retrieval-Augmented Generation) systems or other text-processing pipelines.
Language: Python - Size: 646 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

jfernando-work/GCScraper
A web scraper that collects product listings from a popular musical instrument retailer's website.
Language: Python - Size: 60.5 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Agenty/scrapingai
Build web scraping agents using AI to auto-extract the data from websites, capture screenshot, generate pdf from URL and web crawling with Agenty
Language: TypeScript - Size: 209 KB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 2

HelloThereMatey/tedata
Scraper for Trading Economics
Language: Jupyter Notebook - Size: 5.94 MB - Last synced at: 9 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1

ejones18/gig_scaper 📦
A flask UI / web scraper to find gigs/concerts for an input artists across multiple sites! Now includes visualisation of gig venue locations!
Language: Python - Size: 59.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Pawel-Parma/dademoiselle
Web scraper for Phantom of the Night Genshin Impact web event
Language: Rust - Size: 8.1 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

DevEnterpriseSoftware/scrapi-mcp
MCP server for using ScrAPI to scrape web pages.
Language: JavaScript - Size: 310 KB - Last synced at: 3 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1

funbeedev/TrelloBoardsAutoExport
A web scraper script to automate JSON export of Trello boards. Useful for backing up all your Trello boards automatically.
Language: Python - Size: 7.22 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

jishnukoliyadan/NAV_Scrapper
NAV Scraper is a Python tool that fetches real-time stock and mutual fund NAVs, merges them with holdings data, and stores results in a database or exports to JSON. It supports automated daily updates via cron jobs and uses rate-limited API calls for efficient scraping.
Language: Python - Size: 24.4 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

serpapi/lego-ai-parser 📦
Lego AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.
Language: Python - Size: 199 KB - Last synced at: 4 days ago - Pushed at: 12 months ago - Stars: 233 - Forks: 15

intergalacticalvariable/reader
📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simple prefix http://127.0.0.1:3000/https://website-to-scrape.com/
Language: TypeScript - Size: 2.57 MB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 185 - Forks: 31

GeminidSystems/GoogleNewsScraper
A Python package that scrapes Google News article data while remaining undetected by Google. Our scraper can scrape page data up until the last page and never trigger a CAPTCHA (download stats: https://pepy.tech/project/GoogleNewsScraper)
Language: Python - Size: 15.3 MB - Last synced at: 25 days ago - Pushed at: over 3 years ago - Stars: 12 - Forks: 5

mghmm/funda-scraper
A Python scraper that retrieves property data from Funda and saves it as CSV files.
Language: Python - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

haydenheroux/rpifood
Command-line interface for viewing food on RPI's campus. Scrapes data from the Sodexo Everyday API endpoints.
Language: Go - Size: 38.1 KB - Last synced at: 19 days ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

akselpekin/Web-scraper
This is a simple web scraping application built with Python and Tkinter. It allows you to scrape text content from a webpage and display it in a text box.
Language: Python - Size: 9.77 KB - Last synced at: 9 minutes ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0
