An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: webscraper

ptrumpis/snap-lens-web-crawler

JavaScript library to crawl and download Snap Lenses from lens.snapchat.com with ease.

Language: JavaScript - Size: 244 KB - Last synced at: about 19 hours ago - Pushed at: about 20 hours ago - Stars: 7 - Forks: 4

jaypyles/Scraperr

Self-hosted webscraper.

Language: TypeScript - Size: 2.46 MB - Last synced at: about 23 hours ago - Pushed at: about 23 hours ago - Stars: 3,313 - Forks: 142

shibisuriya/indian-e-commerce-scapers

Scrape products from various Indian e-commerce web sites and export it as csv.

Language: Python - Size: 2.03 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 19 - Forks: 6

Sisoodiya/AI_Webscraper

Simple webscraper that will utilize your local LLM to get a personalized result from scrapped website.

Language: Python - Size: 7.3 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 1

mtttech/catch

A web scraper for the UFC website.

Language: Python - Size: 68.4 KB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

laptopklm/WebExtractor

## WebExtractor WebExtractor is a Python tool for OSINT and ethical hacking that extracts email addresses, phone numbers, and links from target websites. It runs on Linux and Termux, providing a simple CLI interface for cybersecurity professionals to gather critical intelligence. 🐙💻

Language: Python - Size: 18.6 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1 - Forks: 0

s-r-e-e-r-a-j/WebExtractor

WebExtractor is a powerful OSINT and ethical hacking tool developed in Python. It is used to extract email addresses, phone numbers, and links (both visible and hidden) from a target website

Language: Python - Size: 28.3 KB - Last synced at: 2 days ago - Pushed at: 7 days ago - Stars: 32 - Forks: 6

surenjanath/YTS_Movie_Webscraper

This script is automated. It rans and add first 10k movies to db. if you need it to run more u need to delete optional code in the script.

Language: Python - Size: 23.2 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 4 - Forks: 2

AliAkhtari78/SpotifyScraper

Spotify Scraper to extract all the information from spotify, download mp3 with cover of the song

Language: PowerShell - Size: 1.06 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 154 - Forks: 18

techdomegh/ai-news-scraper

AI News Scraper & Semantic Search: A Python application that scrapes news articles, uses GenAI to generate summaries and identify topics, and provides semantic search capabilities through vector embeddings

Language: Python - Size: 258 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

foreandr/hyperSel

HyperSel is a Python-based framework for web automation and data scraping. It simplifies crawling, automating interactions, and data extraction from web pages. It is built with various robust tools to handle dynamic and complex web interactions efficiently, offering features such as headless browsing, proxy support, and API sniffing.

Language: Python - Size: 17 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 0

nameer-rizvi/scrapefrom

scrapefrom is a webscraper that can be used to get data from any publicly accessible html webpage.

Language: TypeScript - Size: 506 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 4 - Forks: 0

brittojo7n/WebScrap-TT2UserDetails

Totem Tribe 2 Jotun User details (ids and account names) dataset and script for scraping and updating the dataset.

Language: Python - Size: 14.6 MB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

zo0o0ot/prospect-scraper-mddb-2022 Fork of Leagify/prospect-scraper-mddb-2022

Scraping information on consensus big boards.

Language: Jupyter Notebook - Size: 9.08 MB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

homeinfogmbh/aha-webscraper

Web Scraper to get garbage collection information from https://www.aha-region.de/

Language: Python - Size: 106 KB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

kcsoc/society-email-scrape

Scrapes Every Email Address of Every Society in Every University

Language: Python - Size: 964 KB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 24 - Forks: 4

lykmapipo/US-Gas-Prices

Python scripts that scrape US gas prices

Language: Python - Size: 2.03 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 3 - Forks: 1

Mis1-rkstudio/Frono_Scraping

This is a Automation script that scrapes website and download reports.

Language: Python - Size: 3.05 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

S-L1/ti_scraper

Highly configurable scripts for a web scraper intended to be used for cyber threat intelligence

Language: Python - Size: 2.2 MB - Last synced at: 4 days ago - Pushed at: 6 days ago - Stars: 7 - Forks: 1

KhoaLon/scrapedo-scrapers

Web scraping scripts with Scrape.do 😎

Size: 1000 Bytes - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0

any4ai/AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

Language: TypeScript - Size: 816 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 10 - Forks: 0

scrapfly/scrapfly-scrapers

Scalable Python web scraping scripts for +40 popular domains

Language: Python - Size: 4.78 MB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 526 - Forks: 128

dxnielperez/mma-events-api

MMA events API

Language: JavaScript - Size: 44.9 KB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

nmcassa/letterboxdpy

A letterboxd webscraper

Language: Python - Size: 2 MB - Last synced at: 5 days ago - Pushed at: 3 months ago - Stars: 77 - Forks: 14

scrape-do/scrapedo-scrapers

Web scraping examples with Scrape.do 😎

Language: Python - Size: 38.1 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 6 - Forks: 0

kyriosaa/ditto-bot

A multifunctional Discord bot that automates moderation and provides automatic news updates related to Pokémon.

Language: Python - Size: 49.8 KB - Last synced at: 5 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

Jumitti/r.sine-easter_eggs

Just a python script to find “all” easter eggs from r.sine (https://r.sine.com/index or https://sine.com/index)

Language: HTML - Size: 16.6 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0

troutlytics/troutlytics-backend

Backend support to provide updated information about trout stocking in Washington state. This repository contains all the essential backend components of the project, including database management, Web API, and a web scraper.

Language: Python - Size: 7.63 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

anaskhan96/soup

Web Scraper in Go, similar to BeautifulSoup

Language: Go - Size: 99.6 KB - Last synced at: 12 days ago - Pushed at: over 1 year ago - Stars: 2,200 - Forks: 168

JonathanVusich/pcpartpicker

This is an unofficial API for the website pcpartpicker.com.

Language: Python - Size: 148 KB - Last synced at: 5 days ago - Pushed at: 7 months ago - Stars: 102 - Forks: 8

frixaco/anitrack

Watch, stream, download and track anime from your terminal. Build with Go and Bubbletea

Language: TypeScript - Size: 8.63 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

Paul-Smith13/GEWebscraper

Scrapes GE URL, gets GE data, writes to file: item name, URL, Dates, Daily Avg Prices, Trends

Language: Java - Size: 15.6 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0

GeekDruggist/1mg.com_data_scraper

A simple web scraper in Python and Jupyter Notebook

Language: Jupyter Notebook - Size: 4.88 KB - Last synced at: 16 days ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 1

DevEnterpriseSoftware/scrapi-sdk-dotnet

The only web scraping service you'll ever need that offers advanced features that are simple to use for efficient data extraction.

Language: C# - Size: 70.3 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 1 - Forks: 0

TBosak/mkfd

RSS feed builder created with Bun🥖 and Hono🔥- builds from webpages, email folders, and REST API calls.

Language: TypeScript - Size: 485 KB - Last synced at: 15 days ago - Pushed at: 18 days ago - Stars: 171 - Forks: 1

angelplusultra/job-shell

JobShell is a command-line tool that takes the hassle out of job searching for software engineers by scraping job postings from companies you care about. Whether you prefer the interactive CLI experience or automated Discord updates, JobShell keeps you ahead of the curve.

Language: Rust - Size: 831 KB - Last synced at: 14 days ago - Pushed at: about 2 months ago - Stars: 49 - Forks: 2

salimk/Rcrawler

An R web crawler and scraper

Language: R - Size: 597 KB - Last synced at: 17 days ago - Pushed at: about 3 years ago - Stars: 355 - Forks: 92

lykmapipo/ProductHunt-Python-Scrapy-Scraper

Python Scrapy spiders that scrapes data from producthunt.com

Language: Python - Size: 81.1 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1

Brelage/Bazaar

Webscraper and Database of supermarket websites to track price changes in a time-series and create statistics

Language: Python - Size: 19.9 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

SuppliedOrange/WebscrapeCounting

Counting by webscraping.

Language: TypeScript - Size: 455 KB - Last synced at: 2 days ago - Pushed at: 20 days ago - Stars: 2 - Forks: 1

EchterAlsFake/PHUB

A lightweight API for Pornhub

Language: Python - Size: 7.54 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 87 - Forks: 24

Pinkvinus/CS2-demo-scraper

Counter-Strike share code scraper

Language: Jupyter Notebook - Size: 6.33 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 0 - Forks: 0

daijro/EssayGen

Essay generator

Language: Python - Size: 28.2 MB - Last synced at: 8 days ago - Pushed at: about 3 years ago - Stars: 53 - Forks: 7

benibela/xidel

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

Language: Pascal - Size: 2.09 MB - Last synced at: 11 days ago - Pushed at: 4 months ago - Stars: 803 - Forks: 44

milad-rasouli/ticket-notifier

A Golang-based Telegram bot for real-time ticket price alerts and availability notifications.

Language: Go - Size: 1.16 MB - Last synced at: 21 days ago - Pushed at: 22 days ago - Stars: 2 - Forks: 0

R4INYIS/polymarket-elections-predictor

Language: Python - Size: 8.79 KB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

R4INYIS/google-images-downloader

Language: Python - Size: 5.86 KB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

R4INYIS/trustpilot-scraper

Language: Python - Size: 0 Bytes - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

R4INYIS/walmart-scraping

Language: Python - Size: 9.77 KB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

pandyah5/Form_Filler_AutoBot

This is a web automation program that helps to fill in online forms given the preset database of information.

Language: Python - Size: 4.1 MB - Last synced at: 8 days ago - Pushed at: almost 5 years ago - Stars: 6 - Forks: 0

brandonrobertz/autoscrape-py

An automated, programming-free web scraper for interactive sites

Language: HTML - Size: 1.12 MB - Last synced at: about 17 hours ago - Pushed at: almost 2 years ago - Stars: 111 - Forks: 17

arham2003/Web-Scraper-Pro

Web Content and Image Scraper built with Python - Beautiful Soap & Selenium

Language: HTML - Size: 5.07 MB - Last synced at: 7 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

oiweiwei/lastfmq

command-line tool/web scraper to query Last.fm artist information

Language: Go - Size: 6.84 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

rohan-bhautoo/Python-Web-Scraper

A python web scaper to extract content and data from a website.

Language: Python - Size: 46.9 KB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 2

realholgi/untisPlan

Scrape the WebUntis API to display a timetable for today and tomorrow

Language: JavaScript - Size: 44.9 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 0

kwgws/we1s_chomp

WE1S Chomp: A Digital Humanities Web Scraper

Language: Python - Size: 7.76 MB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 4 - Forks: 3

iulspop/slack-web-scraper 📦

Puppeteer configured to scrape the posts and threads of any channel on Slack.

Language: HTML - Size: 6.91 MB - Last synced at: 2 days ago - Pushed at: 9 months ago - Stars: 74 - Forks: 23

RGGH/scrapeX

Rust Web Scraper

Language: Rust - Size: 37.1 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

roark-xoxo/roark-privacy-analyser

A Node.js application that scrapes websites and checks for GDPR privacy violations.

Language: JavaScript - Size: 162 KB - Last synced at: 2 days ago - Pushed at: 12 months ago - Stars: 5 - Forks: 0

almondhouse27/harvest-notebook

Data generator

Language: Jupyter Notebook - Size: 74.2 KB - Last synced at: 5 days ago - Pushed at: 29 days ago - Stars: 0 - Forks: 0

daniel-debrun/Tkinter-Desktop-Widgets-py-

Tkinter Desktop Widgets (py)

Language: Python - Size: 582 KB - Last synced at: 27 days ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

jg585Username/vancouver-ski-live

RESTful API that combines Cypress, Grouse, and Seymour live updates in one place

Language: HTML - Size: 54.7 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 1

daijro/SearchifyX

Fast flashcard searcher tool

Language: Python - Size: 498 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 70 - Forks: 8

toby-p/rightmove_webscraper.py

Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

Language: Python - Size: 3.36 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 266 - Forks: 115

andredisa/AI_WebScraper

🕵️‍♂️ Welcome to AI Web Scraper Agent, a powerful and user-friendly app to scrape websites using natural language via OpenAI or Llama 3.2 (Ollama).

Language: Python - Size: 7.81 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

limagabri/nba-official-stats-scraper

This is a Python script to scrape NBA player ans teams statistics data from the official NBA website.

Language: Python - Size: 159 KB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

MichaelYochpaz/iSubRip

A Python command-line tool for scraping and downloading subtitles from AppleTV and iTunes movie pages.

Language: Python - Size: 505 KB - Last synced at: 22 days ago - Pushed at: 3 months ago - Stars: 152 - Forks: 17

MichaelRCruz/web-scraper

A web scraping tool to detect statically and dynamically rendered content on a web page.

Language: Python - Size: 3.17 MB - Last synced at: 8 days ago - Pushed at: about 8 years ago - Stars: 2 - Forks: 2

SohamJoshi25/PuneFarmersMarket-API

A API which exposes a quantity and prices of all local farmer's market products daily by scraping a Government Website. Database is daily updated using github actions' cron job scheduler.

Language: Python - Size: 1.18 MB - Last synced at: 25 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

PadishahIII/SecretScraper

SecretScraper is a web scraper that crawl through target websites, scrape from http response and extract secret information via regular expression.

Language: Python - Size: 739 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 58 - Forks: 1

DZ-ABDLHAKIM/website-regexscraper-api

🚀 300 Free reqs/mo – Our Web Scraper API extracts text, images, emails, phone numbers, and social links from any website. Perfect for developers building data tools or businesses gathering leads—fast, accurate, and free to start.

Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

arshem/webNovelScraper

A simple nodeJS script to download webnovels and convert them to epub format automatically.

Language: JavaScript - Size: 108 KB - Last synced at: about 20 hours ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

StevenNaliwajka/TVWSDataScraper

(Beta 1.0) Selenium based WebScraper for 'GWS5000' TVWS unit to collect data for burried antenna Directed Study

Language: Python - Size: 743 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

Decodo/Scrapy

Scrapy proxy authentication example for Decodo

Language: Python - Size: 36.1 KB - Last synced at: 25 days ago - Pushed at: about 1 month ago - Stars: 5 - Forks: 0

sven-seyfert/github-commit-watcher

Get notifications (WebEx webhook) about new commits been pushed into different repositories.

Language: AutoIt - Size: 916 KB - Last synced at: 4 days ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 0

Decodo/Web-Scraping-API

Web Scraping API code examples for Python, PHP and Node.js

Language: JavaScript - Size: 77.1 KB - Last synced at: 23 days ago - Pushed at: about 2 months ago - Stars: 24 - Forks: 9

mghmm/allecijfers-scraper

This script automatically downloads the “250 onderwerpen” tables for every Dutch municipality from AlleCijfers.nl and saves each set of tables into a separate Excel workbook.

Language: Python - Size: 1.95 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

dimitryzub/ecommerce-scraper-py

Scrape ecommerce websites such as Amazon, eBay, Walmart, Home Depot, Google Shopping from a single module in Python🐍

Language: Python - Size: 147 KB - Last synced at: 28 days ago - Pushed at: almost 2 years ago - Stars: 12 - Forks: 1

Abhishekn1947/SamGov-Scraper

Automated Python scraper for sam.gov contracts

Language: Python - Size: 2.47 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

AnthonyBloomer/rcp

Python client for RealClearPolitics.

Language: Python - Size: 9.77 KB - Last synced at: 26 days ago - Pushed at: over 2 years ago - Stars: 29 - Forks: 9

CuriousLearner/GeeksForGeeksScrapper

Scrapes g4g and creates PDF

Language: Python - Size: 147 KB - Last synced at: 9 days ago - Pushed at: about 5 years ago - Stars: 147 - Forks: 65

Decodo/trustpilot_python_scraper

Scrape Trustpilot utilising Decodo's Web Scraping API

Language: Python - Size: 24.4 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 8 - Forks: 0

lhfmartin/lihkg-scraper

Download LIHKG posts with images

Language: Python - Size: 85 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 1

yawnbo/movers

Watch movies from the terminal :)

Language: Rust - Size: 225 KB - Last synced at: 18 days ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

sakan811/Find-Osaka-And-Japan-Average-Hotel-Price

Showcase visualizations about Osaka and Japan Average Hotel Price. The data was collected from Booking.com

Language: Python - Size: 27.5 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

JamesN-dev/Scroll-Scribe

ScrollScribe is a Python tool designed to scrape internal URLs from targeted website, read those URLs from a text file, scrape the content of each URL using `crawl4ai`, and generate cleaned Markdown output suitable for ingestion into RAG (Retrieval-Augmented Generation) systems or other text-processing pipelines.

Language: Python - Size: 646 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

jfernando-work/GCScraper

A web scraper that collects product listings from a popular musical instrument retailer's website.

Language: Python - Size: 60.5 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Agenty/scrapingai

Build web scraping agents using AI to auto-extract the data from websites, capture screenshot, generate pdf from URL and web crawling with Agenty

Language: TypeScript - Size: 209 KB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 2

HelloThereMatey/tedata

Scraper for Trading Economics

Language: Jupyter Notebook - Size: 5.94 MB - Last synced at: 9 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1

ejones18/gig_scaper 📦

A flask UI / web scraper to find gigs/concerts for an input artists across multiple sites! Now includes visualisation of gig venue locations!

Language: Python - Size: 59.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Pawel-Parma/dademoiselle

Web scraper for Phantom of the Night Genshin Impact web event

Language: Rust - Size: 8.1 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

DevEnterpriseSoftware/scrapi-mcp

MCP server for using ScrAPI to scrape web pages.

Language: JavaScript - Size: 310 KB - Last synced at: 3 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1

funbeedev/TrelloBoardsAutoExport

A web scraper script to automate JSON export of Trello boards. Useful for backing up all your Trello boards automatically.

Language: Python - Size: 7.22 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

jishnukoliyadan/NAV_Scrapper

NAV Scraper is a Python tool that fetches real-time stock and mutual fund NAVs, merges them with holdings data, and stores results in a database or exports to JSON. It supports automated daily updates via cron jobs and uses rate-limited API calls for efficient scraping.

Language: Python - Size: 24.4 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

serpapi/lego-ai-parser 📦

Lego AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.

Language: Python - Size: 199 KB - Last synced at: 4 days ago - Pushed at: 12 months ago - Stars: 233 - Forks: 15

intergalacticalvariable/reader

📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simple prefix http://127.0.0.1:3000/https://website-to-scrape.com/

Language: TypeScript - Size: 2.57 MB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 185 - Forks: 31

GeminidSystems/GoogleNewsScraper

A Python package that scrapes Google News article data while remaining undetected by Google. Our scraper can scrape page data up until the last page and never trigger a CAPTCHA (download stats: https://pepy.tech/project/GoogleNewsScraper)

Language: Python - Size: 15.3 MB - Last synced at: 25 days ago - Pushed at: over 3 years ago - Stars: 12 - Forks: 5

mghmm/funda-scraper

A Python scraper that retrieves property data from Funda and saves it as CSV files.

Language: Python - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

haydenheroux/rpifood

Command-line interface for viewing food on RPI's campus. Scrapes data from the Sodexo Everyday API endpoints.

Language: Go - Size: 38.1 KB - Last synced at: 19 days ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

akselpekin/Web-scraper

This is a simple web scraping application built with Python and Tkinter. It allows you to scrape text content from a webpage and display it in a text box.

Language: Python - Size: 9.77 KB - Last synced at: 9 minutes ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0