TheWebSolver/scraper

A simple and straight-forward PHP package to scrape web content

Language: PHP - Size: 428 KB - Last synced at: about 3 hours ago - Pushed at: about 5 hours ago - Stars: 0 - Forks: 0

vishwajeetdabholkar/eGet-Crawler-for-ai

Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.

Language: Python - Size: 292 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 46 - Forks: 17

xl400v/scrape-json

This shows how to use github actions to do periodic data scraping

Language: JavaScript - Size: 73.1 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

thewebscraping/tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

Language: Python - Size: 3.7 MB - Last synced at: 10 days ago - Pushed at: 4 months ago - Stars: 78 - Forks: 6

ScraperHub/goodfirms-scraper

Goodfirms.com Search Listing and Company Page Scraper. To handle JS rendering and CAPTCHAs, we are using Crawlbase Crawling API.

Language: Python - Size: 6.84 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

ScraperHub/farfetch-scrapers

Farfetch.com Search Listings Scraper and Product Details Page Scraper. Scrapers effectively handle JS rendering and CAPTCHA using Crawlbase Crawling API.

Language: Python - Size: 5.86 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

oxylabs/web-unblocker

Free trial Web Unblocker - an AI-powered proxy solution that can bypass even the most sophisticated anti-bot systems.

Language: Python - Size: 1.07 MB - Last synced at: 18 days ago - Pushed at: 3 months ago - Stars: 325 - Forks: 49

pim97/scrappey.js

Scrappey.js: A versatile JavaScript wrapper for Scrappey API for solving Cloudflare, datadome, enabling seamless web scraping of anti-bot protected websites. Simplify data extraction with robust functionality and reliable results. Unlock valuable insights effortlessly. Get started with Scrappey

Language: JavaScript - Size: 137 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 10 - Forks: 4

oxylabs/how-to-make-web-scraping-faster

How to Make Web Scraping Faster - Python Tutorial

Language: Python - Size: 44.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 5 - Forks: 1

oxylabs/concurrency-vs-parallelism

Learn the difference between concurrency and parallelism

Language: Python - Size: 15.6 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

oxylabs/Python-Web-Scraping-Tutorial

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

Language: Python - Size: 111 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 284 - Forks: 31

sarperavci/kick-unofficial-api

🛡️ Unofficial Kick.com API wrapper with automatic bypass protection.

Language: Python - Size: 15.6 KB - Last synced at: 3 months ago - Pushed at: 8 months ago - Stars: 7 - Forks: 3

luminati-io/langchain-web-scraping

How to integrate LangChain with Bright Data's Web Scraper API for efficient web scraping and real-world LLM data enrichment.

Size: 834 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

aadium/web-scraping-demo

This is a web-scraping server built using Node.js and Supabase

Language: JavaScript - Size: 1.32 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Decodo/Python-scraper-tutorial

A short introduction to scraping with Python with given steps and an example scraper script.

Language: Python - Size: 106 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 30 - Forks: 5

Decodo/Decodo

HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.

Language: Java - Size: 320 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1,125 - Forks: 43

somashekhar223/Scraping-with-langchain

Scrape any table tagged html webpage

Language: Python - Size: 5.34 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

naomibaes/NYT

Scripts to scrape NYT articles using the The New York Times Developer Network (Archive API) (1851 - yesterday)

Language: Jupyter Notebook - Size: 233 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

oxylabs/chat-gpt-scraping

In this tutorial, we'll demonstrate how to extract data with ChatGPT from Oxylabs Sandbox, a dummy e-commerce store that maintains video game listings in several categories.

Size: 10.7 KB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

divyanshudhruv/datadiver-ai

🌊 datadiver-ai is the ultimate tool for 📊 web scraping, transforming 🕸️ unstructured websites into ✨ clean JSON with the 🧠 AI-powered processing.

Language: TypeScript - Size: 1.12 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

luminati-io/Python-web-scraping

Comprehensive Python Web Scraping guide covering libraries, methods, and examples using BeautifulSoup, Selenium, Scrapy, and API solutions.

Language: Python - Size: 32.2 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

ERIZOAT/recaptcha-enterprise

Size: 4.88 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

smattsil/alma-api

A custom Alma (SIS) API made using FastAPI, httpx, and Selectolax.

Language: Python - Size: 88.9 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 2 - Forks: 0

javapuppteernodejs/web-scraping-puppeteer

Language: JavaScript - Size: 7.81 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

BenSFGamer/Meta-Web-Scraper

A web scraper

Size: 2.93 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

javapuppteernodejs/web-scraping-captcha

Size: 4.88 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

javapuppteernodejs/ai-web-unlocker

Size: 3.91 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

aferapi/web-scraping-challenges-

Size: 0 Bytes - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

aferapi/web-scraping-api

Size: 182 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

aferapi/web-scraping

Size: 3.91 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

aferapi/funcaptcha-amazon-captcha-solver

Size: 51.8 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

scrapingbypass/scrapingbypass.github.io Fork of daviddarnes/alembic

scrapingbypass.github.io

Language: SCSS - Size: 5.5 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

scrapingbypass/google-serp-scraper

Google SERP scraper

Size: 2.93 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

scrapingbypass/api

ScrapingBypass API for web scraping with Python, Curl, NodeJS, and Java.

Size: 39.1 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0