Decodo/Decodo

HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.

Language: Java - Size: 320 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1,125 - Forks: 43

oxylabs/web-unblocker

Free trial Web Unblocker - an AI-powered proxy solution that can bypass even the most sophisticated anti-bot systems.

Language: Python - Size: 1.06 MB - Last synced at: 14 days ago - Pushed at: about 2 months ago - Stars: 326 - Forks: 48

oxylabs/Python-Web-Scraping-Tutorial

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

Language: Python - Size: 111 KB - Last synced at: 14 days ago - Pushed at: about 2 months ago - Stars: 282 - Forks: 30

thewebscraping/tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

Language: Python - Size: 3.69 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 56 - Forks: 4

vishwajeetdabholkar/eGet-Crawler-for-ai

Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.

Language: Python - Size: 248 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 41 - Forks: 15

Decodo/Python-scraper-tutorial

A short introduction to scraping with Python with given steps and an example scraper script.

Language: Python - Size: 106 KB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 30 - Forks: 5

pim97/scrappey.js

Scrappey.js: A versatile JavaScript wrapper for Scrappey API for solving Cloudflare, datadome, enabling seamless web scraping of anti-bot protected websites. Simplify data extraction with robust functionality and reliable results. Unlock valuable insights effortlessly. Get started with Scrappey

Language: JavaScript - Size: 124 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 9 - Forks: 4

oxylabs/web-crawler

Web Crawler is a tool used to discover target URLs, select the relevant content, and have it delivered in bulk. It crawls websites in real-time and at scale to quickly deliver all content or only the data you need based on your chosen criteria.

Language: Python - Size: 45.9 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 5 - Forks: 2

oxylabs/how-to-make-web-scraping-faster

How to Make Web Scraping Faster - Python Tutorial

Language: Python - Size: 41 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 5 - Forks: 1

oxylabs/concurrency-vs-parallelism

Learn the difference between concurrency and parallelism

Language: Python - Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0

smattsil/alma-api

A custom Alma (SIS) API made using FastAPI, httpx, and Selectolax.

Language: Python - Size: 88.9 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 2 - Forks: 0

scrapingbypass/api

ScrapingBypass API for web scraping with Python, Curl, NodeJS, and Java.

Size: 39.1 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0

naomibaes/NYT

Scripts to scrape NYT articles using the The New York Times Developer Network (Archive API) (1851 - yesterday)

Language: Jupyter Notebook - Size: 233 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

divyanshudhruv/datadiver-ai

🌊 datadiver-ai is the ultimate tool for 📊 web scraping, transforming 🕸️ unstructured websites into ✨ clean JSON with the 🧠 AI-powered processing.

Language: TypeScript - Size: 1.12 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

luminati-io/Python-web-scraping

Comprehensive Python Web Scraping guide covering libraries, methods, and examples using BeautifulSoup, Selenium, Scrapy, and API solutions.

Language: Python - Size: 32.2 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

ERIZOAT/recaptcha-enterprise

Size: 4.88 KB - Last synced at: 2 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

javapuppteernodejs/web-scraping-puppeteer

Language: JavaScript - Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

scrapingbypass/scrapingbypass.github.io Fork of daviddarnes/alembic

scrapingbypass.github.io

Language: SCSS - Size: 5.5 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

xl400v/scrape-json

This shows how to use github actions to do periodic data scraping

Language: JavaScript - Size: 42.9 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

aadium/web-scraping-demo

This is a web-scraping server built using Node.js and Supabase

Language: JavaScript - Size: 1.32 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

TheWebSolver/scraper

A simple and straight-forward PHP package to scrape web content

Language: PHP - Size: 461 KB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

somashekhar223/Scraping-with-langchain

Scrape any table tagged html webpage

Language: Python - Size: 5.34 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

oxylabs/chat-gpt-scraping

In this tutorial, we'll demonstrate how to extract data with ChatGPT from Oxylabs Sandbox, a dummy e-commerce store that maintains video game listings in several categories.

Size: 10.7 KB - Last synced at: 28 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

luminati-io/langchain-web-scraping

How to integrate LangChain with Bright Data's Web Scraper API for efficient web scraping and real-world LLM data enrichment.

Size: 834 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

sarperavci/kick-unofficial-api

🛡️ Unofficial Kick.com API wrapper with automatic bypass protection.

Language: Python - Size: 15.6 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

BenSFGamer/Meta-Web-Scraper

A web scraper

Size: 2.93 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

javapuppteernodejs/web-scraping-captcha

Size: 4.88 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

javapuppteernodejs/ai-web-unlocker

Size: 3.91 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

aferapi/web-scraping-challenges-

Size: 0 Bytes - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

aferapi/web-scraping-api

Size: 182 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

aferapi/web-scraping

Size: 3.91 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

aferapi/funcaptcha-amazon-captcha-solver

Size: 51.8 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

scrapingbypass/google-serp-scraper

Google SERP scraper

Size: 2.93 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0