GitHub topics: scraping-api

Repositories

SxryxnshS5/Python-Playwright-StockScraper-API

A Flask-based API that scrapes stock data using Playwright and BeautifulSoup, returning the results as downloadable CSV files. Note: The API is hosted on Render.com's free tier, which may lead to a loading time of 3-4 minutes.

Language: Python - Size: 5.07 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

matfurrier/webscraper-api

RESTful API for periodic scraping with Playwright + FastAPI + MongoDB

Language: Python - Size: 13.7 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

Onxx-datas/GoogleMapsScraper

A Python project that scrapes hospital data from the Google Places API for Norwich. It retrieves details like hospital names, addresses, contact information, and ratings, organizing the data for further analysis or application use. Data will be saved into (.xlsx) Excel file

Language: Python - Size: 126 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 5 - Forks: 1

scrapfly/python-scrapfly

Scrapfly Python SDK for headless browsers and proxy rotation

Language: Python - Size: 673 KB - Last synced at: 4 days ago - Pushed at: 12 days ago - Stars: 42 - Forks: 11

scrapeless-ai/scrapeless-sdk-node

SDK to access Scrapeless API directly from Node.js. We handle Proxies, Scraping Browser, Scraping API, Web Unlocker and Captcha Solver for you.

Language: TypeScript - Size: 42 KB - Last synced at: 2 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 2

Decodo/zalando_python_scraper

Scrape Zalando utilising Decodo's Web Scraping API

Language: Python - Size: 8.79 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 3 - Forks: 0

Decodo/trustpilot_python_scraper

Scrape Trustpilot utilising Decodo's Web Scraping API

Language: Python - Size: 24.4 KB - Last synced at: 11 days ago - Pushed at: 16 days ago - Stars: 8 - Forks: 0

Decodo/Web-Scraping-API

Web Scraping API code examples for Python, PHP and Node.js

Language: JavaScript - Size: 99.6 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 23 - Forks: 8

Ashupathak2001/AI_Travel_Planner

TravelBuddy is AI based travel companion helps in generating itineraries

Language: Python - Size: 155 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 0 - Forks: 0

Decodo/Social-Media-Scraping-API

Social Media Scraping API code examples for Python, PHP and Node.js

Language: PHP - Size: 80.1 KB - Last synced at: 9 days ago - Pushed at: about 1 year ago - Stars: 25 - Forks: 5

goodandev/Doublegram-Startup-Telegram-Scraper-Adder

The Professional Telegram Bulk Members Adder & Scraper. More on doublegram.com

Size: 155 KB - Last synced at: 23 days ago - Pushed at: 24 days ago - Stars: 27 - Forks: 5

LearnCodingEasy/Web_Scraping

Web Scraping

Language: Vue - Size: 165 KB - Last synced at: 22 days ago - Pushed at: 28 days ago - Stars: 1 - Forks: 0

oxylabs/amazon-scraper

Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

Language: Python - Size: 378 KB - Last synced at: 29 days ago - Pushed at: about 1 month ago - Stars: 1,663 - Forks: 53

serpapi/serpapi-python

a Python client library for SerpApi.

Language: Python - Size: 397 KB - Last synced at: 7 days ago - Pushed at: 10 months ago - Stars: 84 - Forks: 7

oxylabs/scrape-google-python

In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.

Size: 36.1 KB - Last synced at: 27 days ago - Pushed at: about 1 month ago - Stars: 47 - Forks: 0

oofidc/Yorubanames-Scraper

"A web scraper for Yorùbá names and a Flask API to serve the data, providing detailed information on name meanings, origins, and variations.

Language: Python - Size: 6.41 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

oxylabs/how-to-scrape-google-trends

Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.

Language: Python - Size: 942 KB - Last synced at: 27 days ago - Pushed at: 3 months ago - Stars: 43 - Forks: 0

macsencasaus/jetapi

web scraping API to gather info about aircraft from JetPhotos and FlightRadar

Language: Go - Size: 374 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 2

NotKitsune/goprox

🚀 Goprox: Simplify Google searches with automatic proxy handling and user-agent selection.

Language: Python - Size: 14.6 KB - Last synced at: 11 days ago - Pushed at: about 1 year ago - Stars: 10 - Forks: 0

solve-cloudflare/cloudflare-bypass

Size: 2.93 KB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 2 - Forks: 1

ScrapeGraphAI/langchain-scrapegraph

ScrapeGraph client langchain integration

Language: Python - Size: 52.7 KB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 16 - Forks: 2

pavlovtech/WebReaper

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

Language: C# - Size: 37.3 MB - Last synced at: 28 days ago - Pushed at: 6 months ago - Stars: 119 - Forks: 28

Matthew17-21/Captcha-Tools

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!

Language: Go - Size: 140 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 73 - Forks: 7

kunalnagarco/imdb-scraper 📦

🎬 An attempt at the most complete IMDb API

Language: TypeScript - Size: 1.06 MB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 39 - Forks: 8

Roho11/DividendGrowthPicks

Analysing US dividend stocks based on 5 fundamental metrics for dividend growth investing. Tweeting results @DividendGrowthPicks

Language: Jupyter Notebook - Size: 70 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

ScrapingAnt/amazon_scraper

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Language: JavaScript - Size: 52.7 KB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 81 - Forks: 19

addy999/onequery

AI web agent to find answers to any question

Language: Python - Size: 13.2 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 31 - Forks: 1

crawlbase/crawlbase-net

A lightweight, fast .NET class that acts as wrapper for Crawlbase API

Language: C# - Size: 25.4 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 4 - Forks: 1

carvalhoviniciusluiz/web-scraping-correios

Correios Scraping

Language: JavaScript - Size: 73.2 KB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 3 - Forks: 0

scrapeless-ai/scrapeless-sdk-python

SDK to access Scrapeless API directly from Python. We handle Proxies, Scraping Browser, Scraping API, Web Unlocker and Captcha Solver for you.

Language: Python - Size: 11.7 KB - Last synced at: 17 days ago - Pushed at: 5 months ago - Stars: 1 - Forks: 2

orsifrancesco/instagram-without-api-node

A simple Node.js code to get unlimited instagram public pictures by every user without api, without credentials.

Language: JavaScript - Size: 1.25 MB - Last synced at: 22 days ago - Pushed at: about 1 year ago - Stars: 68 - Forks: 10

myawesomebike/frog-cloud

ScreamingFrog in Docker with an API

Language: TypeScript - Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

lenoarditrryh/scraping

The Ultimate Guide to Web Scraping APIs in 2025

Size: 4.88 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

nirajmalviya/product-review-scraper

A Python-based web scraper for extracting product reviews from sites using curl_cffi and openpyxl. Includes support for sorting reviews, handling pagination, and saving results to Excel." This description highlights the key aspects of the project and tools used, making it easy for others to understand what your repository is about.

Language: Python - Size: 12.7 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 2 - Forks: 0

scrapeless-ai/scrapeless-sdk-go

SDK to access Scrapeless API directly from Golang. We handle Proxies, Scraping Browser, Scraping API, Web Unlocker and Captcha Solver for you.

Language: Go - Size: 10.7 KB - Last synced at: 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

jonesrussell/page-prowler

Experimental mashup of golang commands to scrape the web

Language: HTML - Size: 11.1 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 1

salvatorecorvaglia/database-project

Profiling of the community of online research laboratories and their contents

Language: Python - Size: 339 MB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

MontFerret/ferret-server

Advanced declarative web scraping

Language: Go - Size: 359 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 30 - Forks: 6

junioranheu/raspagem-de-api-python

Script desenvolvido em Python para "raspar" dados de uma API com ou sem token JWT e salvar em uma base de dados (MySQL ou SQL Server)

Language: Python - Size: 9.77 KB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

ScrapingAnt/zoominfo_scraper

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Language: Python - Size: 7.81 KB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 32 - Forks: 9

crawlbase/scrapy-proxycrawl-middleware 📦

Scrapy middleware interface to scrape using ProxyCrawl proxy service

Language: Python - Size: 34.2 KB - Last synced at: 14 days ago - Pushed at: almost 2 years ago - Stars: 11 - Forks: 3

suryasreddy/YouTube-Performance-Analysis

Analysis of YouTube video metrics to determine the impact of keywords, title length, and seasonality on viewer engagement

Language: Jupyter Notebook - Size: 142 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

chrismichaelps/ryuanime

A free anime streaming , using the jkanime content by scraping the jkanime website.

Language: Vue - Size: 2.77 MB - Last synced at: 3 days ago - Pushed at: 5 months ago - Stars: 22 - Forks: 14

Santa-Clara-Imaginarium-Lab/twitter-scraping-with-python

Twitter Scraping with Python!

Language: Python - Size: 36.1 KB - Last synced at: 9 months ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 2

umihico/minigun-requests

Web scraping API to outsource tons of GET & xpath to cloud computing

Language: Python - Size: 392 KB - Last synced at: 28 days ago - Pushed at: 11 months ago - Stars: 7 - Forks: 0

juftin/yellowstone-camping

Campsite Reservation Cancellation Finder (Yellowstone National Park)

Language: Python - Size: 19.5 KB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 13 - Forks: 6

ScrapingAnt/alibaba_scraper

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Language: Python - Size: 152 KB - Last synced at: about 1 month ago - Pushed at: 12 months ago - Stars: 16 - Forks: 3

serpwow/google-search-results-nodejs

Scrape and parse Google search results in Node.JS

Language: JavaScript - Size: 274 KB - Last synced at: about 12 hours ago - Pushed at: over 2 years ago - Stars: 32 - Forks: 3

Smartproxy/SERP-Scraping-API

SERP Scraping API code examples for Python, PHP and Node.js

Language: PHP - Size: 345 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 15 - Forks: 4

Smartproxy/eCommerce-Scraping-API

eCommerce Scraping API code examples for Python, PHP and Node.js

Language: PHP - Size: 151 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 21 - Forks: 4

Lusplitaim/wooordhunt-dotnet

Provides a custom API for fetching data from Wooordhunt dictionary.

Language: C# - Size: 19.5 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

Azure-Samples/durablefunctions-apiscraping-dotnet

Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.

Language: C# - Size: 33.2 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 107 - Forks: 89

Shuvo-BBHH/Web-Scraping

This repositories is Random Web Scraping projects

Language: Python - Size: 2.64 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

blablageeks/issues-scrapper

This tool is in charge of scrapping good first issues

Size: 12.7 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

KalyanM45/Article-Web-Scraping

This Python script is designed to scrape articles from The Guardian's technology section using their API. It fetches article data, extracts the titles and content, and then saves each article's content to separate text files. The text files are organized in a folder named with the current date and time of the scraping.

Language: Jupyter Notebook - Size: 116 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

serpwow/google-search-results-php

Scrape and parse Google search results in PHP

Language: PHP - Size: 72.3 KB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 19 - Forks: 8

crawlbase/proxycrawl-java 📦

ProxyCrawl Java library for scraping and crawling

Language: Java - Size: 13.7 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 0

scrape-do/python-sample

Best Rotating Proxy & Scraping API Alternative. Python Example.

Language: Python - Size: 120 KB - Last synced at: 3 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

martapanc/aoc-data-api

API to retrieve stars obtained by year from the personal account on adventofcode.com

Language: Kotlin - Size: 230 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

kckmdev/scraping_app

web scraping app

Language: HTML - Size: 10.6 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

fckveza/create-proxy

HTTP / HTTPS Proxy

Size: 3.97 MB - Last synced at: 2 months ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 1

mateuszbuda/webscraping-benchmark

Web scraping API benchmark

Language: Python - Size: 55.7 KB - Last synced at: over 1 year ago - Pushed at: almost 3 years ago - Stars: 9 - Forks: 1

akmalia3/news_scraping-News_API

News scraping form News API

Language: Python - Size: 6.84 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

DiegoRojasGonzalez/DevJobs-Chile

DevJobs Chile is an online platform that connects IT and software development professionals with companies in search of talent in Chile. Our platform utilizes real-time web scraping techniques to provide job opportunities in various areas, such as programming, web design, data analysis, and more.

Language: JavaScript - Size: 327 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

zago-crawly/crawly

Framework for creating, configuring, running and monitoring web-crawlers

Language: Python - Size: 486 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

mateuszbuda/instagram-scraping-fish

A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com

Language: Jupyter Notebook - Size: 26.4 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 1

Subrata-Rudra/github_scrapper_API

This is a simple flask api for getting someone's GitHub profile details such as Name, No. of public repositories, No. of followers, No. of following etc, made by scraping GitHub

Language: Python - Size: 3.91 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 2

shrav-6/datapreparation-entip

This project involves cleaning and preparing data for entip project

Language: Jupyter Notebook - Size: 2.93 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

Roho11/SofaScorePlayerCardAnalysis

Language: Python - Size: 18.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

crawlbase/proxycrawl-node 📦

ProxyCrawl Node library for scraping and crawling

Language: JavaScript - Size: 91.8 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 21 - Forks: 5

scrape-do/dotnet-example

Best Rotating Proxy & Scraping API Alternative. C# Example.

Language: C# - Size: 1000 Bytes - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

Azure-Samples/durablefunctions-apiscraping-nodejs

Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.

Language: JavaScript - Size: 202 KB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 34 - Forks: 13

serpwow/google-search-results-golang

Scrape and parse Google search results in Golang

Language: Go - Size: 10.7 KB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 5 - Forks: 1

NotTheStallion/EVE-Online_deals_finder-web-scraping-

This repository will have different deal finders for EVE Online, offering players ways to discover in-game opportunities like finding rare items, resources and trade routes. With multiple options available, players can optimize their gameplay and achieve their goals.

Language: Python - Size: 68.4 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0