Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub topics: scraping-api
BeyondGoodAndDev/Doublegram-Startup-Telegram-Scraper-Adder
Add users to your groups and channels automatically using your Telegram accounts. Doublegram let you do that easily and in an automatic and personalized way.
Size: 222 KB - Last synced: about 8 hours ago - Pushed: about 20 hours ago - Stars: 9 - Forks: 2
pavlovtech/WebReaper
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
Language: C# - Size: 37.3 MB - Last synced: 5 days ago - Pushed: 5 months ago - Stars: 93 - Forks: 19
serpapi/serpapi-python
an official Python client library for SerpApi.
Language: Python - Size: 389 KB - Last synced: 9 days ago - Pushed: 5 months ago - Stars: 37 - Forks: 3
jonesrussell/page-prowler
Experimental mashup of golang commands to scrape the web
Language: Go - Size: 10.8 MB - Last synced: 11 days ago - Pushed: 11 days ago - Stars: 0 - Forks: 1
oxylabs/serp-scraper-api-guide
A quick-start guide on using SERP Scraper API
Size: 23.4 KB - Last synced: 12 days ago - Pushed: about 1 month ago - Stars: 370 - Forks: 3
oxylabs/amazon-scraper
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
Language: Python - Size: 95.7 KB - Last synced: 12 days ago - Pushed: about 1 month ago - Stars: 488 - Forks: 31
scrapfly/python-scrapfly
Scrapfly Python SDK for headless browsers and proxy rotation
Language: Python - Size: 375 KB - Last synced: 14 days ago - Pushed: 14 days ago - Stars: 18 - Forks: 3
serpwow/google-search-results-nodejs
Scrape and parse Google search results in Node.JS
Language: JavaScript - Size: 274 KB - Last synced: 8 days ago - Pushed: over 1 year ago - Stars: 32 - Forks: 3
Mixtre/Goprox
π Goprox: Simplify Google searches with automatic proxy handling and user-agent selection.
Language: Python - Size: 14.6 KB - Last synced: 20 days ago - Pushed: 21 days ago - Stars: 7 - Forks: 0
kunalnagarco/imdb-scraper π¦
π¬ An attempt at the most complete IMDb API
Language: TypeScript - Size: 1.06 MB - Last synced: 9 days ago - Pushed: 4 months ago - Stars: 34 - Forks: 7
ScrapingAnt/amazon_scraper
Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Language: JavaScript - Size: 52.7 KB - Last synced: 24 days ago - Pushed: about 2 months ago - Stars: 75 - Forks: 18
Smartproxy/Social-Media-Scraping-API
Social Media Scraping API code examples for Python, PHP and Node.js
Language: PHP - Size: 80.1 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 13 - Forks: 4
Smartproxy/SERP-Scraping-API
SERP Scraping API code examples for Python, PHP and Node.js
Language: PHP - Size: 345 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 15 - Forks: 4
Smartproxy/Web-Scraping-API
Web Scraping API code examples for Python, PHP and Node.js
Language: JavaScript - Size: 99.6 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 21 - Forks: 5
Smartproxy/eCommerce-Scraping-API
eCommerce Scraping API code examples for Python, PHP and Node.js
Language: PHP - Size: 151 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 21 - Forks: 4
Lusplitaim/wooordhunt-dotnet
Provides a custom API for fetching data from Wooordhunt dictionary.
Language: C# - Size: 19.5 KB - Last synced: 29 days ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0
juftin/yellowstone-camping
Campsite Reservation Cancellation Finder (Yellowstone National Park)
Language: Python - Size: 19.5 KB - Last synced: 1 day ago - Pushed: almost 3 years ago - Stars: 10 - Forks: 5
Azure-Samples/durablefunctions-apiscraping-dotnet
Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.
Language: C# - Size: 33.2 KB - Last synced: 22 days ago - Pushed: 6 months ago - Stars: 107 - Forks: 89
Shuvo-BBHH/Web-Scraping
This repositories is Random Web Scraping projects
Language: Python - Size: 2.64 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 3 - Forks: 0
SergeyArzumanyan/Link_Scraper
API scrapes websites for data, allowing programmatic access to public information for your applications. Send a website URL to get the data back in a structured format.
Language: Python - Size: 13.7 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0
macsencasaus/jetapi
web scraping API to gather info about aircraft from JetPhotos and FlightRadar
Language: Go - Size: 372 KB - Last synced: about 1 month ago - Pushed: 2 months ago - Stars: 1 - Forks: 0
blablageeks/issues-scrapper
This tool is in charge of scrapping good first issues
Size: 12.7 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0
Smartproxy/zalando_python_scraper
Scrape Zalando utilising Smartproxy's Web Scraping API
Language: Python - Size: 4.88 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 2 - Forks: 0
KalyanM45/Article-Web-Scraping
This Python script is designed to scrape articles from The Guardian's technology section using their API. It fetches article data, extracts the titles and content, and then saves each article's content to separate text files. The text files are organized in a folder named with the current date and time of the scraping.
Language: Jupyter Notebook - Size: 116 KB - Last synced: 1 day ago - Pushed: 5 months ago - Stars: 4 - Forks: 0
orsifrancesco/instagram-without-api-node
A simple Node.js code to get unlimited instagram public pictures by every user without api, without credentials.
Language: JavaScript - Size: 1.25 MB - Last synced: 24 days ago - Pushed: 2 months ago - Stars: 61 - Forks: 22
Matthew17-21/Captcha-Tools
All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!
Language: Go - Size: 144 KB - Last synced: about 2 months ago - Pushed: 5 months ago - Stars: 56 - Forks: 5
Smartproxy/trustpilot_python_scraper
Scrape Trustpilot utilising Smartproxy's Web Scraping API
Language: Python - Size: 16.6 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 4 - Forks: 0
serpwow/google-search-results-php
Scrape and parse Google search results in PHP
Language: PHP - Size: 72.3 KB - Last synced: 3 months ago - Pushed: about 4 years ago - Stars: 19 - Forks: 8
crawlbase/proxycrawl-java π¦
ProxyCrawl Java library for scraping and crawling
Language: Java - Size: 13.7 KB - Last synced: 3 months ago - Pushed: 10 months ago - Stars: 4 - Forks: 0
martapanc/aoc-data-api
API to retrieve stars obtained by year from the personal account on adventofcode.com
Language: Kotlin - Size: 230 KB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0
kckmdev/scraping_app
web scraping app
Language: HTML - Size: 10.6 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0
mateuszbuda/webscraping-benchmark
Web scraping API benchmark
Language: Python - Size: 55.7 KB - Last synced: 5 months ago - Pushed: almost 2 years ago - Stars: 9 - Forks: 1
akmalia3/news_scraping-News_API
News scraping form News API
Language: Python - Size: 6.84 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0
DiegoRojasGonzalez/DevJobs-Chile
DevJobs Chile is an online platform that connects IT and software development professionals with companies in search of talent in Chile. Our platform utilizes real-time web scraping techniques to provide job opportunities in various areas, such as programming, web design, data analysis, and more.
Language: JavaScript - Size: 327 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 1 - Forks: 0
zago-crawly/crawly
Framework for creating, configuring, running and monitoring web-crawlers
Language: Python - Size: 486 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 1
mateuszbuda/instagram-scraping-fish
A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com
Language: Jupyter Notebook - Size: 26.4 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 11 - Forks: 1
Subrata-Rudra/github_scrapper_API
This is a simple flask api for getting someone's GitHub profile details such as Name, No. of public repositories, No. of followers, No. of following etc, made by scraping GitHub
Language: Python - Size: 3.91 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 2 - Forks: 2
shrav-6/datapreparation-entip
This project involves cleaning and preparing data for entip project
Language: Jupyter Notebook - Size: 2.93 KB - Last synced: 7 months ago - Pushed: over 2 years ago - Stars: 1 - Forks: 0
MontFerret/ferret-server
Advanced declarative web scraping
Language: Go - Size: 359 KB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 29 - Forks: 6
Roho11/SofaScorePlayerCardAnalysis
Language: Python - Size: 18.6 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0
crawlbase/scrapy-proxycrawl-middleware π¦
Scrapy middleware interface to scrape using ProxyCrawl proxy service
Language: Python - Size: 34.2 KB - Last synced: 24 days ago - Pushed: 10 months ago - Stars: 10 - Forks: 3
crawlbase/proxycrawl-node π¦
ProxyCrawl Node library for scraping and crawling
Language: JavaScript - Size: 91.8 KB - Last synced: 3 months ago - Pushed: 10 months ago - Stars: 21 - Forks: 5
ChrisMichaelPerezSantiago/ryuanime
A free anime streaming , using the jkanime content by scraping the jkanime website.
Language: Vue - Size: 3.61 MB - Last synced: 17 days ago - Pushed: 17 days ago - Stars: 21 - Forks: 13
scrape-do/dotnet-example
Best Rotating Proxy & Scraping API Alternative. C# Example.
Language: C# - Size: 1000 Bytes - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
Azure-Samples/durablefunctions-apiscraping-nodejs
Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.
Language: JavaScript - Size: 202 KB - Last synced: 22 days ago - Pushed: about 1 year ago - Stars: 34 - Forks: 13
ScrapingAnt/alibaba_scraper
Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Language: Python - Size: 151 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 10 - Forks: 3
Santa-Clara-Media-Lab/twitter-scraping-with-python
Twitter Scraping with Python!
Language: Python - Size: 36.1 KB - Last synced: 10 months ago - Pushed: over 2 years ago - Stars: 5 - Forks: 2
serpwow/google-search-results-golang
Scrape and parse Google search results in Golang
Language: Go - Size: 10.7 KB - Last synced: 9 months ago - Pushed: about 4 years ago - Stars: 5 - Forks: 1
GeeKboy2/EVE-Online_deals_finder-web-scraping-
This repository will have different deal finders for EVE Online, offering players ways to discover in-game opportunities like finding rare items, resources and trade routes. With multiple options available, players can optimize their gameplay and achieve their goals.
Language: Python - Size: 68.4 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0
junioranheu/raspagem-de-api-python
Script desenvolvido em Python para "raspar" dados de uma API com ou sem token JWT e salvar em uma base de dados (MySQL ou SQL Server)
Language: Python - Size: 9.77 KB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 1 - Forks: 0
manuparra/html-renderer Fork of zenato/puppeteer-renderer
HTML Rendered with Docker
Language: JavaScript - Size: 269 KB - Last synced: 9 months ago - Pushed: over 4 years ago - Stars: 2 - Forks: 0
glennfang/apple-app-reviews-scraper
Apple App Store reviews scraper with backoff strategy to tackle rate limiting
Language: Jupyter Notebook - Size: 12.7 KB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 1 - Forks: 0
arpitamangal/web-scraping
Projects related to web scraping
Language: Python - Size: 454 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 0 - Forks: 0
rizkhal/aniflix-api
π₯ AniFlix API
Language: JavaScript - Size: 3.54 MB - Last synced: 1 day ago - Pushed: 12 months ago - Stars: 1 - Forks: 1
ScrapingAnt/zoominfo_scraper
Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Language: Python - Size: 7.81 KB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 18 - Forks: 6
rafaellagp/Real-estate-price-prediction-FullProject
BeCode Project - Immo Eliza Full Project - Complete pipeline of Real Estate price prediction.
Language: Jupyter Notebook - Size: 4.35 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 2 - Forks: 0
jaeyk/digital_data_collection_workshop
Digital Data Collection Workshop
Language: HTML - Size: 4.86 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 6 - Forks: 0
carvalhoviniciusluiz/web-scraping-correios
Correios Scraping
Language: JavaScript - Size: 73.2 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 5 - Forks: 0
fckveza/create-proxy
HTTP / HTTPS Proxy
Size: 3.97 MB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 4 - Forks: 1
wzykubek/searx-instance-scrapi π¦
Experimental ScrAPI to get information about Searx instance.
Language: Python - Size: 12.7 KB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 0 - Forks: 0
mateuszbuda/walmart-scraping-fish
A tutorial for scraping Walmart product details using Scraping Fish API: https://scrapingfish.com
Language: Jupyter Notebook - Size: 146 KB - Last synced: 9 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0
prodseanb/BooksToScrape
Scraping exercise: https://books.toscrape.com/index.html
Language: Python - Size: 22.5 KB - Last synced: 12 months ago - Pushed: almost 3 years ago - Stars: 3 - Forks: 1
kadiryaren/-TorChangeIP
Tor IP Changer for Linux and MacOS!
Language: Python - Size: 4.88 KB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 3 - Forks: 1
npranav10/acciotables
API to scrap data from dynamic webpages. (say tables on Sports Reference websites)
Size: 122 KB - Last synced: 10 months ago - Pushed: about 4 years ago - Stars: 12 - Forks: 0
fffelix-jan/emailsanta-py
Python library to "send a letter to Santa" using emailsanta.com and receive a properly-formatted plaintext reply
Language: Python - Size: 34.2 KB - Last synced: about 12 hours ago - Pushed: almost 2 years ago - Stars: 1 - Forks: 0
mfalfafa/web-scraping-airnow
Scrape historical data of air quality from dosairnowdata.org
Language: Python - Size: 35.4 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0
mfalfafa/web-scraping-api
Web scraping in Python using Request with API
Language: Python - Size: 35.9 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0
Drewsky33/NBA-Playoff-Tweet-Analysis
Analyzed tweets about the NBA playoffs.
Language: Jupyter Notebook - Size: 3.45 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0
usametov/mls-node-script
MLS mini-scraper
Language: JavaScript - Size: 6.84 KB - Last synced: 11 months ago - Pushed: over 5 years ago - Stars: 2 - Forks: 0
addi-kamal/Scraping
Le projet Γ©crit en Python (notebook jupyter) en deux parties : -Srapper la data Γ partir du site web : BeautifulSoup, Requests -L'analyse et l'exploitation de la data : Numpy, Pandas,Matplotlib, Seaborn..
Language: Jupyter Notebook - Size: 2.63 MB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 1 - Forks: 0
umihico/minigun-requests
Web scraping API to outsource tons of GET & xpath to cloud computing
Language: Python - Size: 413 KB - Last synced: 1 day ago - Pushed: over 5 years ago - Stars: 8 - Forks: 0
vulturno/lurte
π Scraping AEMET
Language: Shell - Size: 58.6 KB - Last synced: 18 days ago - Pushed: about 2 years ago - Stars: 8 - Forks: 2
bcdan/ToxicPlantsIdentifier
Find out if that plant you're getting is toxic to your pet or not
Language: JavaScript - Size: 11.7 MB - Last synced: 13 days ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0
Zummation/SEC-API
Get daily NAV data of Thailand's active funds
Language: Python - Size: 24.6 MB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 1 - Forks: 0
MayankFawkes/Instagram-Scraper
Instagram Scraper and Downloader
Language: Python - Size: 24.4 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 2 - Forks: 1
tylerhall/tadpoles-api
A PHP script which pretends to be the Tadpoles.com iPhone app and downloads/backs-up all of your kids' photos and videos from daycare.
Language: PHP - Size: 12.7 KB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 4 - Forks: 1
namanjakhetiya/popularrepos
Language: Python - Size: 4.41 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 1
David-Lor/pysgapi
A Python "API" for the Steamgifts website
Language: Python - Size: 11.7 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0
Ravit436/WebPage-Scraping-With-Puppeteer
WebPage Scraping With Puppeteer
Language: JavaScript - Size: 64.5 KB - Last synced: 11 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0
nikhitmago/nlp-project
This project attempts to annotate and classify Youtube videos taking into account the content of the video and the composition of the text/captions. While youtube flags content inappropriate for young audiences by requiring viewers to sign in, a lot of youtube content is generally unaudited if the uploader of the video does not flag it as appropriate for a particular age group. Also there is no distinction as to what content is appropriate for which age groups. In this project, we will classify content based the film rating system: βG, PG, PG-13 and R.β
Language: Python - Size: 17.4 MB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0