Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: scraping-api

BeyondGoodAndDev/Doublegram-Startup-Telegram-Scraper-Adder

Add users to your groups and channels automatically using your Telegram accounts. Doublegram let you do that easily and in an automatic and personalized way.

Size: 222 KB - Last synced: about 8 hours ago - Pushed: about 20 hours ago - Stars: 9 - Forks: 2

pavlovtech/WebReaper

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

Language: C# - Size: 37.3 MB - Last synced: 5 days ago - Pushed: 5 months ago - Stars: 93 - Forks: 19

serpapi/serpapi-python

an official Python client library for SerpApi.

Language: Python - Size: 389 KB - Last synced: 9 days ago - Pushed: 5 months ago - Stars: 37 - Forks: 3

jonesrussell/page-prowler

Experimental mashup of golang commands to scrape the web

Language: Go - Size: 10.8 MB - Last synced: 11 days ago - Pushed: 11 days ago - Stars: 0 - Forks: 1

oxylabs/serp-scraper-api-guide

A quick-start guide on using SERP Scraper API

Size: 23.4 KB - Last synced: 12 days ago - Pushed: about 1 month ago - Stars: 370 - Forks: 3

oxylabs/amazon-scraper

Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

Language: Python - Size: 95.7 KB - Last synced: 12 days ago - Pushed: about 1 month ago - Stars: 488 - Forks: 31

scrapfly/python-scrapfly

Scrapfly Python SDK for headless browsers and proxy rotation

Language: Python - Size: 375 KB - Last synced: 14 days ago - Pushed: 14 days ago - Stars: 18 - Forks: 3

serpwow/google-search-results-nodejs

Scrape and parse Google search results in Node.JS

Language: JavaScript - Size: 274 KB - Last synced: 8 days ago - Pushed: over 1 year ago - Stars: 32 - Forks: 3

Mixtre/Goprox

πŸš€ Goprox: Simplify Google searches with automatic proxy handling and user-agent selection.

Language: Python - Size: 14.6 KB - Last synced: 20 days ago - Pushed: 21 days ago - Stars: 7 - Forks: 0

kunalnagarco/imdb-scraper πŸ“¦

🎬 An attempt at the most complete IMDb API

Language: TypeScript - Size: 1.06 MB - Last synced: 9 days ago - Pushed: 4 months ago - Stars: 34 - Forks: 7

ScrapingAnt/amazon_scraper

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Language: JavaScript - Size: 52.7 KB - Last synced: 24 days ago - Pushed: about 2 months ago - Stars: 75 - Forks: 18

Smartproxy/Social-Media-Scraping-API

Social Media Scraping API code examples for Python, PHP and Node.js

Language: PHP - Size: 80.1 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 13 - Forks: 4

Smartproxy/SERP-Scraping-API

SERP Scraping API code examples for Python, PHP and Node.js

Language: PHP - Size: 345 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 15 - Forks: 4

Smartproxy/Web-Scraping-API

Web Scraping API code examples for Python, PHP and Node.js

Language: JavaScript - Size: 99.6 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 21 - Forks: 5

Smartproxy/eCommerce-Scraping-API

eCommerce Scraping API code examples for Python, PHP and Node.js

Language: PHP - Size: 151 KB - Last synced: 28 days ago - Pushed: 28 days ago - Stars: 21 - Forks: 4

Lusplitaim/wooordhunt-dotnet

Provides a custom API for fetching data from Wooordhunt dictionary.

Language: C# - Size: 19.5 KB - Last synced: 29 days ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

juftin/yellowstone-camping

Campsite Reservation Cancellation Finder (Yellowstone National Park)

Language: Python - Size: 19.5 KB - Last synced: 1 day ago - Pushed: almost 3 years ago - Stars: 10 - Forks: 5

Azure-Samples/durablefunctions-apiscraping-dotnet

Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.

Language: C# - Size: 33.2 KB - Last synced: 22 days ago - Pushed: 6 months ago - Stars: 107 - Forks: 89

Shuvo-BBHH/Web-Scraping

This repositories is Random Web Scraping projects

Language: Python - Size: 2.64 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 3 - Forks: 0

SergeyArzumanyan/Link_Scraper

API scrapes websites for data, allowing programmatic access to public information for your applications. Send a website URL to get the data back in a structured format.

Language: Python - Size: 13.7 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

macsencasaus/jetapi

web scraping API to gather info about aircraft from JetPhotos and FlightRadar

Language: Go - Size: 372 KB - Last synced: about 1 month ago - Pushed: 2 months ago - Stars: 1 - Forks: 0

blablageeks/issues-scrapper

This tool is in charge of scrapping good first issues

Size: 12.7 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

Smartproxy/zalando_python_scraper

Scrape Zalando utilising Smartproxy's Web Scraping API

Language: Python - Size: 4.88 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 2 - Forks: 0

KalyanM45/Article-Web-Scraping

This Python script is designed to scrape articles from The Guardian's technology section using their API. It fetches article data, extracts the titles and content, and then saves each article's content to separate text files. The text files are organized in a folder named with the current date and time of the scraping.

Language: Jupyter Notebook - Size: 116 KB - Last synced: 1 day ago - Pushed: 5 months ago - Stars: 4 - Forks: 0

orsifrancesco/instagram-without-api-node

A simple Node.js code to get unlimited instagram public pictures by every user without api, without credentials.

Language: JavaScript - Size: 1.25 MB - Last synced: 24 days ago - Pushed: 2 months ago - Stars: 61 - Forks: 22

Matthew17-21/Captcha-Tools

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!

Language: Go - Size: 144 KB - Last synced: about 2 months ago - Pushed: 5 months ago - Stars: 56 - Forks: 5

Smartproxy/trustpilot_python_scraper

Scrape Trustpilot utilising Smartproxy's Web Scraping API

Language: Python - Size: 16.6 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 4 - Forks: 0

serpwow/google-search-results-php

Scrape and parse Google search results in PHP

Language: PHP - Size: 72.3 KB - Last synced: 3 months ago - Pushed: about 4 years ago - Stars: 19 - Forks: 8

crawlbase/proxycrawl-java πŸ“¦

ProxyCrawl Java library for scraping and crawling

Language: Java - Size: 13.7 KB - Last synced: 3 months ago - Pushed: 10 months ago - Stars: 4 - Forks: 0

martapanc/aoc-data-api

API to retrieve stars obtained by year from the personal account on adventofcode.com

Language: Kotlin - Size: 230 KB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0

kckmdev/scraping_app

web scraping app

Language: HTML - Size: 10.6 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0

mateuszbuda/webscraping-benchmark

Web scraping API benchmark

Language: Python - Size: 55.7 KB - Last synced: 5 months ago - Pushed: almost 2 years ago - Stars: 9 - Forks: 1

akmalia3/news_scraping-News_API

News scraping form News API

Language: Python - Size: 6.84 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

DiegoRojasGonzalez/DevJobs-Chile

DevJobs Chile is an online platform that connects IT and software development professionals with companies in search of talent in Chile. Our platform utilizes real-time web scraping techniques to provide job opportunities in various areas, such as programming, web design, data analysis, and more.

Language: JavaScript - Size: 327 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 1 - Forks: 0

zago-crawly/crawly

Framework for creating, configuring, running and monitoring web-crawlers

Language: Python - Size: 486 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 1

mateuszbuda/instagram-scraping-fish

A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com

Language: Jupyter Notebook - Size: 26.4 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 11 - Forks: 1

Subrata-Rudra/github_scrapper_API

This is a simple flask api for getting someone's GitHub profile details such as Name, No. of public repositories, No. of followers, No. of following etc, made by scraping GitHub

Language: Python - Size: 3.91 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 2 - Forks: 2

shrav-6/datapreparation-entip

This project involves cleaning and preparing data for entip project

Language: Jupyter Notebook - Size: 2.93 KB - Last synced: 7 months ago - Pushed: over 2 years ago - Stars: 1 - Forks: 0

MontFerret/ferret-server

Advanced declarative web scraping

Language: Go - Size: 359 KB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 29 - Forks: 6

Roho11/SofaScorePlayerCardAnalysis

Language: Python - Size: 18.6 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0

crawlbase/scrapy-proxycrawl-middleware πŸ“¦

Scrapy middleware interface to scrape using ProxyCrawl proxy service

Language: Python - Size: 34.2 KB - Last synced: 24 days ago - Pushed: 10 months ago - Stars: 10 - Forks: 3

crawlbase/proxycrawl-node πŸ“¦

ProxyCrawl Node library for scraping and crawling

Language: JavaScript - Size: 91.8 KB - Last synced: 3 months ago - Pushed: 10 months ago - Stars: 21 - Forks: 5

ChrisMichaelPerezSantiago/ryuanime

A free anime streaming , using the jkanime content by scraping the jkanime website.

Language: Vue - Size: 3.61 MB - Last synced: 17 days ago - Pushed: 17 days ago - Stars: 21 - Forks: 13

scrape-do/dotnet-example

Best Rotating Proxy & Scraping API Alternative. C# Example.

Language: C# - Size: 1000 Bytes - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0

Azure-Samples/durablefunctions-apiscraping-nodejs

Build an Azure Durable Functions that will scrape GitHub for opened issues and store them on Azure Storage.

Language: JavaScript - Size: 202 KB - Last synced: 22 days ago - Pushed: about 1 year ago - Stars: 34 - Forks: 13

ScrapingAnt/alibaba_scraper

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Language: Python - Size: 151 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 10 - Forks: 3

Santa-Clara-Media-Lab/twitter-scraping-with-python

Twitter Scraping with Python!

Language: Python - Size: 36.1 KB - Last synced: 10 months ago - Pushed: over 2 years ago - Stars: 5 - Forks: 2

serpwow/google-search-results-golang

Scrape and parse Google search results in Golang

Language: Go - Size: 10.7 KB - Last synced: 9 months ago - Pushed: about 4 years ago - Stars: 5 - Forks: 1

GeeKboy2/EVE-Online_deals_finder-web-scraping-

This repository will have different deal finders for EVE Online, offering players ways to discover in-game opportunities like finding rare items, resources and trade routes. With multiple options available, players can optimize their gameplay and achieve their goals.

Language: Python - Size: 68.4 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

junioranheu/raspagem-de-api-python

Script desenvolvido em Python para "raspar" dados de uma API com ou sem token JWT e salvar em uma base de dados (MySQL ou SQL Server)

Language: Python - Size: 9.77 KB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 1 - Forks: 0

manuparra/html-renderer Fork of zenato/puppeteer-renderer

HTML Rendered with Docker

Language: JavaScript - Size: 269 KB - Last synced: 9 months ago - Pushed: over 4 years ago - Stars: 2 - Forks: 0

glennfang/apple-app-reviews-scraper

Apple App Store reviews scraper with backoff strategy to tackle rate limiting

Language: Jupyter Notebook - Size: 12.7 KB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 1 - Forks: 0

arpitamangal/web-scraping

Projects related to web scraping

Language: Python - Size: 454 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 0 - Forks: 0

rizkhal/aniflix-api

πŸ”₯ AniFlix API

Language: JavaScript - Size: 3.54 MB - Last synced: 1 day ago - Pushed: 12 months ago - Stars: 1 - Forks: 1

ScrapingAnt/zoominfo_scraper

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Language: Python - Size: 7.81 KB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 18 - Forks: 6

rafaellagp/Real-estate-price-prediction-FullProject

BeCode Project - Immo Eliza Full Project - Complete pipeline of Real Estate price prediction.

Language: Jupyter Notebook - Size: 4.35 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 2 - Forks: 0

jaeyk/digital_data_collection_workshop

Digital Data Collection Workshop

Language: HTML - Size: 4.86 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 6 - Forks: 0

carvalhoviniciusluiz/web-scraping-correios

Correios Scraping

Language: JavaScript - Size: 73.2 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 5 - Forks: 0

fckveza/create-proxy

HTTP / HTTPS Proxy

Size: 3.97 MB - Last synced: about 1 year ago - Pushed: about 3 years ago - Stars: 4 - Forks: 1

wzykubek/searx-instance-scrapi πŸ“¦

Experimental ScrAPI to get information about Searx instance.

Language: Python - Size: 12.7 KB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 0 - Forks: 0

mateuszbuda/walmart-scraping-fish

A tutorial for scraping Walmart product details using Scraping Fish API: https://scrapingfish.com

Language: Jupyter Notebook - Size: 146 KB - Last synced: 9 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

prodseanb/BooksToScrape

Scraping exercise: https://books.toscrape.com/index.html

Language: Python - Size: 22.5 KB - Last synced: 12 months ago - Pushed: almost 3 years ago - Stars: 3 - Forks: 1

kadiryaren/-TorChangeIP

Tor IP Changer for Linux and MacOS!

Language: Python - Size: 4.88 KB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 3 - Forks: 1

npranav10/acciotables

API to scrap data from dynamic webpages. (say tables on Sports Reference websites)

Size: 122 KB - Last synced: 10 months ago - Pushed: about 4 years ago - Stars: 12 - Forks: 0

fffelix-jan/emailsanta-py

Python library to "send a letter to Santa" using emailsanta.com and receive a properly-formatted plaintext reply

Language: Python - Size: 34.2 KB - Last synced: about 12 hours ago - Pushed: almost 2 years ago - Stars: 1 - Forks: 0

mfalfafa/web-scraping-airnow

Scrape historical data of air quality from dosairnowdata.org

Language: Python - Size: 35.4 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

mfalfafa/web-scraping-api

Web scraping in Python using Request with API

Language: Python - Size: 35.9 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

Drewsky33/NBA-Playoff-Tweet-Analysis

Analyzed tweets about the NBA playoffs.

Language: Jupyter Notebook - Size: 3.45 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

usametov/mls-node-script

MLS mini-scraper

Language: JavaScript - Size: 6.84 KB - Last synced: 11 months ago - Pushed: over 5 years ago - Stars: 2 - Forks: 0

addi-kamal/Scraping

Le projet Γ©crit en Python (notebook jupyter) en deux parties : -Srapper la data Γ  partir du site web : BeautifulSoup, Requests -L'analyse et l'exploitation de la data : Numpy, Pandas,Matplotlib, Seaborn..

Language: Jupyter Notebook - Size: 2.63 MB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 1 - Forks: 0

umihico/minigun-requests

Web scraping API to outsource tons of GET & xpath to cloud computing

Language: Python - Size: 413 KB - Last synced: 1 day ago - Pushed: over 5 years ago - Stars: 8 - Forks: 0

vulturno/lurte

🌊 Scraping AEMET

Language: Shell - Size: 58.6 KB - Last synced: 18 days ago - Pushed: about 2 years ago - Stars: 8 - Forks: 2

bcdan/ToxicPlantsIdentifier

Find out if that plant you're getting is toxic to your pet or not

Language: JavaScript - Size: 11.7 MB - Last synced: 13 days ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

Zummation/SEC-API

Get daily NAV data of Thailand's active funds

Language: Python - Size: 24.6 MB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 1 - Forks: 0

MayankFawkes/Instagram-Scraper

Instagram Scraper and Downloader

Language: Python - Size: 24.4 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 2 - Forks: 1

tylerhall/tadpoles-api

A PHP script which pretends to be the Tadpoles.com iPhone app and downloads/backs-up all of your kids' photos and videos from daycare.

Language: PHP - Size: 12.7 KB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 4 - Forks: 1

namanjakhetiya/popularrepos

Language: Python - Size: 4.41 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 1

David-Lor/pysgapi

A Python "API" for the Steamgifts website

Language: Python - Size: 11.7 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

Ravit436/WebPage-Scraping-With-Puppeteer

WebPage Scraping With Puppeteer

Language: JavaScript - Size: 64.5 KB - Last synced: 11 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

nikhitmago/nlp-project

This project attempts to annotate and classify Youtube videos taking into account the content of the video and the composition of the text/captions. While youtube flags content inappropriate for young audiences by requiring viewers to sign in, a lot of youtube content is generally unaudited if the uploader of the video does not flag it as appropriate for a particular age group. Also there is no distinction as to what content is appropriate for which age groups. In this project, we will classify content based the film rating system: ​G, PG, PG-13 and R.​

Language: Python - Size: 17.4 MB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0