Topic: "scraping-web"
franckferman/MetaDetective
🕵️ Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.
Language: Python - Size: 19.2 MB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 360 - Forks: 35
deliton/idt
Image Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.
Language: Python - Size: 105 KB - Last synced at: 9 days ago - Pushed at: over 4 years ago - Stars: 228 - Forks: 27
pavlovtech/WebReaper
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
Language: C# - Size: 37.3 MB - Last synced at: 8 days ago - Pushed at: 6 months ago - Stars: 119 - Forks: 28
hhuayuan/spiderbuf
Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，通过大量的爬虫实战掌握常见的爬虫与反爬套路。 引导式爬虫案例 + 免费爬虫视频教程，以闯关的形式挑战各个爬虫任务，培养爬虫开发的直觉及经验，验证自身爬虫开发与反爬虫实力的时候到了。
Language: Python - Size: 128 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 87 - Forks: 8
ScrapingAnt/amazon_scraper
Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Language: JavaScript - Size: 52.7 KB - Last synced at: 15 days ago - Pushed at: about 1 year ago - Stars: 81 - Forks: 19
codegratia/react-node-web-scraper
Final Year project, scraping data of e-commerce stores and display in ReactJS app.
Language: JavaScript - Size: 14 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 45 - Forks: 18
officialpm/scrape-amazon
🤩 Python Package for Scraping Amazon Product Reviews ✨
Language: Python - Size: 134 KB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 34 - Forks: 11
Smartproxy/Web-Scraping-API
Web Scraping API code examples for Python, PHP and Node.js
Language: JavaScript - Size: 99.6 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 21 - Forks: 5
Smartproxy/eCommerce-Scraping-API
eCommerce Scraping API code examples for Python, PHP and Node.js
Language: PHP - Size: 151 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 21 - Forks: 4
Joabutt/ScrapeDogg
GPT4 Assisted Web Scraping Library
Language: JavaScript - Size: 8.79 KB - Last synced at: about 8 hours ago - Pushed at: over 1 year ago - Stars: 17 - Forks: 0
ScrapingAnt/alibaba_scraper
Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Language: Python - Size: 152 KB - Last synced at: 18 days ago - Pushed at: 11 months ago - Stars: 16 - Forks: 3
kurt213/scraper-auto-trader
A web scraper for extracting car ads data from Auto Trader
Language: Python - Size: 41 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 16 - Forks: 6
Smartproxy/SERP-Scraping-API
SERP Scraping API code examples for Python, PHP and Node.js
Language: PHP - Size: 345 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 15 - Forks: 4
alexferrari88/scrapeblocks
Scraping automation framework based on Playwright
Language: TypeScript - Size: 305 KB - Last synced at: 4 days ago - Pushed at: almost 3 years ago - Stars: 13 - Forks: 0
xLe0x/AcquiFinder
Get acquisitions by scraping titles of crunchbase.
Language: Python - Size: 11.7 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 12 - Forks: 2
gayanukabulegoda/Web-Scraping-Starter-Kit
Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.
Language: Python - Size: 10.7 KB - Last synced at: 13 days ago - Pushed at: 3 months ago - Stars: 7 - Forks: 0
gabyah92/HackerRankLeaderboardGUI
Scraping Leaderboards from HackerRank using Python
Language: Python - Size: 319 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 7 - Forks: 2
nikiroo/fanfix-jexer
A TUI interface with the library Jexer for fanfix
Language: Java - Size: 20.8 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 4 - Forks: 0
nikiroo/fanfix
A small program to download and convert fanfictions and comics from supported websites into offline files (epub, cbz...)
Language: Java - Size: 21.3 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 4 - Forks: 0
epythonlab/github-search-tool
Github Repository Search Tool
Language: Python - Size: 281 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1
yashsonwane/Scraping_GitHub_Topics
Scraping Github topics page. In scraping, first scrape topics Titles, Descriptions and URLs. By using the above info scrape all Topics which contain Username, Repo_name, Stars and repo_url.
Language: HTML - Size: 60.5 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0
CobaltGoldCS/Spindler
A book reading app optimized for Android. Use css paths to obtain content in a readable format
Language: C# - Size: 3.04 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
nikiroo/fanfix-swing
A graphical interface in SWING for fanfix
Language: Java - Size: 24.7 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 2 - Forks: 0
TheNoiselessNoise/csfd_scraper
Simple scraper for CSFD.cz, a Czech movie database.
Language: Python - Size: 140 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 2 - Forks: 1
SumitM01/Integrated-skill-tracker-using-websraping
A skill development tracking application which uses web scraping to collect data from various coding websites and displays stats for each user in one place making it easy to learn coding.
Language: Python - Size: 91.4 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
Marco90v/ScrapingDolarBs
Scraping Web del precio del dolar en bolívares, script para usar en polybar, extrae y muestra resultado
Language: Python - Size: 59.6 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0
LearnCodingEasy/Web_Scraping
Web Scraping
Language: Vue - Size: 165 KB - Last synced at: 3 days ago - Pushed at: 9 days ago - Stars: 1 - Forks: 0
YasinSalehi06/instagram-reels-scraper
A Python script designed to automate the scraping of Instagram reels, using Selenium ChromeDriver to interact with Instagram's interface. This script simplifies the process of downloading Instagram video content directly to your device.
Language: Python - Size: 14 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0
samircd4/Brainy-Quotes-Scrapy
Scrap 190k data from https://www.brainyquote.com/
Language: Python - Size: 7.25 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 1 - Forks: 0
MomirMilutinovic/smartcat-qna-weaviate
RAG chatbot that answers questions about SmartCat. Powered by Weaviate and Cohere.
Language: Python - Size: 36.1 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0
ritikaga/Forbes-Realtime-Billionaires-Data-web-scraping
Scrape Forbes website data: Top Billionaires in the world 2023, using python libraries. Save the data into csv file.
Language: Python - Size: 8.79 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
rizkhal/aniflix-api
🔥 AniFlix API
Language: JavaScript - Size: 3.54 MB - Last synced at: 12 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 1
jeankassio/Sioner-Metadata-Extractor
Sioner Metadata Extractor uses Chromedriver to extract metadata from websites with javascript using Symfony/Panther.
Language: PHP - Size: 27.3 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0
Jefe21054/web-scraping-python
Web Scraping Amazon & eBay in searching products, extracting their price and comparing what is the best value for the money with push desktop notifications for user.
Language: Python - Size: 6.64 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
KAispread/Instagram-image-downloader
💟 Instagram Image Downloader
Language: Java - Size: 208 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
Strykez/fastscrape
A simple web scraper built with python and beautifulfoup.
Language: Python - Size: 5.86 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1
opop999/TI_monitoring_transparent_accounts_2021
Automatized scraping and analysis of Czech transparent election accounts for the 2021 pre-election monitoring.
Language: HTML - Size: 308 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0
Souvic/mtweepy
Fastest scraping using multiple apps and user tokens for Twitter API!
Language: Python - Size: 81.1 KB - Last synced at: 6 days ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0
suyashphatak23/Web-Crawler-GUI
Web Crawling Bot GUI: Intermediate Python
Language: Python - Size: 1.02 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0
dfleper/Puppeteer
Example of how Puppeteer works. Ejemplo de funcionamiento de Puppeteer.
Language: JavaScript - Size: 43.9 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 0 - Forks: 0
sashinram/DAPO
An Open-source RL System from ByteDance Seed and Tsinghua AIR
Size: 1.96 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
Tittoh/table-scraping
Scraping data from html tables,
Language: JavaScript - Size: 317 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
TheODDYSEY/YTS-Pipeline-Postgres
ETL pipeline 🪈 for scraping, transforming, and loading YTS movie data 🎞️ into PostgreSQL 🛢️ Container using Docker🐳
Language: Python - Size: 66.4 KB - Last synced at: 27 days ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0
prakhar362/Real-Estate-Agency
Horizon Homes Realty: Leading the Future of Real Estate. Discover our Web3-powered platform for asset management, NFT tokenization, and digitization index.
Language: JavaScript - Size: 43.8 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0
egin10/dapodik_go
Command Line App untuk scraping data sekolah dari web dapodik (Data Refrensi) : https://referensi.data.kemdikbud.go.id
Language: Go - Size: 29.4 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
NotTheStallion/EVE-Online_deals_finder-web-scraping-
This repository will have different deal finders for EVE Online, offering players ways to discover in-game opportunities like finding rare items, resources and trade routes. With multiple options available, players can optimize their gameplay and achieve their goals.
Language: Python - Size: 68.4 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
andrealenzi11/py-web-miner
Extensible Web Miner to extract information from web pages. It is based on HTTP Requests library, Beautiful Soup parser, and Selenium WebDriver.
Language: Python - Size: 24.4 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
OkeyProxyCom/Scraping-Proxy
In this article, we’ll take a look at what is proxy scarping, why use proxies for web scraping, types of web scraping proxy, and how to use proxy for web scraping.
Size: 7.81 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
reijin90/easyfind.com-scraper
A python script which scrapes and parses the easyfind.com, a Swiss lost and found page, with selenium into a CSV file
Language: Python - Size: 13.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
TheOwaisShaikh/Langchainwebsitescraper
Extract product details from WooCommerce sites using the langchain web extraction library and OpenAI's GPT models.
Language: Python - Size: 7.81 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
Braa-GH/node.js-scrapping-cpaverify
nodejs web scraping using puppeteer on cpaverify website
Language: JavaScript - Size: 77.1 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
anujbarochia/crawlee-puppeteer-domain.com.au
Scraper for extracting data from a Real Estate listing site.
Language: JavaScript - Size: 111 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
MERTTUTUM/python_ile_projeler
Python ile gelişmiş örnek projeler
Language: Python - Size: 22.2 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
kkoutoup/Scrape-report-info-pdf-html
Python script used to scrape data from html pages and online pdfs
Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
heartshapedbox/python
Python learning. Tasks.
Language: Python - Size: 12.6 MB - Last synced at: 24 days ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
axbecher/Supply_Status_Checker
A python script for web scraping to check if a product exists on a website and create a HTML table with 4 columns: Availability, Product Name, URL and Timestamp and send that table to your email.
Language: HTML - Size: 91.4 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
jayhere1/go_scraper
Web scraper using Golang with set parallelism and json support
Language: Go - Size: 46.9 KB - Last synced at: 10 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
socramel/scraping-elpais
Web scraping en NodeJS para extraer titulares de la página elpais.com
Language: JavaScript - Size: 13.7 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
capan/google-image-search
AWS CDK code that creates an API GW and a Lambda function. Lambda function searches incoming query string in Google images and returns first image url as response.
Language: JavaScript - Size: 113 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
hendrapaiton/makelar
Web Proxy for Python Web Crawler and Ethical Hacking
Language: Python - Size: 16.6 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
vaibh15/Web-Scraping
This Repo shows you how to scrape web page/pages using with Selenium and Beautiful Soup.
Language: Jupyter Notebook - Size: 47.9 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
salvatorecorvaglia/database-project
Profiling of the community of online research laboratories and their contents
Language: Python - Size: 339 MB - Last synced at: 17 days ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
aj4abinjacob/Google-Maps-Review-Scraper
Scrape google maps reviews
Language: Jupyter Notebook - Size: 29.3 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
BTawaifi/puppeteer-general-scraper
Customizable application for webscraping using puppeteer
Language: JavaScript - Size: 156 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
heriswn/Scraping
Scraping Website for Education
Language: Python - Size: 24.4 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
xjz1016/SI-507-Final-Project
Language: Python - Size: 7.73 MB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0
devildances/RecommenderSystem_Project
A simple project to provide recommendations for types of food & beverages that are suitable for users who want to start a culinary business in certain areas in Jakarta, Indonesia.
Language: Jupyter Notebook - Size: 41.6 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0
Aniruddhsinh03/splashWithJavaScriptWebsiteLuaScript
Language: Python - Size: 1.23 MB - Last synced at: 8 months ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0
Aniruddhsinh03/scrapySeleniumDemo
Language: Python - Size: 1.99 MB - Last synced at: 8 months ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0
Aniruddhsinh03/scrapyFormRequestDemo
Language: Python - Size: 231 KB - Last synced at: 8 months ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0