lorien/awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

Language: Makefile - Size: 473 KB - Last synced at: 6 days ago - Pushed at: 4 months ago - Stars: 6,970 - Forks: 805

omkarcloud/botasaurus-starter

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

Language: TypeScript - Size: 397 KB - Last synced at: 1 day ago - Pushed at: 2 months ago - Stars: 24 - Forks: 8

RevoltSecurities/SpideyX

SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.

Language: Python - Size: 973 KB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 159 - Forks: 28

harismuneer/Android-Apps-Downloader

📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).

Language: Python - Size: 2.82 MB - Last synced at: 19 days ago - Pushed at: 3 months ago - Stars: 33 - Forks: 19

kodjunkie/node-raspar

🕷️ Easily scrap the web for torrent and media files.

Language: JavaScript - Size: 635 KB - Last synced at: 11 days ago - Pushed at: over 2 years ago - Stars: 12 - Forks: 7

miroshnikov/scrapyteer

Web crawling & scraping framework for Node.js on top of headless Chrome browser

Language: TypeScript - Size: 384 KB - Last synced at: 23 days ago - Pushed at: about 1 year ago - Stars: 19 - Forks: 0

Marcel0024/CocoCrawler

An declarative and easy to use web crawler and scraper in C#

Language: C# - Size: 83 KB - Last synced at: 15 days ago - Pushed at: 8 months ago - Stars: 27 - Forks: 3

omkarcloud/web-scraping-template

🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

Language: Python - Size: 104 KB - Last synced at: 32 minutes ago - Pushed at: almost 2 years ago - Stars: 7 - Forks: 3

CyberPlatoon/DirFinder_old

The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use

Language: Python - Size: 429 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 2

Meenapintu/Crawler

A web Crowler design , basic setup c++

Language: C++ - Size: 789 KB - Last synced at: 11 months ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 1

patgdut/GoogleMapsScraper

By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.

Size: 4.88 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

UCI-Networking-Group/firetastic

Firetastic - a tool for automating interaction with FireTV apps

Language: Python - Size: 159 KB - Last synced at: 5 months ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 4

mareksuma1985/WordPress_Newsup_crawler

Selenium automatic test that visits every article on WordPress site.

Language: Java - Size: 8.79 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

devidw/google-untitled-spam-spider

A spam spider which is targeting 'Untitled' spam pages from the Google search results.

Language: Python - Size: 6.84 KB - Last synced at: 6 months ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

Ak-wa/Kankra

A Website Spider/Crawler, Python 3.x

Language: Python - Size: 218 KB - Last synced at: almost 2 years ago - Pushed at: about 5 years ago - Stars: 4 - Forks: 1

recepkizilarslan/console-tourist

Tourist is a simple tool that allows you to collect console messages, errors, unsuccessful requests of all your pages after the DOM loading with authentication support.

Language: JavaScript - Size: 49.8 KB - Last synced at: 14 days ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

levanhieu-git/firetastic Fork of UCI-Networking-Group/firetastic

Firetastic - a tool for automating interaction with FireTV apps

Language: Python - Size: 163 KB - Last synced at: 11 months ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

elibooklover/TwitterCrawling

Language: Python - Size: 2.93 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

khanof89/CourseraCrawler

This python script crawls course title, ratings, description and instructors from coursera.org

Language: Python - Size: 1000 Bytes - Last synced at: about 2 months ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 1