GitHub topics: webpage-scraper
joelbarmettlerUZH/Scrapeasy
Scraping in python made easy - receive the content you like in just one line of code
Language: Python - Size: 63.5 KB - Last synced at: 2 days ago - Pushed at: 2 months ago - Stars: 101 - Forks: 51
jcottam/html-metadata
Simplifies the extraction of HTML meta and Open Graph tags from HTML content or URLs.
Language: TypeScript - Size: 1.42 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
BilalAhmadKhanKhattak/LinkxDoxer
LinkxDoxer is a Python script designed to efficiently retrieve all links found directly under the webpage of a given URL. It is ideal for web developers, bug bounty hunters, and OSINT (Open-Source Intelligence) enthusiasts seeking to analyze links under a webpage and uncover valuable information(Expected In Ideal Cases)
Language: Python - Size: 126 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 4 - Forks: 1
BilalAhmadKhanKhattak/LinkxDoctor
LinkxDoctor is a Python tool that scans a webpage to identify both broken and valid links. It provides a report on the link status, helping ensure all links on the page are functional. This Project Is Indeed The Successor Of One Of My Previous Projects, LinkxDoxer
Language: Python - Size: 13.7 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0
DivineOmega/web-article-formatter
🌐🔀📰 Converts a webpage article into other formats, like PDF, markdown, JSON, plain text...
Language: PHP - Size: 16.6 KB - Last synced at: 19 days ago - Pushed at: about 7 years ago - Stars: 9 - Forks: 0
Datasilk/Charlotte
An off-screen Chromium web browser used to extract the computed DOM from any web page using .NET Core WCF.
Language: JavaScript - Size: 892 KB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 2
Aravindhan-G/Profile_Scrapper
Bot to scarp user profile data in Linked-in .
Language: Python - Size: 14.6 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 3 - Forks: 0
vladimanaev/web-spider
web crawler allowing full page render crawl using HtmlUnit
Language: Java - Size: 48.8 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 5 - Forks: 0
plugnsearch/plugnsearch
The only real pluggable crawler / spider / webcrawler to search the web for stuff you need to know.
Language: JavaScript - Size: 1.48 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 2
screenshotmachine/screenshotmachine-python
Simple example how to call screenshot machine's API using python programming language.
Language: Python - Size: 3.91 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 4 - Forks: 0
youstinus/car-scrape
Scrapes website content, puts to sqlite3 database, downloads preview picture
Language: Go - Size: 6.84 KB - Last synced at: 28 days ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
SurajAdsul/laravel-analyser
A Laravel application to analyse the web pages
Language: PHP - Size: 222 KB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0
