Topic: "url-extractor"
patternhelloworld/url-knife
Extract and decompose (fuzzy) URLs (including emails, which are conceptually a part of URLs) in texts with Area-Pattern-based modularity
Language: TypeScript - Size: 958 KB - Last synced at: 20 days ago - Pushed at: 3 months ago - Stars: 351 - Forks: 15
dwisiswant0/galer
A fast tool to fetch URLs from HTML attributes by crawl-in.
Language: Go - Size: 70.3 KB - Last synced at: 14 days ago - Pushed at: 3 months ago - Stars: 252 - Forks: 39
r3dxpl0it/Damn-Small-URL-Crawler
A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website
Language: Python - Size: 26.4 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 19 - Forks: 9
eversinc33/urlExtract
Recursively extract urls from a web page for reconnaissance.
Language: Go - Size: 18.6 KB - Last synced at: 10 months ago - Pushed at: 11 months ago - Stars: 11 - Forks: 1
sp34rh34d/WebRunner
Web scraping | Website cloner | Path Traversal Scanner
Language: Python - Size: 56.6 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 10 - Forks: 4
httpreserve/tikalinkextract
Tika based link (URL) extractor for httpreserve
Language: HTML - Size: 171 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 9 - Forks: 1
yogsec/URL_Extractor
URL Extractor | Designed By YogSec is a powerful Bash script that helps you extract URLs from a single file or all files inside a folder
Language: Shell - Size: 954 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 5 - Forks: 2
superbeppe98/ebay-listing-matches
The eBay Listing Matcher is a Python script designed to compare and match eBay listings with parts from an Inventree instance. This script utilizes the eBay Trading API and the Inventree API to gather and process data.
Language: Python - Size: 73.2 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 5 - Forks: 0
limit-zero/url-juicer
🍊🔗 Squeeze some juice from URLs: A URL crawler/extraction library.
Language: JavaScript - Size: 269 KB - Last synced at: 22 days ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0
hrbrmstr/drill-twitter-text
An Apache Drill UDF for working with Twitter tweet text via the twitter-text Java library (https://github.com/twitter/twitter-text/tree/master/java)
Language: Java - Size: 117 KB - Last synced at: 18 days ago - Pushed at: almost 7 years ago - Stars: 5 - Forks: 3
SeyedMahmoudMousavi/url-extractor
Extract urls from your a file or web address
Language: PHP - Size: 12.7 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
hobsRKM/article-miner
Extract article title, description, images, keywords and authors from any URL
Language: JavaScript - Size: 14 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0
akash-rajak/URL-Extractor
A python script to extract URL from the text or paragraph.
Language: Python - Size: 1.14 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 1
khalidelboray/SrcSearch
Extract URLs,endpoints,paths and word-lists form source files
Language: Raku - Size: 8.79 KB - Last synced at: about 7 hours ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 1
OpenBookPublishers/geturls
Extact all URLs from anchor and image tags within a html/xhtml page and its children.
Language: Shell - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: almost 7 years ago - Stars: 2 - Forks: 2
Ishanoshada/ApacheStatusExtractor
Python tool to extract PID, Method, VHost, and Request from Apache server-status pages. Supports single and bulk URL checks for security analysis
Language: Python - Size: 14.6 KB - Last synced at: 8 days ago - Pushed at: 9 days ago - Stars: 1 - Forks: 0
hueristiq/hq-go-url
A Go (Golang) package for working with URLs.
Language: Go - Size: 290 KB - Last synced at: 11 days ago - Pushed at: 13 days ago - Stars: 1 - Forks: 0
dotdesh71/Website-URL-Scanner
Website URL Scanner is a simple command-line tool that allows you to scan a website and extract all URLs. It can be useful for various purposes, such as link analysis or checking for broken links.
Language: Batchfile - Size: 18.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
KOUISAmine/url-extractor
Extract http/https URLs from any kind of text content.
Language: HTML - Size: 3.91 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
zedseven/urlextractor
A small tool for extracting all urls from a blob of binary data (ex. PDFs).
Language: Go - Size: 4.88 KB - Last synced at: about 2 months ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0
superbeppe98/url-title-extractor
URL Title Extractor is a Python program that extracts the titles of web pages from a file containing URLs. It uses the requests and BeautifulSoup libraries to extract the title and decode any HTML entities.
Language: Python - Size: 43 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0
loneicewolf/RE_QUERY
A tool I use to search the web efficiently
Size: 61.5 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
AlteredAdmin/Link-Lifter
LinkLifter is a Python script that searches for URLs in a given text file or recursively in a directory and its subdirectories. The found URLs, along with the file they are located in, are saved to a CSV file.
Language: Python - Size: 4.88 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
ryanaryap/URL-Extractor
URL Extractor is a simple Python code designed to extract the domain name from a list of URLs stored in a text file. This application provides a convenient way to extract and process URLs efficiently.
Language: Python - Size: 6.84 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
jessicasimplicio/mD-links-lib
Bootcamp Laboratoria - Produto final do sprint 4. Biblioteca no npm para extracao de links em documento markdown.
Language: JavaScript - Size: 14.6 KB - Last synced at: 11 days ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0
manyfacedllama/email-attachment-url-extractor
File attachment and URL extractor for EML & MSG files using Python
Language: Python - Size: 6.84 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0
