1970Mr/link-crawler

Web Link Crawler: A Python script to crawl websites and collect links based on a regex pattern. Efficient and customizable.

Language: Python - Size: 32.2 KB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

ynbh/walker

A link walker that recursively checks for broken links in a website.

Language: Rust - Size: 31.2 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0

batikanturkmen/link-crawler

crawl given link and create graph according to link and its adjacent that is in the same domain

Language: Python - Size: 1.37 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

yordadev/FenrisJS

A NodeJS application that scrapes any links from a given input and outputs the results nicely into one of two files, external or internal file for further analysis.

Language: JavaScript - Size: 8.79 KB - Last synced at: 4 months ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

ArifulProtik/Recon404

Language: Python - Size: 5.86 KB - Last synced at: over 2 years ago - Pushed at: almost 6 years ago - Stars: 2 - Forks: 1