GitHub / atymri / WebCrawler
WebCrawler is a C# console application that recursively scans a website starting from a given URL, collects all discovered links, and saves them to a file. It’s useful for site mapping, link analysis, and content discovery.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/atymri%2FWebCrawler
PURL: pkg:github/atymri/WebCrawler
Stars: 7
Forks: 2
Open issues: 0
License: None
Language: C#
Size: 85 KB
Dependencies parsed at: Pending
Created at: 2 months ago
Updated at: 11 days ago
Pushed at: 11 days ago
Last synced at: 10 days ago
Topics: cli, commandline, commandline-interface, commandline-tool, crawler, crawler-csharp, crawler-engine, crawling-sites, git, github, grabber, opensource, url, web, web-crawler, web-crawling, website