GitHub / scottstraughan / simple-python-url-crawler
Super simple Python3 website URL scraper/crawler. Multi-threaded.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/scottstraughan%2Fsimple-python-url-crawler
Stars: 3
Forks: 3
Open issues: 0
License: mit
Language: Python
Size: 21.5 KB
Dependencies parsed at: Pending
Created at: over 5 years ago
Updated at: 5 months ago
Pushed at: about 3 years ago
Last synced at: about 1 month ago
Topics: crawler, googlebot, lightweight, link-collection, multi-threaded, python, python3, scraper, simple
Loading...