GitHub / CrawlScript / WebCollector
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CrawlScript%2FWebCollector
PURL: pkg:github/CrawlScript/WebCollector
Stars: 3,073
Forks: 1,450
Open issues: 62
License: gpl-3.0
Language: Java
Size: 278 MB
Dependencies parsed at: Pending
Created at: almost 11 years ago
Updated at: 27 days ago
Pushed at: 5 months ago
Last synced at: 26 days ago
Loading...