An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: crawling-tasks

crawlab-team/crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架

Language: Go - Size: 23.5 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 11,720 - Forks: 1,829

crawlab-team/crawlab-lite

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

Language: Vue - Size: 2.36 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 224 - Forks: 75

xblanc33/crawler

JS Framework to scrapp any website.

Language: JavaScript - Size: 237 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 1