An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: node-spider

xiyuan-fengyu/ppspider

web spider built by puppeteer, support task-queue and task-scheduling by decorators,support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架,提供灵活的任务队列管理调度方案,提供便捷的数据保存方案(nedb/mongodb),提供数据可视化和用户交互的实现方案

Language: TypeScript - Size: 1.59 MB - Last synced at: about 3 hours ago - Pushed at: over 3 years ago - Stars: 337 - Forks: 77

zeeklog/csdn-crawler

A Node.js Crawler for csdn.com. node 爬虫,csdn 爬虫, 爬取csdn 用户的全部文章。代码仅用于测试和交流学习,请勿用于不良用途。

Language: JavaScript - Size: 135 KB - Last synced at: 9 days ago - Pushed at: 10 months ago - Stars: 2 - Forks: 1

SangLiang/ChangshaHousingPricesList

A Changsha housing prices list program by WeiXin small APP

Language: JavaScript - Size: 36.1 KB - Last synced at: over 1 year ago - Pushed at: over 8 years ago - Stars: 0 - Forks: 1

yangfan0095/guwen-spider

一个完整的nodeJs 串行爬虫 抓取3万多个页面。

Language: JavaScript - Size: 856 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 134 - Forks: 19

cliek/fast-spider

A simple and fast crawler tool based on node

Language: JavaScript - Size: 234 KB - Last synced at: 4 days ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 1

qiangzi7723/spider-for-novel

a node spider for crawl novels and with a front-end progress show

Language: JavaScript - Size: 6.2 MB - Last synced at: over 2 years ago - Pushed at: almost 8 years ago - Stars: 0 - Forks: 0