Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / fesiong / collector
这是一个由golang编写的采集器,可以自动识别文章列表和文章内容。使用它来采集文章并不需要编写正则表达式,你只需要提供文章列表页的连接即可。
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fesiong%2Fcollector
Stars: 32
Forks: 13
Open Issues: 3
License: mit
Language: Go
Repo Size: 4.7 MB
Dependencies:
243
Created: almost 4 years ago
Updated: about 1 year ago
Last pushed: about 1 year ago
Last synced: about 1 year ago
Files
Loading...
Readme
Loading...
Dependencies
go.mod
go
- github.com/Chain-Zhang/pinyin v0.1.3
- github.com/PuerkitoBio/goquery v1.5.1
- github.com/adamzy/cedar-go v0.0.0-20170805034717-80a9c64b256d
- github.com/ajg/form v1.5.1
- github.com/axgle/mahonia v0.0.0-20180208002826-3358181d7394
- github.com/fasthttp-contrib/websocket v0.0.0-20160511215533-1f3b11f56072
- github.com/fesiong/goproject/convert v0.0.0-20210407013830-243f22255055
- github.com/google/go-querystring v1.0.0
- github.com/huichen/sego v0.0.0-20180617034105-3f3c8a8cfacc
- github.com/imkira/go-interpol v1.1.0
- github.com/issue9/assert v1.4.0
- github.com/jinzhu/gorm v1.9.14
- github.com/k0kubun/colorstring v0.0.0-20150214042306-9440f1994b88
- github.com/kataras/iris/v12 v12.1.8
- github.com/mattn/go-colorable v0.1.7
- github.com/moul/http2curl v1.0.0
- github.com/onsi/ginkgo v1.14.0
- github.com/parnurzeal/gorequest v0.2.16
- github.com/polaris1119/keyword v0.0.0-20170608075927-96ae6735f2f2
- github.com/robfig/cron/v3 v3.0.1
- github.com/sergi/go-diff v1.1.0
- github.com/shurcooL/sanitized_anchor_name v1.0.0
- github.com/stretchr/testify v1.5.1
- github.com/valyala/fasthttp v1.16.0
- github.com/xeipuuv/gojsonschema v1.2.0
- github.com/yalp/jsonpath v0.0.0-20180802001716-5cc68e5049a0
- github.com/yudai/gojsondiff v1.0.0
- github.com/yudai/golcs v0.0.0-20170316035057-ecda9a501e82
- github.com/yudai/pp v2.0.1+incompatible
- golang.org/x/crypto v0.0.0-20200820211705-5c72a883971a
- golang.org/x/net v0.0.0-20200904194848-62affa334b73
- golang.org/x/sys v0.0.0-20200909081042-eff7692f9009
- golang.org/x/xerrors v0.0.0-20200804184101-5ec99f83aff1