Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / jonesrussell / page-prowler
Experimental mashup of golang commands to scrape the web
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonesrussell%2Fpage-prowler
Stars: 0
Forks: 1
Open Issues: 0
License: mit
Language: Go
Repo Size: 10.8 MB
Dependencies:
84
Created: over 2 years ago
Updated: 10 days ago
Last pushed: 10 days ago
Last synced: 10 days ago
Topics: scraping-api, scraping-websites
Files
Loading...
Readme
Loading...
Dependencies
go.mod
go
- github.com/PuerkitoBio/goquery v1.7.1
- github.com/adrg/strutil v0.3.0
- github.com/andybalholm/cascadia v1.2.0
- github.com/antchfx/htmlquery v1.2.3
- github.com/antchfx/xmlquery v1.3.6
- github.com/antchfx/xpath v1.1.10
- github.com/bbalet/stopwords v1.0.0
- github.com/caneroj1/stemmer v0.0.0-20170128035808-c9f2ce1504d5
- github.com/cespare/xxhash/v2 v2.1.2
- github.com/davecgh/go-spew v1.1.1
- github.com/dgryski/go-rendezvous v0.0.0-20200823014737-9f7001d12a5f
- github.com/go-redis/redis/v8 v8.11.5
- github.com/gobwas/glob v0.2.3
- github.com/gocolly/colly v1.2.0
- github.com/golang/groupcache v0.0.0-20200121045136-8c9f03a8e57e
- github.com/golang/protobuf v1.3.1
- github.com/google/jsonapi v1.0.0
- github.com/joho/godotenv v1.4.0
- github.com/kennygrant/sanitize v1.2.4
- github.com/saintfish/chardet v0.0.0-20120816061221-3af4cd4741ca
- github.com/temoto/robotstxt v1.1.2
- golang.org/x/net v0.0.0-20210902165921-8d991716f632
- golang.org/x/text v0.3.6
- google.golang.org/appengine v1.6.7
.github/workflows/main.yml
actions
- actions/checkout v3 composite
- actions/setup-go v3 composite
.devcontainer/Dockerfile
docker
- mcr.microsoft.com/devcontainers/go 1-1.21-bullseye build
go.sum
go
- github.com/PuerkitoBio/goquery v1.7.1
- github.com/adrg/strutil v0.3.0
- github.com/andybalholm/cascadia v1.2.0
- github.com/antchfx/htmlquery v1.2.3
- github.com/antchfx/xmlquery v1.3.6
- github.com/antchfx/xpath v1.1.6
- github.com/antchfx/xpath v1.1.10
- github.com/bbalet/stopwords v1.0.0
- github.com/caneroj1/stemmer v0.0.0-20170128035808-c9f2ce1504d5
- github.com/cespare/xxhash/v2 v2.1.2
- github.com/davecgh/go-spew v1.1.0
- github.com/davecgh/go-spew v1.1.1
- github.com/dgryski/go-rendezvous v0.0.0-20200823014737-9f7001d12a5f
- github.com/fsnotify/fsnotify v1.4.9
- github.com/go-redis/redis/v8 v8.11.5
- github.com/gobwas/glob v0.2.3
- github.com/gocolly/colly v1.2.0
- github.com/golang/groupcache v0.0.0-20200121045136-8c9f03a8e57e
- github.com/golang/protobuf v1.3.1
- github.com/google/jsonapi v1.0.0
- github.com/joho/godotenv v1.4.0
- github.com/kennygrant/sanitize v1.2.4
- github.com/nxadm/tail v1.4.8
- github.com/onsi/ginkgo v1.16.5
- github.com/onsi/gomega v1.18.1
- github.com/pmezard/go-difflib v1.0.0
- github.com/saintfish/chardet v0.0.0-20120816061221-3af4cd4741ca
- github.com/stretchr/objx v0.1.0
- github.com/stretchr/testify v1.3.0
- github.com/stretchr/testify v1.7.1
- github.com/temoto/robotstxt v1.1.2
- golang.org/x/crypto v0.0.0-20190308221718-c2843e01d9a2
- golang.org/x/crypto v0.0.0-20200622213623-75b288015ac9
- golang.org/x/net v0.0.0-20180218175443-cbe0f9307d01
- golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
- golang.org/x/net v0.0.0-20190603091049-60506f45cf65
- golang.org/x/net v0.0.0-20200421231249-e086a090c8fd
- golang.org/x/net v0.0.0-20200813134508-3edf25e44fcc
- golang.org/x/net v0.0.0-20210614182718-04defd469f4e
- golang.org/x/net v0.0.0-20210902165921-8d991716f632
- golang.org/x/sys v0.0.0-20190215142949-d0b11bdaac8a
- golang.org/x/sys v0.0.0-20190412213103-97732733099d
- golang.org/x/sys v0.0.0-20200323222414-85ca7c5b95cd
- golang.org/x/sys v0.0.0-20201119102817-f84b799fce68
- golang.org/x/sys v0.0.0-20210423082822-04245dca01da
- golang.org/x/sys v0.0.0-20211216021012-1d35b9e2eb4e
- golang.org/x/term v0.0.0-20201126162022-7de9c90e9dd1
- golang.org/x/text v0.3.0
- golang.org/x/text v0.3.2
- golang.org/x/text v0.3.6
- golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e
- google.golang.org/appengine v1.6.7
- gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405
- gopkg.in/tomb.v1 v1.0.0-20141024135613-dd632973f1e7
- gopkg.in/yaml.v2 v2.4.0
- gopkg.in/yaml.v3 v3.0.0-20200313102051-9f266ea9e77c