Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / pzaino / thecrowler
Another personal website indexer, this time in Golang and using Selenium webdriver. Please note: This is the new official repo for the project, old C++ and Rust versions are now closed, please follow this repo for updates.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pzaino%2Fthecrowler
Stars: 7
Forks: 2
Open Issues: 0
License: apache-2.0
Language: Go
Repo Size: 34.6 MB
Dependencies:
175
Created: 6 months ago
Updated: about 16 hours ago
Last pushed: about 16 hours ago
Last synced: about 16 hours ago
Topics: automation, content-detection, content-discovery, crawler, crawling, cyber-security, cybersecurity, cybersecurity-tools, golang, indexer, indexing, scraping, search-engine
Files
Dependencies
- ${DOCKER_SELENIUM_IMAGE -selenium/standalone-chrome-debug
- postgres latest
- github.com/PuerkitoBio/goquery v1.8.1
- github.com/andybalholm/cascadia v1.3.1
- github.com/antchfx/htmlquery v1.3.0
- github.com/antchfx/xpath v1.2.3
- github.com/blang/semver v3.5.1+incompatible
- github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
- github.com/lib/pq v1.10.9
- github.com/tebeka/selenium v0.9.9
- golang.org/x/net v0.17.0
- golang.org/x/text v0.13.0
- gopkg.in/yaml.v2 v2.4.0
- actions/checkout v3 composite
- actions/setup-go v4 composite
- actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
- actions/setup-go 93397bea11091df50f3d7e59dc26a7711a8bcfbe composite
- github/codeql-action/analyze 0b21cf2492b6b02c465a3e5d7c473717ad7721ba composite
- github/codeql-action/autobuild 0b21cf2492b6b02c465a3e5d7c473717ad7721ba composite
- github/codeql-action/init 0b21cf2492b6b02c465a3e5d7c473717ad7721ba composite
- step-security/harden-runner eb238b55efaa70779f274895e782ed17c84f2895 composite
- actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
- actions/dependency-review-action 4901385134134e04cec5fbe5ddfe3b2c5bd5d976 composite
- step-security/harden-runner eb238b55efaa70779f274895e782ed17c84f2895 composite
- actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
- actions/upload-artifact 3cea5372237819ed00197afe530f5a7ea3e805c8 composite
- github/codeql-action/upload-sarif 0b21cf2492b6b02c465a3e5d7c473717ad7721ba composite
- ossf/scorecard-action 0864cf19026789058feabb7e87baa5f140aac736 composite
- step-security/harden-runner eb238b55efaa70779f274895e782ed17c84f2895 composite
- actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
- codacy/codacy-analysis-cli-action 5cc54a75f9ad88159bb54046196d920e40e367a5 composite
- github/codeql-action/upload-sarif b7bf0a3ed3ecfa44160715d7c442788f65f0f923 composite
- step-security/harden-runner eb238b55efaa70779f274895e782ed17c84f2895 composite