GitHub / samclarke / robots-parser
NodeJS robots.txt parser with support for wildcard (*) matching.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samclarke%2Frobots-parser
PURL: pkg:github/samclarke/robots-parser
Stars: 156
Forks: 19
Open issues: 1
License: mit
Language: JavaScript
Size: 506 KB
Dependencies parsed at: Pending
Created at: over 10 years ago
Updated at: about 1 month ago
Pushed at: 8 months ago
Last synced at: about 19 hours ago
Commit Stats
Commits: 79
Authors: 8
Mean commits per author: 9.88
Development Distribution Score: 0.127
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/samclarke/robots-parser
Topics: javascript, nodejs, rfc-9309, robots-exclusion-standard, robots-parser, robots-txt, user-agent