muratgozel/robotstxt-util

RFC 9309 spec compliant robots.txt builder and parser. 🦾 No dependencies, fully typed.

Language: TypeScript - Size: 136 KB - Last synced at: 7 days ago - Pushed at: 9 months ago - Stars: 3 - Forks: 1