0xIbra/robots-txt-component

Fully native robots.txt parsing component without any dependencies.

Language: JavaScript - Size: 19.5 KB - Last synced at: 13 days ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0