GitHub topics: x-robots-tag
VIPnytt/UserAgentParser
User-Agent parser for robots.txt, X-Robots-tag and Robots-meta-tag rule sets
Language: PHP - Size: 38.1 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 2
lerni/folderindex
Silverstripe Module to set X-Robots-Tag noindex, nofollow, noimageindex, noarchive, and nosnippet for files in folders and sub-folders when ShowInSearch is unchecked.
Language: PHP - Size: 236 KB - Last synced at: 22 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 1
toimik/RobotsProtocol
Parsers for robots.txt (aka Robots Exclusion Standard / Robots Exclusion Protocol), Robots Meta Tag, and X-Robots-Tag
Language: C# - Size: 198 KB - Last synced at: about 9 hours ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
uretgec/roboindex-checker
Website meta tag checker tool made by both node and golang for my education
Language: Go - Size: 20.5 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0
