GitHub topics: crawler-detection
x-way/crawlerdetect
Golang module to detect bots and crawlers via the user agent
Language: Go - Size: 3.63 MB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 62 - Forks: 6
scrapy-plugins/scrapy-zyte-smartproxy
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
Language: Python - Size: 300 KB - Last synced at: about 22 hours ago - Pushed at: 3 months ago - Stars: 363 - Forks: 90
loadkpi/crawler_detect
Ruby gem to detect bots and crawlers via the user agent
Language: Ruby - Size: 3.78 MB - Last synced at: 13 days ago - Pushed at: 3 months ago - Stars: 133 - Forks: 12
hisorange/browser-detect
Browser Detection for Laravel by hisorange!
Language: PHP - Size: 1.14 MB - Last synced at: 18 days ago - Pushed at: 6 months ago - Stars: 1,121 - Forks: 143
S4k1dl0/Bot-Analytics-with-PHP
A PHP-based application for detecting and logging bot activity on your website. This project utilizes CrawlerDetect to differentiate between human users and crawlers, storing relevant data in a MySQL database.
Language: PHP - Size: 3.91 KB - Last synced at: 7 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0
vlados/laravel-blade-crawler-detect
Simple package for adding directives to show/hide content from crawlers
Language: PHP - Size: 92.8 KB - Last synced at: about 7 hours ago - Pushed at: about 18 hours ago - Stars: 0 - Forks: 0
BryanMorgan/isbot
Rust library to detect bots using a user-agent string
Language: Rust - Size: 4.04 MB - Last synced at: 12 months ago - Pushed at: almost 3 years ago - Stars: 12 - Forks: 1
stephenafamo/isbot
Detect bots/crawlers/spiders using the user agent string.
Language: Go - Size: 435 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 0
RominaShin/Machine-Learning-Internship
A 2 months internship program at rahnema college
Language: Jupyter Notebook - Size: 2.28 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
zivdar001matin/web-crawler-detection
Final project of Rahnema College internship. Crawler detection using unsupervised learning methods.
Language: Python - Size: 4.57 MB - Last synced at: over 2 years ago - Pushed at: almost 4 years ago - Stars: 13 - Forks: 0
manuelxaguilar/bot-inspector
Simple node user-agent inspector that detects bot requests
Language: JavaScript - Size: 53.7 KB - Last synced at: 25 days ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0
loonies/corrode
A web crawler bot killer
Language: Python - Size: 5.86 KB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 0
