Topic: "crawler-detection"
hisorange/browser-detect
Browser Detection for Laravel by hisorange!
Language: PHP - Size: 928 KB - Last synced at: 6 months ago - Pushed at: 10 months ago - Stars: 1,089 - Forks: 144

scrapy-plugins/scrapy-zyte-smartproxy
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
Language: Python - Size: 270 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 348 - Forks: 88

loadkpi/crawler_detect
Ruby gem to detect bots and crawlers via the user agent
Language: Ruby - Size: 10.9 MB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 131 - Forks: 12

x-way/crawlerdetect
Golang module to detect bots and crawlers via the user agent
Language: Go - Size: 3.63 MB - Last synced at: 6 days ago - Pushed at: 12 days ago - Stars: 61 - Forks: 5

stephenafamo/isbot
Detect bots/crawlers/spiders using the user agent string.
Language: Go - Size: 435 KB - Last synced at: 21 days ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 0

zivdar001matin/web-crawler-detection
Final project of Rahnema College internship. Crawler detection using unsupervised learning methods.
Language: Python - Size: 4.57 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 13 - Forks: 0

BryanMorgan/isbot
Rust library to detect bots using a user-agent string
Language: Rust - Size: 4.04 MB - Last synced at: 10 months ago - Pushed at: almost 3 years ago - Stars: 12 - Forks: 1

loonies/corrode
A web crawler bot killer
Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 0

S4k1dl0/Bot-Analytics-with-PHP
A PHP-based application for detecting and logging bot activity on your website. This project utilizes CrawlerDetect to differentiate between human users and crawlers, storing relevant data in a MySQL database.
Language: PHP - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

vlados/laravel-blade-crawler-detect
Simple package for adding directives to show/hide content from crawlers
Language: PHP - Size: 71.3 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

RominaShin/Machine-Learning-Internship
A 2 months internship program at rahnema college
Language: Jupyter Notebook - Size: 2.28 MB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

manuelxaguilar/bot-inspector
Simple node user-agent inspector that detects bot requests
Language: JavaScript - Size: 53.7 KB - Last synced at: 5 days ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0
