An open API service providing repository metadata for many open source software ecosystems.

Topic: "crawler-detection"

hisorange/browser-detect

Browser Detection for Laravel by hisorange!

Language: PHP - Size: 928 KB - Last synced at: 6 months ago - Pushed at: 10 months ago - Stars: 1,089 - Forks: 144

scrapy-plugins/scrapy-zyte-smartproxy

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

Language: Python - Size: 270 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 348 - Forks: 88

loadkpi/crawler_detect

Ruby gem to detect bots and crawlers via the user agent

Language: Ruby - Size: 10.9 MB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 131 - Forks: 12

x-way/crawlerdetect

Golang module to detect bots and crawlers via the user agent

Language: Go - Size: 3.63 MB - Last synced at: 6 days ago - Pushed at: 12 days ago - Stars: 61 - Forks: 5

stephenafamo/isbot

Detect bots/crawlers/spiders using the user agent string.

Language: Go - Size: 435 KB - Last synced at: 21 days ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 0

zivdar001matin/web-crawler-detection

Final project of Rahnema College internship. Crawler detection using unsupervised learning methods.

Language: Python - Size: 4.57 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 13 - Forks: 0

BryanMorgan/isbot

Rust library to detect bots using a user-agent string

Language: Rust - Size: 4.04 MB - Last synced at: 10 months ago - Pushed at: almost 3 years ago - Stars: 12 - Forks: 1

loonies/corrode

A web crawler bot killer

Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 0

S4k1dl0/Bot-Analytics-with-PHP

A PHP-based application for detecting and logging bot activity on your website. This project utilizes CrawlerDetect to differentiate between human users and crawlers, storing relevant data in a MySQL database.

Language: PHP - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

vlados/laravel-blade-crawler-detect

Simple package for adding directives to show/hide content from crawlers

Language: PHP - Size: 71.3 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

RominaShin/Machine-Learning-Internship

A 2 months internship program at rahnema college

Language: Jupyter Notebook - Size: 2.28 MB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

manuelxaguilar/bot-inspector

Simple node user-agent inspector that detects bot requests

Language: JavaScript - Size: 53.7 KB - Last synced at: 5 days ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0