jaybizzle / laravel-crawler-detect

A Laravel wrapper for CrawlerDetect - the web crawler detection library

Laravel Crawler Detect

A Laravel wrapper for CrawlerDetect - the web crawler detection library

Installation

Run composer require jaybizzle/laravel-crawler-detect 1.* or add "jaybizzle/laravel-crawler-detect": "1.*" to your composer.json file.

The last version compatible with Laravel 4 was v1.0.2 so if you need that, you will have to fix your composer.json to that specific version.

Add the following to the providers array in your config/app.php file..

  Jaybizzle\LaravelCrawlerDetect\LaravelCrawlerDetectServiceProvider::class,

...and the following to your aliases array...

  'Crawler'   => Jaybizzle\LaravelCrawlerDetect\Facades\LaravelCrawlerDetect::class,

Laravel 5.5 uses Package Auto-Discovery, so doesn't require you to manually add the ServiceProvider.

Usage

use Crawler;

// Check current 'visitors' user agent
if(Crawler::isCrawler()) {
  // true if crawler user agent detected
}


// Pass a user agent as a string
if(Crawler::isCrawler('Mozilla/5.0 (compatible; aiHitBot/2.9; +https://www.aihitdata.com/about)')) {
  // true if crawler user agent detected
}

laravel-crawler-detect's Issues

Undefined type 'Crawler'.

On a fresh Laravel 8x install I followed the steps in the README like so:

Added " Jaybizzle\LaravelCrawlerDetect\LaravelCrawlerDetectServiceProvider::class," to config.app

Added " 'Crawler' => Jaybizzle\LaravelCrawlerDetect\Facades\LaravelCrawlerDetect::class," to aliases in config.app

Added "use Crawler;" at the top of a Livewire component

But when trying to use "Crawler::isCrawler()" I am getting the error: "Undefined type 'Crawler'."

Is there something I am missing?

Stable version

Your package looks nice, any chances of a stable version anytime soon?

I would like to use it on https://github.com/antonioribeiro/tracker.

Thank you!

Getting bot agent information

Is it possible to get any information at all related to the bot with this awesome library? How to?

Can this library return false positives?

So this isn't an issue, but rather a question - is there any possibility at all this library can return a false positive, i.e. return true even if the 'user' isn't a crawler?

User guide

I want to get data from other website . And i don't know how to get it with laravel-crawler-detect. Thanks

The browser version is not correctly defined `MZ Browser`

The browser version is not correctly defined.
Device: Mobile
Platform: AndroidOS 6.0
Founded Browser: Chrome 40.0.2214.89
Real Browser: MZ Browser 6.9
User Agent: Mozilla/5.0 (Linux; U; Android 6.0; zh-CN; MZ-PRO 6 Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/40.0.2214.89 MZBrowser/6.9.511-2018012510 UWS/2.11.0.33 Mobile Safari/537.36

php 8.3 support

will there be support for php 8.3?

  Problem 1
    - nette/schema v1.2.2 requires php >=7.1 <8.2 -> your php version (8.3.1) does not satisfy that requirement.

Ahrefs is not excluded?

Why ahrefs is not included by crawler detection?

54.36.149.249 - - [29/Jun/2023:08:08:52 +0000] "GET /hr/proizvod/kratke-hlace-nike-w-pro365-short-7in-hi-rise-34457 HTTP/2.0" 200 16893 "-" "Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)"

IP addresses not showing in table

Hi,
I have just installed this package, and it is not logging my users' IP to localhost, is that correct or should I do something?
Will it start logging users' IPs only after uploading files to the server?

Warning: preg_match(): Null byte in regex in /mnt/e/xampp/htdocs/vendor/jaybizzle/crawler-detect/src/CrawlerDetect.php on line 175

Warning: preg_match(): Null byte in regex in /mnt/e/xampp/htdocs/vendor/jaybizzle/crawler-detect/src/CrawlerDetect.php on line 175

Update Readme

Thanks for doing the work on this, really helped me a lot.

You may want to update the readme for new users of Laravel though.

under Aliases (in 5.4) they should use:

'Crawler'   => Jaybizzle\LaravelCrawlerDetect\Facades\LaravelCrawlerDetect::class,

and under Usage they need to add:

Use Crawler;

at the top.

Great work though, thanks.

R