Litespeed blocking Google bot

[Serge_S]

Hi,

We have been running Litespeed for years. In the past couple of weeks we have started seeing Connection Reset errors in Google Webmaster's Crawl statistics. We also started seeing Temporarily Unavailable errors when using Fetch as Google.

Upon further inspection I managed to catch in the logs the following error

[66.249.69.185] bot detected, reason: 5, close connection!

This is the Google Bot and it is essential that it has access to all of our website at all times.

I can't seem to find any configuration options to disable bot detection.

We are running 2-CPU LSWS Owned LiteSpeed Web Server version 5.1.10 that was just now updated from 5.1.9

 

[mistwang]

reason: 5

it is triggered by a mod_security rule "drop" action, you should review your mod_security audit log to find out which rule was triggered, then disable that rule.

 

[Serge_S]

Thank you for the answer. I'll look deeper into it. It does not show up in ModSec logs, but it might be some rule with nolog option. At least I have something to go on now.