I have developed a Multi Threading crawler for cache warmup. It works similar like crawler in cache plugin for Wordpress, but has some more features and is x-time faster.
Problem: If I set CURLOPT_NOBODY to true I get errors for reading communication packets in MySQL, but not at every request. It doesn't matter if I limit number of max. simultaneous requests to 1 or if a increase delay between each request. This issue only happens if I run crawler on an application that uses MyISAM engine, with INNODB everything works fine.
This is not a LSWS issue, but possibly there are any similar experiences with crawler scripts for LiteSpeed plugins?
Problem: If I set CURLOPT_NOBODY to true I get errors for reading communication packets in MySQL, but not at every request. It doesn't matter if I limit number of max. simultaneous requests to 1 or if a increase delay between each request. This issue only happens if I run crawler on an application that uses MyISAM engine, with INNODB everything works fine.
This is not a LSWS issue, but possibly there are any similar experiences with crawler scripts for LiteSpeed plugins?
Last edited: