i can't be certain all of its related to liespeed
but for the past month about i have been unable to complete a sitemap crawl.
normally when the crawler gets an error like a timeout or 500 error it logs it, and moves on, but for the past month it will crawl an average of 100k-200k (as low as just 18k) out of 1 million pages and just stall..no errors, no continuing on.. and trying to stop the crawl, it won't stop (normally it might take a momment to stop till the stuck page reaches the timeout)
other issues that may or may not be related
1 when you make a post .comment, or a new member joins, often theres a long delay before it shows up
2 most site emails were not sending (some were0 the ones not sending said something abort ipv6 issues
we had similar 'dynamic content being cached as static) in the past, which you fixed and this seems similar
just an afterthought, most of the time when the crawler gets stuck, its on an image, which makes me very afraid to clear image cache.. and worried what might happen when the cache expires (cache is on an ssd images are stored on a sata)
but for the past month about i have been unable to complete a sitemap crawl.
normally when the crawler gets an error like a timeout or 500 error it logs it, and moves on, but for the past month it will crawl an average of 100k-200k (as low as just 18k) out of 1 million pages and just stall..no errors, no continuing on.. and trying to stop the crawl, it won't stop (normally it might take a momment to stop till the stuck page reaches the timeout)
other issues that may or may not be related
1 when you make a post .comment, or a new member joins, often theres a long delay before it shows up
2 most site emails were not sending (some were0 the ones not sending said something abort ipv6 issues
we had similar 'dynamic content being cached as static) in the past, which you fixed and this seems similar
just an afterthought, most of the time when the crawler gets stuck, its on an image, which makes me very afraid to clear image cache.. and worried what might happen when the cache expires (cache is on an ssd images are stored on a sata)