Hello,
I use crawler with parametr /crawler.sh -v -c https://domain/1_index_sitemap.xml and word great.
But after some time the entire cache is deleted. How can you see why this cache is known and the robot has to start over.
What could be the cause of the disappearing cache
I use crawler with parametr /crawler.sh -v -c https://domain/1_index_sitemap.xml and word great.
But after some time the entire cache is deleted. How can you see why this cache is known and the robot has to start over.
What could be the cause of the disappearing cache