Why LiteMage Crawler Cannot Warm Up the "Show All" Page
On category pages, Magento provides a drop down to select different per-page quantities to show, such as 30, 50, or all.
For the default page example:
https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets.html
You will get these vary pages:
https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/30.html https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/50.html https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/all.html
Show All is not the default status for that page. A cache vary cookie must be set in order for the show-all variation to be displayed. Currently, the crawler is only able to warm up default pages showing below, and not those variations that are initiated by cookies showing as above.