googlebot

[illidan]

googlebot indexes ~100 pages and stops after changing the web server to litespeed. is this because off the configuration? when we use apache it indexes ~125000 pages.

 

[mistwang]

I don't think so, unless googlebot has been blocked for some reason, such as the per client connection throttling, access control, etc.

We have customer using litespeed on website with millions of pages, no problem with google at all.

 

[xinn]

sorry for bumping this topic.. i just want to say that it has nothing to do with liteSpeed.. i run lyrics site and dmoz copy on lsws.. and it works wery vell.. there is no problems with indexing.. ( check it by yourself: lyricstown.org or katalog.otserv.pl .. each site returns almost 400k indexed pages).. i get like 15k-40k googlebot request/day..