stop yahoo from spidering my site in litespeed

[hichew]

is there a way in litespeed to banned / slow down yahoo spider from indexing my site?
Can someone show me how, please...

this is a quote from ppl who running vBulletin forum

This is causing a HUGE uproar for users with online BBs's. I've seen VB and IPB users alike complaining how they suddenly now have 1200 online users when they used to have 100,and 1100 of those 1200 are Slurp spiders.

Seriously...can this get reverted back? Track the session you are spidering a site with and force the session to use a single IP. As someone else said, sure devs can code around this, but the reality is the responsibility falls on Yahoo's hands in this case.

Stop using 100+ different IP addresses when spidering

submitted by anonymous user 1 month ago
Why is it that Yahoo! uses a different IP for every page request while spidering?

A lot of sites, such as forums, have a "guests" or "online users" count listed on their page. When Yahoo! uses 146 different IP addresses to spider 146 pages, it artificially inflates the online users count.

It's irritating.

Please use one IP address when spidering to prevent inflating online user counts.

Thanks.

 

[mistwang]

You can block that subnet with server level access control.
It is hard to slow them down when they use 100+ different IP addresses.