Yahoo Slurp Spider! [Archive]

Alien

03-23-2007, 08:39 AM

Every time one of these spiders visits my site,the shoutbox v2.1 doesnt show any where to input text.Obviously i still want them to visit my site for ranking purposes but its getting real annoying,does anyone know of a fix?I have adjusted my robots.txt to slow them down a little but it aint doin anything other than that.Any advice appreciated.:depressed:

Shawn

03-23-2007, 12:33 PM

Whats your cookie time on "Whos currently online"

Alien

03-23-2007, 10:22 PM

Its at 300 m8 is that 2 much?

Shawn

03-23-2007, 11:12 PM

Nope 300 is pretty low in my opinion which is good =)
Are you sure it is yahoo slurp? All shoutboxs ususally slow down any forum. I know dedicated hosting thats slowed down to.

Alien

03-25-2007, 02:46 AM

i adjusted my robots txt a wee bit more and increased the delay and it seems 2 have helped

Shawn

03-25-2007, 03:12 AM

Great!
Be sure to prune your shoutbox if it gets too big, that helps too.

If you would like a auto prune feature which occurs every 24 hours (or how ever long you set it) let me know

ironfly

04-03-2007, 11:31 AM

it is always very shitting these spiders