Search engine spiders

[Vtec44]

Recently, SBN has been bombarded with spiders from search engines that I haven't even heard of. Spiders are scripts used by search engines to gather and index information. Enough of them on a site simultaneously can really hinder performance. So, I've decided to disallow quite a few spiders from the lesser known seach engines. In addition to that, I've reindexed and optimized the database. Hopefully, that will be enough to speed up the site a bit. If not, we may have to upgrade again for the 4th time :ohno

[Jarhead78]

Will the site be down if we have to upgrade? What will I do with all my free time if the site goes down? This site is like drugs, you give us just enough to get us hooked and then you take it away ahhahah

[The Sauce]

yuck...spiders

[Vtec44]

Will the site be down if we have to upgrade? What will I do with all my free time if the site goes down? This site is like drugs, you give us just enough to get us hooked and then you take it away ahhahah

It won't, but it's a pain depending on how far we want to go. I've done it 3 times before, twice w/o interuption.

[zman]

yuck...spiders
Yeah next time ill show ya some Barking spiders :D

[The Sauce]

I actually dont mind actual spiders. I'm actually wanting to go to GMR to catch a new office-pet. (those "big" jumping tarantulas)

[BigNinja]

Watch out for covert police and media inquiries looking to incriminate sportbike riders, sounds like they've got their own spiders! Good job getting rid of them. Let them go and bust the meth-lab hard-core dealers on the Harley sites instead! Wanna go incriminate, go for the gold, or at least the Meth. What color is Meth anyway?

[scriggities]

What in the hell was that last post about? Did I miss something?