Yahoo Spider and Server Tips
Search engine spiders lugging down your server? Dave Simpson (Yahoo!
Search Engineering) posts on the Yahoo blog some tips for saving bandwidth. Very cool stuff, if you didn't know already.
Have your say ...
First-time comments will be held for moderation (but comments are appreciated). Otherwise, just be courteous. If your name is a bunch of keywords, your comment will be deleted. Don't post links unless highly pertinent. Posters must be 16 or older.