Yahoo Slurping in a New Way

Yahoo Slurp, their search engine spider has been given an update.

In addition to crawling the Internet faster, our new crawler is more efficient at visiting websites. As a result, site owners will notice as much as a 25% reduction in the number of requests and bandwidth consumed by the crawler.
While transitioning to the new crawler over the past few weeks, we had been running both crawlers in tandem. In some cases, this increased the frequency of Yahoo Search requests to websites. Now, with the new crawler in full production, we have turned off the old crawler and site owners should see a much lower crawl load without a loss in content coverage.

With this change of behavior in the crawler, you may see some shuffling of the pages that are included in the index and some changes in ranking as well.

I have yet to notice any changes in my sites, but I have not been watching Yahoo! all that closely. I guess I am just more of a Google man myself.

via Problogger.net

( Add your comments )

Recent Entries:
· Happy Holidays!
· Andrew Baron's Rocketboom Adds Lisa Nova To The Roster
· Cesar Kuriyama's Video: 'Long Gone' in 45,000 Photographs

[ READER COMMENTS ]

(Note: separate multiple email addresses with commas)

Yahoo Slurping in a New Way

Add your comments...

We kindly ask that you keep your comments relevant to this blog entry. Abusive or inappropriate comments or comments that are specifically promotional in nature may be removed.