Bingbot Arrives October 1st


An exciting new change is happening in the world of search beginning October 1st, 2010.  No longer will your log files be filled with references to visits by MSNBot – BingBot will arrive and do all of the crawling for the Bing search engine.

Ok, so “exciting” may not be the perfect way to describe this name change.  But for those of you who regularly analyze your log files (you DO look at your log files, don’t you?), this is an important update that should not be ignored in your SEO campaign.

Why is this name change important?  For one, websites that utilize server configurations that apply access rules for search engine crawlers, this name change will require a review of those settings to ensure BingBot can access your site content.  Otherwise, your site could be dropped from the Bing index.  And since the Yahoo Bing search alliance has taken place, BingBot will be doing the crawling for Yahoo search results as well.  So make sure access is given and BingBot can freely crawl areas of your site(s) that you want to show up in SERPs.

Aside from the name change, all else should remain the same with Bing’s crawler.  Bing does report that they will still honor all robots.txt directives that address msnbot.  Also, the IP addresses used for msnbot crawlers will remain the same for bingbot.

This is but the latest update in Microsoft’s commitment to the Bing Search engine.  Bing is slowing growing and maturing so it only makes sense that they would re-brand and update their crawler.

An exciting new change is happening in the world of search beginning October 1st, 2010.  No longer will your log files be filled with references to visits by MSNBot – BingBot will arrive and do all of the crawling for the Bing search engine. Ok, maybe “exciting” may not be the perfect way to describe this name change.  But for those of you who regularly analyze your log files (you DO look at your log files, don’t you?), this is an important update that should not be ignored.

Why is this name change important?  For one, websites that utilize server configurations that apply access rules for search engine crawlers, this name change will require a review of those settings to ensure BingBot can access your site content.  Otherwise, your site could be dropped from the Bing index.  And since the Yahoo Bing search alliance has taken place, BingBot will be doing the crawling for Yahoo search results as well.

So make sure access is given and BingBot can freely crawl areas of your site(s) that you want to show up in SERPs. Aside from the name change, all else should remain the same.  Bing does report that they will still honor all robots.txt directives that address msnbot.  Also, the IP addresses used for msnbot crawlers will remain the same for bingbot.

This is but the latest update in Microsoft’s commitment to the Bing Search engine.  Bing is slowing growing and maturing so it only makes sense that they would re-brand and update their crawler.


About Search Discovery

Search Discovery is a digital intelligence company that empowers organizations to make better, dynamic and transformative business decisions. We're focused on delivering results for our clients through digital analytics, SEO, digital media, and technology.


Comments

Let's Talk.

You're excited. We're excited. Give us a shout so we can get this party started.

!
!
!