Manage your Robots.txt Wisely – Robots.txt 101

Posted December 21st, 2008 by admin

Categories: SEO, Web Analytics · Tags: googlebot, robots.txt, site analysis, Web Analytics, webmaster tools

Comments: Add a comment

 

My boss sent me a few days ago a link to a very useful article regarding robots.txt and how to manage it wisely. As you probably now, robots.txt management and building can be cruacial to your sote preformance. You have to know exactly when to put noindex, nofllow, disallow, allow etc. This file reflects your site’s relationship with search engines – Learn here how to use it properly.

Share and Enjoy:
  • Digg
  • Sphinn
  • del.icio.us
  • Facebook
  • Mixx
  • Google
  • BlinkList
  • BlogMemes
  • E-mail this story to a friend!
  • Furl
  • Ma.gnolia
  • Netvouz
  • Simpy
  • Spurl
  • StumbleUpon
  • Blue Dot
  • connotea
  • De.lirio.us
  • LinkedIn
  • Live
  • NewsVine
  • Propeller
  • Technorati
  • TwitThis
  • YahooMyWeb
Send to Facebook
 

Discussion

What do you think? Leave a comment. Alternatively, write a post on your own weblog; this blog accepts trackbacks [trackback url].

If you found this page useful, consider linking to it.
Simply copy and paste the code below into your web site (Ctrl+C to copy)
It will look like this: Manage your Robots.txt Wisely – Robots.txt 101

Leave a Reply

You must be logged in to post a comment.