Taking Advantage of Robots.txt
This indeed was something that had me confused at first, and I know I’m not the only one in this case. It can thus be interesting to have a look at this post on Blog SEO about playing with robots.txt. While, as usually said, meta-tags and the likes don’t have as much importance as they once had, it’s nevertheless interesting to know this kind of little things.
Better than this, though, is the link added at the end of the post, and pointing to robotstxt.org, where one will indeed find all there is to learn, and in details, along with FAQ, recommended sites and readings, and how to direct robots to visit your website.
After having read this, there’s no excuse anymore to not knowing what robots/spiders are!
If you enjoyed this article please consider staying updated via RSS. Links to your own social media pages could be added here.
This entry was posted on Wednesday, August 24th, 2005 at 8:47 am and is filed under Link Building, SEO Tips. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.
