Archive | Resources RSS feed for this section

Robots.txt Generator

I’ve just come across a great little tool to help you build a robots.txt file for your website. Robots.txt Generator What is a robots.txt file? It’s basically a little text file you upload to your server which tells search engines which pages or directories of your site you want them to spider (or not spider). […]