Robots.txt Generator

Search Engine Optimization

Robots.txt Generator

Default - All Robots are:  
Sitemap: (leave blank if you don't have) 
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo MM
  Yahoo Blogs
  DMOZ Checker
  MSN PicSearch
Restricted Directories: The path is relative to root and must contain a trailing slash "/"

Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.

About Robots.txt Generator

Robots.txt Generator tool by Online ToolsKit is a simple and easy-to-use online tool to help you create a robots file for your website or blog. You can easily generate one from the site or download it from their website if you already have one downloaded and saved on your computer or server.

Robots are web crawlers that index pages in search engines like Google, Bing, Yahoo, etc., which helps them to find information about new websites and improve their search results for these websites as well as provide them with other useful information like contact details of the owner of the website, links to