Simple Dev Tools
Home
Contact
Robots.txt Generator
Default - All Robots are:
Allowed
Refused
Crawl-Delay:
Default - No Delay
5 Seconds
10 Seconds
20 Seconds
60 seconds
120 Seconds
Sitemap:
(leave blank if you don't have)
Search Robots:
Google
Same as Default
Allowed
Refused
Google Image
Same as Default
Allowed
Refused
Google Mobile
Same as Default
Allowed
Refused
MSN Search
Same as Default
Allowed
Refused
Yahoo
Same as Default
Allowed
Refused
Yahoo MM
Same as Default
Allowed
Refused
Yahoo Blogs
Same as Default
Allowed
Refused
Ask/Teoma
Same as Default
Allowed
Refused
GigaBlast
Same as Default
Allowed
Refused
DMOZ Checker
Same as Default
Allowed
Refused
Nutch
Same as Default
Allowed
Refused
Alexa/Wayback
Same as Default
Allowed
Refused
Baidu
Same as Default
Allowed
Refused
Naver
Same as Default
Allowed
Refused
MSN PicSearch
Same as Default
Allowed
Refused
Restricted Directories:
The path is relative to root and must contain a trailing slash "/"
Advertisement
Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
SEARCH
Popular SEO Tools
Plagiarism Checker
Word Count Checker
Article Spinner / Rewriter
Keyword Position Checker
Grammar Checker
Pagespeed Insights Checker
Image Compression Tool
Reverse Image Search
Text To Speech
Backlink Checker
Alexa Rank Checker
Backlink Maker
Domain Age Checker
Website Ping Tool
Keyword Density Checker
Website Page Size Checker
×
Sign In
×
Sign in with your username
Username
Password
×
Sign Up
×
Sign up with your email address
Username
Email
Full Name
Password
×