AI Tools For You
Login
Default - All Robots are
Allow
Disallow
Crawl-Delay
Default - No Delay
5 Seconds
10 Seconds
20 Seconds
60 Seconds
120 Seconds
Sitemap
Leave blank if you don't have.
Search Robots:
Google
Same as Default
Allow
Disallow
Google Image
Same as Default
Allow
Disallow
Google Mobile
Same as Default
Allow
Disallow
MSN Search
Same as Default
Allow
Disallow
Yahoo
Same as Default
Allow
Disallow
Yahoo MM
Same as Default
Allow
Disallow
Yahoo Blogs
Same as Default
Allow
Disallow
Ask/Teoma
Same as Default
Allow
Disallow
GigaBlast
Same as Default
Allow
Disallow
DMOZ Checker
Same as Default
Allow
Disallow
Nutch
Same as Default
Allow
Disallow
Alexa/Wayback
Same as Default
Allow
Disallow
Baidu
Same as Default
Allow
Disallow
Naver
Same as Default
Allow
Disallow
MSN PicSearch
Same as Default
Allow
Disallow
Disallow Folders
The path is relative to the root and must contain a trailing slash "/".
Generate
Related Tools
Open Graph Generator
HTTP Status Code Checker
Credit Card Validator
URL Opener
Keywords Suggestion Tool
WordPress Theme Detector
Robots.txt Generator
Popular Tools
YouTube Video Statistics
YouTube Description Generator
YouTube Hashtag Generator
YouTube Hashtag Extractor
YouTube Tag Generator
YouTube Tag Extractor
Adsense Calculator
Domain Authority Checker
Google Index Checker
Alexa Rank Checker
We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.
Accept all cookies
x