Kraaft
All in One Tools
⌘K
Donate
Home
SEO & Web Tools
Robots.txt Generator
Robots.txt Generator
Generate robots.txt files for your website
Robots.txt Generator
Create a robots.txt file to guide search engine crawlers on your website.
Default Rule for All Robots
Allow all (except disallowed below)
Disallow all
Crawl Delay (seconds)
Sitemap URL
Disallowed Directories/Pages
Add Row
×
×
Generated robots.txt
Download .txt
User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/