Robots.txt TesterTest robots.txt directives to avoid blocking important pages from crawlers.Open tool