Robots.txt Tester

Test whether a URL would be blocked by a robots.txt rule. Paste your robots.txt content, enter the URL path to test, and select the user-agent to simulate.

robots.txt content URL path to test (e.g. /admin/page) User-agent to test as

This tool parses robots.txt rules client-side using the standard specificity rules: Allow overrides Disallow when both match and the Allow rule is more specific.