Skip to content
OutMonkey

Website & SEO

Test what robots.txt is actually allowing.

Fetch a site's robots.txt and test a path against Googlebot using the longest matching allow/disallow rule.

OutMonkey sends this public URL to its server to fetch and check the page.

Free · no sign-up · public URLs only.

Useful to know

Four things worth knowing.

What it is

This reads a search signal.

You want to know whether robots.txt allows Googlebot to fetch a particular path.

Where it stops

A clean signal is not a ranking promise.

Blocking crawling does not automatically remove a URL that is already indexed.

Check the live response too.

Test the exact path and remember that a broader or longer matching rule can change the result.

Fix blockers before polish.

If the goal is removal from search, use the appropriate index-control method rather than relying on robots.txt alone.