This reads a search signal.
You want to know whether robots.txt allows Googlebot to fetch a particular path.
Website & SEO
Fetch a site's robots.txt and test a path against Googlebot using the longest matching allow/disallow rule.
Useful to know
You want to know whether robots.txt allows Googlebot to fetch a particular path.
Blocking crawling does not automatically remove a URL that is already indexed.
Test the exact path and remember that a broader or longer matching rule can change the result.
If the goal is removal from search, use the appropriate index-control method rather than relying on robots.txt alone.