Check which URLs a robots.txt allows or blocks for a given user-agent.
Fetching from a URL needs the Edge Tools Bridge extension. Without it, paste a robots.txt below.
Matched group: *
- Allowed/
No matching rule — allowed by default.
- Blocked/admin/
Disallow: /admin/ · line 2
- Allowed/admin/public/page
Allow: /admin/public/ · line 4
- Blocked/data.json
Disallow: /*.json$ · line 3
