Open-source browser tool

Mydentify AI Crawler Access Checker

Paste a robots.txt policy and test one path against documented OpenAI and Anthropic crawler names. Everything on this page runs in your browser.

Policy result

Run the evaluator

Crawler	Purpose	Access	Matched rule

This demo evaluates pasted rules only. It does not fetch a site or prove how an official crawler IP will behave.