GEO & AI search
Welcome-list robots.txt
Definition
A robots.txt posture that explicitly allows AI crawlers across discovery content — product pages, collections, guides, policies — while disallowing transactional and private paths. The deliberate opposite of the publisher default-deny.
Defined in Should You Block AI Crawlers? A Merchant Decision Guide.
Does ChatGPT recommend you, or a rival?
We run real shopping prompts for your category and show who AI assistants put on the shelf.