Free tool
Can AI answer engines read your site?
Check crawler access for eleven AI and search crawlers, plus indexability, metadata, structured data, and server-rendered content. Free, no account needed.
About this checker
The full list of crawlers and checks is in the readiness check reference.
Should I block GPTBot or other AI crawlers?
It depends on your policy. Blocking training crawlers such as GPTBot, ClaudeBot, or Google-Extended limits use of your content for model training and does not remove you from live answers. Blocking retrieval crawlers such as OAI-SearchBot, ChatGPT-User, or PerplexityBot does remove your pages from those engines’ live answers and citations.
Does a high score mean AI engines will cite me?
No. The checker confirms that engines can access and understand the page. Whether they cite it depends on whether it answers questions better than other sources. Manifest Signal measures that directly.
Do I need an llms.txt file?
It is optional. llms.txt is an emerging convention for summarizing a site for language models; no major engine has committed to using it, so the checker reports it for information only.
Why does server-rendered content matter?
Many AI crawlers fetch HTML without running JavaScript. If your main content only appears after scripts run, those crawlers may see an almost empty page.