Free check · No signup
Is your site readable by AI crawlers?
Crawlable scores your site 0–100 for GPTBot, ClaudeBot, PerplexityBot and Google AI — then generates the llms.txt to fix it.
Runs in ~5 seconds 9 weighted checks Shareable report
FREEREPORTFirst full report free — apply at checkout (1 per user).
getcrawlable.com/report/example.com
live preview62
score
Needs work
- ✓GPTBot accessAllowed in robots.txt
- ✓ClaudeBot accessAllowed in robots.txt
- !Server-side content~40% rendered without JavaScript
- ✕llms.txtNot found at /llms.txt
- ✓Sitemap312 URLs indexed
Score 0–100
Weighted across crawler access, server-side content, structure, sitemap, and llms.txt.
Generate llms.txt
Spec-compliant llms.txt drafted from your sitemap and titles, ready to deploy.
Weekly monitoring
Re-scans your saved sites and alerts you when AI crawlers get blocked.
How it works
No signup. No installation. Paste a URL and see exactly what AI crawlers see — and what they don't.
- 01Paste your URL
We fetch your site server-side — exactly like an AI bot does.
- 02Get your score
9 checks run instantly. See what passes, what warns, what fails.
- 03Fix it in one file
Generate llms.txt and ship it to /llms.txt at your root.
See your AI crawler score in 5 seconds.
Free, no account, no card.