anthropic.com scores 65/100, indicating partial visibility in AI-generated answers. While AI crawlers can access the site, missing elements like the llms.txt file and JSON-LD schema hinder its visibility. Fixing these issues will improve how often the site appears in AI-generated responses.
What the Probe Saw
The probe identified that anthropic.com has "Partial visibility" with a score of 65/100. AI engines can reach the site, but two critical signals need attention. The homepage is accessible, returning an HTTP 200 status with approximately 4,660 characters of server-rendered text. This ensures that retrieval bots can read the content. Additionally, there are no blanket disallow rules for major AI crawlers like GPTBot, ClaudeBot, and PerplexityBot, which means these bots can fetch key pages.
However, the absence of a /llms.txt file means that AI engines lack a curated map to the site's best content, forcing them to guess. Furthermore, the homepage lacks a JSON-LD schema, preventing engines from identifying the type of entity the site represents. On the positive side, the site has a clear H1 and five sections with short, extractable answers, making it answer-ready.
What It Means for a Normal Business Site
For a business site, missing elements like a /llms.txt file and JSON-LD schema can significantly impact visibility in AI-generated content. The /llms.txt file serves as a guide for AI engines to understand which parts of your site are most relevant, while JSON-LD provides structured data that helps engines categorize your site correctly. Without these, AI engines may not include your site in relevant search results, affecting discoverability.
Ensuring that AI crawlers have proper access and guidance can make a substantial difference in how your site is perceived and ranked. Businesses should consider using resources like our llms.txt guide and AI crawler playbook to optimize their sites for AI visibility.
No comments yet