User-agent: * Allow: / Allow: /llms.txt Disallow: /dashboard/ Disallow: /api/ # Allow search engine crawlers for public content User-agent: Googlebot Allow: / Allow: /llms.txt Disallow: /dashboard/ Disallow: /api/ # Allow AI crawlers for discovery User-agent: GPTBot Allow: / Allow: /llms.txt User-agent: ClaudeBot Allow: / Allow: /llms.txt User-agent: anthropic-ai Allow: / Allow: /llms.txt User-agent: PerplexityBot Allow: / Allow: /llms.txt User-agent: ChatGPT-User Allow: / Allow: /llms.txt User-agent: Applebot Allow: / Allow: /llms.txt Sitemap: https://clawgrc.com/sitemap.xml # Claw GRC — AI-Native GRC Platform # https://clawgrc.com # llms.txt: https://clawgrc.com/llms.txt