# llms.txt — Controls access for Large Language Model crawlers # Allow well-behaved AI bots User-Agent: ChatGPT-User Allow: / User-Agent: Google-Extended Allow: / User-Agent: PerplexityBot Allow: / User-Agent: Anthropic-User Allow: / # Disallow others by default User-Agent: * Disallow: / # Optional: Disallow access to sensitive areas Disallow: /client-portal/ Disallow: /dashboard/ Disallow: /private/