# https://daya.co/robots.txt User-agent: * Allow: / # The embedded Sanity Studio. Behind Sanity auth, so a crawler only ever sees a # login screen, but it is excluded explicitly so those URLs are never fetched. # The route also sends a noindex robots directive in its own metadata. Disallow: /studio # AI crawlers — allowed, see /llms.txt # # Each group repeats the Studio exclusion on purpose. A crawler obeys only the # most specific User-agent group that matches it and ignores the "*" group # entirely, so a named bot listed here with just "Allow: /" would be free to # crawl /studio despite the rule above. # # Retrieval bots first. These fetch a page to answer a question in ChatGPT # search, Claude or Perplexity, so they decide whether daya.co is cited. They # are named here rather than left to the "*" group so a later tightening of # the wildcard cannot drop the site out of AI search without anyone noticing. User-agent: OAI-SearchBot Allow: / Disallow: /studio User-agent: ChatGPT-User Allow: / Disallow: /studio User-agent: Claude-User Allow: / Disallow: /studio User-agent: Claude-SearchBot Allow: / Disallow: /studio User-agent: PerplexityBot Allow: / Disallow: /studio # Training crawlers. User-agent: GPTBot Allow: / Disallow: /studio User-agent: ClaudeBot Allow: / Disallow: /studio User-agent: Google-Extended Allow: / Disallow: /studio Sitemap: https://daya.co/sitemap.xml