User-agent: * Allow: / # AI crawlers that cite with attribution are explicitly welcome, and so # are the named vendors' training crawlers. Citation is the point. User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / # Bulk extraction is the other thing, and it is refused. User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: cohere-ai Disallow: / User-agent: Diffbot Disallow: / User-agent: omgilibot Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: AI2Bot Disallow: / User-agent: Timpibot Disallow: / User-agent: PanguBot Disallow: / Sitemap: https://hobocode.net/sitemap.xml # LLM-oriented site guide: https://hobocode.net/llms.txt