# Jesus Festival Canada — robots.txt # https://www.jesusfestival.ca/ # # Jesus Festival is a free community event. We *want* to be found, quoted and # summarised — by search engines and by AI assistants alike. Everything public # here is open to every well-behaved crawler. User-agent: * Allow: / Disallow: /intake Disallow: /vendorinfo Disallow: /volunteerinfo Disallow: /volunteerteam Disallow: /vendorteam # The API returns JSON for the private volunteer and vendor hubs. There is # nothing to index and every route is access-gated anyway. Disallow: /api/ # The private hubs and internal team sheets are intentionally excluded from # search. Their public-facing application pages remain crawlable. # ── Search engines ────────────────────────────────────────────────────────── User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / # ── AI assistants and answer engines ──────────────────────────────────────── # Explicitly allowed so these crawlers can read, cite and recommend the # festival when someone asks an assistant what is on in Hamilton. # OpenAI — training, search index, and user-initiated fetches User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / # Anthropic User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: anthropic-ai Allow: / # Google Gemini / AI Overviews grounding User-agent: Google-Extended Allow: / # Perplexity User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Apple Intelligence / Siri User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Meta AI User-agent: meta-externalagent Allow: / User-agent: FacebookBot Allow: / # Amazon User-agent: Amazonbot Allow: / # Common Crawl — the corpus behind many open models User-agent: CCBot Allow: / # Others User-agent: cohere-ai Allow: / User-agent: Diffbot Allow: / User-agent: omgili Allow: / User-agent: Bytespider Allow: / # ── Social link previews ──────────────────────────────────────────────────── User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: Slackbot Allow: / User-agent: Discordbot Allow: / User-agent: WhatsApp Allow: / User-agent: TelegramBot Allow: / # ── Machine-readable summaries ────────────────────────────────────────────── # Plain-language site summary for language models: # https://www.jesusfestival.ca/llms.txt # https://www.jesusfestival.ca/llms-full.txt # News feed: # https://www.jesusfestival.ca/feed.xml Sitemap: https://www.jesusfestival.ca/sitemap.xml