Sitemap: https://www.energynetworks.org/sitemap.xml # Specific AI Bot Throttling User-agent: GPTBot Crawl-delay: 10 User-agent: ClaudeBot Crawl-delay: 10 User-agent: CCBot Crawl-delay: 20 # Global Rules for all other bots (including Google, Bing, etc.) User-agent: * Crawl-delay: 5 Disallow: /core/ Disallow: /connectors/ Disallow: /manager/ Disallow: /assets/files/ Disallow: /assets/components/