User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /index.php Disallow: /wp-includes/ Disallow: /wp-content/plugins/ # Disallow: /wp-content/themes/ Disallow: /feed/ Disallow: /tag/ Disallow: /category/ Disallow: /*testing #Disallow: /*test Allow: /wp-content/uploads/ Sitemap: https://www.cchofwaunakee.com/sitemap.xml Crawl-delay: 20 Disallow: /author* # 1/15/2023 TCH: This bot was bringing down the server: User-agent: serpstatbot Disallow: / # AI Bots Crawl Delay User-agent: GPTBot Crawl-delay: 10 User-agent: ChatGPT-User Crawl-delay: 10 User-agent: CCBot Crawl-delay: 10 User-agent: ClaudeBot Crawl-delay: 10 User-agent: Google-Extended Crawl-delay: 10