# miStable network robots.txt policy (plugins/mistable-robots-policy/mistable-robots-policy.php) User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /?s= Disallow: /*?replytocom= # AI training crawlers User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: meta-externalagent User-agent: Bytespider User-agent: cohere-training-data-crawler Disallow: / # Third-party SEO crawlers User-agent: SemrushBot User-agent: AhrefsBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: DataForSeoBot Disallow: / Sitemap: https://pricekentracing.com.au/sitemap_index.xml