User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /wp-json/ Disallow: /?s= Disallow: /*/feed/ # Block Bulk AI Training Scrapers (No Traffic Value) User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot User-agent: Google-Extended User-agent: FacebookBot Disallow: / # Allow AI Search & Live Retrieval Agents (Drives Referral Traffic) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-Web User-agent: Google-Search-Intent Allow: / Sitemap: https://sharadchhetri.com/sitemap_index.xml