User-agent: * Allow: / Disallow: /api/ Disallow: /cdn-cgi/ # Search and user-triggered AI agents are allowed (08_SEO_CONTENT_ARCHITECTURE section 5.4). User-agent: OAI-SearchBot Allow: / Disallow: /api/ Disallow: /cdn-cgi/ User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /cdn-cgi/ User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /cdn-cgi/ User-agent: Claude-SearchBot Allow: / Disallow: /api/ Disallow: /cdn-cgi/ User-agent: Claude-User Allow: / Disallow: /api/ Disallow: /cdn-cgi/ # Model-training crawlers (GPTBot, CCBot, Google-Extended and others): owner policy decision pending, no rule set here. # Shared result pages stay crawlable on purpose so LinkedIn and Facebook can read their Open Graph tags; they carry noindex. Sitemap: https://pmcareerdesk.com/sitemap.xml