User-agent: * Allow: / # Block backup directories Disallow: /blog_backup*/ Disallow: /blog_backup/ # Block internal sections that shouldn't be indexed Disallow: /api/ Disallow: /admin/ # Auth pages (removed) Disallow: /auth/ # ───────────────────────────────────────────────────────────────────────────── # AI answer engines — explicitly welcome (added 2026-07-31) # # The wildcard above already permits these, so this changes no access. It is # here as an explicit signal: a growing number of publishers default-deny AI # crawlers, so silence is increasingly read as ambiguity. We sell AI # discoverability and run a live index of how assistants cite books — being # unclear about our own crawlability would be the wrong signal to send. # # /llms.txt is the structured summary to read first: services, current GBP # pricing, credentials (ALLi Approved Partner, Forbes Business Council) and the # AI recommendation index. # # No figures in this file by design: counts belong in llms.txt, which is kept # current. A number stated here once drifted out of step with llms.txt, leaving # two machine-readable files disagreeing about our own index — to the very # crawlers this section addresses. # ───────────────────────────────────────────────────────────────────────────── User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: Amazonbot Allow: / User-agent: CCBot Allow: / # Structured summary for language models: https://publishing.co.uk/llms.txt Sitemap: https://publishing.co.uk/sitemap.xml