Hello, I run Embryology Wiki at embryologywiki.org. I added the following to MediaWiki:Robots.txt, and it now appears in https://embryologywiki.org/robots.txt:
User-agent: ChatGPT-User Allow: /wiki/ Disallow: /wiki/Special: Disallow: /Special: Disallow: /```
However, ChatGPT still receives HTTP 403 Forbidden when trying to directly access public article pages such as:
https://embryologywiki.org/wiki/Main_Page
https://embryologywiki.org/wiki/Miscarriage
https://embryologywiki.org/wiki/Embryology
I want ChatGPT and OpenAI tools to be able to directly access and read my public wiki articles, especially for users who are trying to use AI tools to search for information, ask questions about Embryology Wiki, or summarize/analyze specific wiki pages.
Could you please check whether Miraheze, Cloudflare, or another WAF/bot-protection layer is blocking OpenAI/ChatGPT requests, especially the ChatGPT-User and OAI-SearchBot user agents or OpenAI IP ranges?
I do not want to allow GPTBot for training. My main goal is to allow:
1. OAI-SearchBot, so Embryology Wiki pages can appear in ChatGPT search/browsing results.
2. ChatGPT-User, so ChatGPT can directly open and read public pages when users ask about them.
Thank you.