#Allowing ChatGPT/AI to access my articles.

5 messages · Page 1 of 1 (latest)

inland silo
#

Hello, I run Embryology Wiki at embryologywiki.org. I added the following to MediaWiki:Robots.txt, and it now appears in https://embryologywiki.org/robots.txt:


User-agent: ChatGPT-User Allow: /wiki/ Disallow: /wiki/Special: Disallow: /Special: Disallow: /```

However, ChatGPT still receives HTTP 403 Forbidden when trying to directly access public article pages such as:

https://embryologywiki.org/wiki/Main_Page
https://embryologywiki.org/wiki/Miscarriage
https://embryologywiki.org/wiki/Embryology

I want ChatGPT and OpenAI tools to be able to directly access and read my public wiki articles, especially for users who are trying to use AI tools to search for information, ask questions about Embryology Wiki, or summarize/analyze specific wiki pages.

Could you please check whether Miraheze, Cloudflare, or another WAF/bot-protection layer is blocking OpenAI/ChatGPT requests, especially the ChatGPT-User and OAI-SearchBot user agents or OpenAI IP ranges?

I do not want to allow GPTBot for training. My main goal is to allow:

1. OAI-SearchBot, so Embryology Wiki pages can appear in ChatGPT search/browsing results.
2. ChatGPT-User, so ChatGPT can directly open and read public pages when users ask about them.

Thank you.
#

@mild cairn @crimson dove @winged kelp @dense epoch

crimson dove
quaint yokeBOT
crimson dove
#

Per-wiki exceptions are easy to grant but is very difficult to manage if too many wikis request them.
Allowing AI bots farm-wide will likely never happen. I expect a 1/5 support to oppose ratio (or less) if this idea is ever brought up to the tech team or community.