AI directory search

Search across educators, skills, and resources.

Use this when you know the topic you need: Claude Code, MCP, evals, RAG, agents, product, coding, prompting, foundations, or model internals.

1 matches for "robots.txt"

GPT-5.6 Claude Code Gemini 3.7 Flash Grok 4.6 MCP context engineering evals RAG OpenRouter coding agents

Resources

Shared robots.txt AI training preference explained

AI training policy standard analysis · OpenAI · Beginner to intermediate

Use this when you manage a website and need to understand the proposed cross-provider AI training preference before changing robots.txt.

AI training, robots.txt, IETF, publisher controls, GPTBot