AI learning answer
What course teaches agent evals?
Short answer from Learnetto's Best AI agent evaluation courses guide.
Short answer
Evaluating AI Agents is the clearest course-style starting point. Follow it with OpenAI agent eval docs, Phoenix, Promptfoo, or Hamel Husain's eval material for practical implementation patterns.
Context from the full guide
Start with Evaluating AI Agents for a beginner-friendly 2-hour-36-minute course with Python exercises. Add an official provider lab or LangSmith course when you need a specific implementation, then build a code-owned suite with calibrated graders, CI checks, and production traces.
Useful resources
-
Evaluating AI Agents
Short course · DeepLearning.AI · Intermediate
You need to test, trace, and improve agent workflows instead of judging only single LLM responses.
-
OpenAI Evaluate agent workflows
Guide · OpenAI · Intermediate
You need the current OpenAI path for tracing, grading, and regression-testing agent workflows instead of only single-prompt evals.
-
LLM Evals
Guide · Hamel Husain · Intermediate
Your AI app needs quality checks before users see it.
-
Lazarus AI agent backdoor defense guide
AI agent security analysis · Microsoft Research · Intermediate to advanced
Understand Microsoft's Lazarus model-backdoor research, assess open-weight agent risk and add provenance, isolation and monitoring controls before deployment.
-
Claude Fable 5.2 and Mythos 5.2 launch guide
Frontier model news analysis · Anthropic · Intermediate to advanced
Use this analysis to decide whether Claude Fable 5.2 belongs in a demanding agent workflow, plan migration tests and understand why Mythos access remains restricted.
-
Uber production AI agent security guide
AI agent security guide · Uber · Intermediate
Use this guide to turn a production agent's purpose, tools and risk level into enforceable checks before it can take sensitive actions.
-
Claude Code local-settings secret leak response guide
AI coding-agent security analysis · Apiiro · Intermediate
Use this guide to find credentials recorded in Claude Code settings, rotate exposed secrets and prevent local approvals from entering Git history.
-
Agent memory: notes, dreams and knowledge wikis
AI agent memory guide · Anthropic · Intermediate
Use this guide to decide what an AI agent should remember, how to correct stale notes and when a knowledge wiki is worth maintaining.