LLM evaluation with W&B
Similar video
Weights & Biases · evals, llm apps, observability, mlops
AI education source
Maven AI courses
Useful discovery surface for live courses taught by practitioners across AI product, work, and engineering.
Start with: Filter by role and check instructor outcomes before buying a course.
Educator videos are listed first. Similar videos are labelled and included when they cover the same skills or adjacent topics.
Similar video
Weights & Biases · evals, llm apps, observability, mlops
Similar video
Arize AI · evals, observability, tracing, rag debugging
Similar video
Promptfoo · evals, prompt testing, red teaming, security
Similar video
Peter Yang · product, ai product, strategy, ai adoption
Professionals looking for cohort-based AI courses should start here when they need ai product, ai leadership, ai workflows, and evals. The strongest fit is a learner who wants material in these formats: cohort courses.
Filter by role and check instructor outcomes before buying a course. After that, open one related resource below and write down the exact workflow, concept, or implementation pattern you want to apply.
Useful discovery surface for live courses taught by practitioners across AI product, work, and engineering. Use this profile when you are comparing educators by topic, level, format, and practical usefulness rather than browsing random AI content.
Compare the skill coverage, the starting recommendation, and the related videos. If you need ai product, search the directory for that skill and shortlist three profiles before committing to a course, book, or playlist.
| Resource | Kind | Level | Use when |
|---|---|---|---|
|
LLM Evals
Hamel Husain
|
Guide | Intermediate | Your AI app needs quality checks before users see it. |
|
W&B LLM Evaluation Course
Weights & Biases
|
Free course | Intermediate | You need to debug and measure LLM app quality. |
|
Phoenix by Arize
Arize AI
|
Open source tool and docs | Intermediate | You need to trace, inspect, and evaluate LLM app behavior. |
|
Promptfoo Intro
Promptfoo
|
Open source docs | Intermediate | You need regression tests for prompts, models, and LLM outputs. |
|
AI Evals for Engineers & PMs
Hamel Husain and Shreya Shankar
|
Cohort course | Intermediate | You are shipping AI features and need a serious evaluation workflow. |
|
Lenny's Podcast: AI product episodes
Lenny Rachitsky
|
Podcast videos | Beginner to advanced | You want AI product examples from PMs and founders. |
|
Hamel's AI evals guides
Hamel Husain
|
Guides | Intermediate to advanced | Use this when you want Hamel Husain's material for evals and related AI skills. |
|
AI Evals for Engineers and PMs
Shreya Shankar
|
Course | Intermediate | Use this when you want Shreya Shankar's material for evals and related AI skills. |
|
W&B Courses
Weights & Biases
|
Free courses | Intermediate | Use this when you want Weights & Biases's material for llm apps and related AI skills. |
|
Phoenix
Arize AI
|
Docs | Intermediate | Use this when you want Arize AI's material for observability and related AI skills. |