AI learning guide

Best AI resources for local models

Run open models locally and understand inference, privacy, and tradeoffs.

Quick answer

Best first move

Pick one educator from the table, watch one matched video, then open one hands-on resource. The aim is to leave with a working habit, project, or mental model tied to local models.

How to shortlist

Compare audience, level, format, and starting point. Favor a source that matches your current role and gives you exercises, examples, docs, or code you can use immediately.

What to avoid

Avoid collecting dozens of generic AI tips. Use this guide to choose a narrow learning loop: one topic, one educator, one video, one resource, one application in your own work.

Videos to watch

Hugging Face agents course

Hugging Face

2025 in LLMs so far

Simon Willison

Educators and sources

Educator / source Best for Skills Start with
Developers, technical generalists LLM tools, Prompting, AI safety, Local models Read recent LLM posts and try the llm command-line tool.
Researchers, advanced builders NLP research, Open models, Multilingual AI Browse research posts and community programs.
Developers and ML learners Agents, Transformers, Diffusion, Open models Take the Agents Course if you want agent basics, or the NLP/Transformers course if you need model fundamentals.
Developers deploying AI workloads Deployment, GPU workloads, AI engineering, Batch jobs Deploy a small inference example before moving a real workload.
Developers fine-tuning and deploying models Open models, Fine-tuning, Deployment, Transformers Pick one fine-tuning or inference guide and reproduce it end to end.
Developers learning Transformer applications Transformers, NLP, Open models, Fine-tuning Use the book notebooks alongside the Hugging Face course.
Developers running local models Local models, LLM tools, AI engineering, Privacy Run one small model locally and connect it to a simple app.
Technical users running models locally Local models, Inference, Quantization, AI engineering Run a supported model locally and learn the main inference options.

Resources

Hugging Face Agents Course

Free course · Hugging Face · Beginner to intermediate

You want a hands-on agent course that uses open-source tools.

Hugging Face NLP Course

Free course · Hugging Face · Beginner to intermediate

You need the Transformer and NLP basics behind many AI apps.

Simon Willison on LLMs

Blog · Simon Willison · Beginner to advanced

Use this when you want Simon Willison's material for llm tools and related AI skills.

Cohere For AI

Research · Cohere For AI · Advanced

Use this when you want Cohere For AI's material for nlp research and related AI skills.

Hugging Face Learn

Free courses · Hugging Face · Beginner to advanced

Use this when you want Hugging Face's material for agents and related AI skills.

Hugging Face LLM tutorials

Tutorials · Phil Schmid · Intermediate to advanced

Use this when you want Phil Schmid's material for open models and related AI skills.

NLP with Transformers

Book · Lewis Tunstall · Intermediate

Use this when you want Lewis Tunstall's material for transformers and related AI skills.

Ollama docs

Docs · Ollama · Beginner to intermediate

Use this when you want Ollama's material for local models and related AI skills.

llama.cpp examples

GitHub repo · llama.cpp · Intermediate to advanced

Use this when you want llama.cpp's material for local models and related AI skills.

Questions this guide answers

How do I learn local LLMs?

Use the educator table, videos, and resources above to compare options by topic fit, depth, and format. A good choice gives you a concrete next step: a course module, code example, video walkthrough, project, or workflow you can try today.

Which tools should I use to run models locally?

Use the educator table, videos, and resources above to compare options by topic fit, depth, and format. A good choice gives you a concrete next step: a course module, code example, video walkthrough, project, or workflow you can try today.

When are local models useful?

Use the educator table, videos, and resources above to compare options by topic fit, depth, and format. A good choice gives you a concrete next step: a course module, code example, video walkthrough, project, or workflow you can try today.