Production AI engineering
Engineering teams
Learn first
- Observability
- Cost and latency
- Deployment
- Data pipelines
Good matches
Open next
AI directory search
Use this when you know the topic you need: Claude Code, MCP, evals, RAG, agents, product, coding, prompting, foundations, or model internals.
20 matches for "latency"
Engineering teams
Learn first
Good matches
Open next
Builders choosing between Claude, GPT, Gemini, Llama, Mistral, Cohere, DeepSeek, Qwen, Grok, Perplexity, and hosted open models
Learn first
Good matches
Open next
Model selection guide · OpenRouter · Intermediate
You want a practical six-step workflow for shortlisting models from live data, testing them on your own prompts, measuring cost per completed task, and choosing or routing from inside a coding assistant.
openrouter, model selection, evals, benchmarks, cost
Guide · OpenAI · Intermediate
You need the current OpenAI guidance for trading higher spend for lower latency in interactive or tool-heavy workflows instead of assuming standard processing is the only mode.
openai, fast mode, latency, gpt-5.6, interactive workflows
Release notes · OpenAI · Intermediate
You want the primary-source August 13, 2026 OpenAI changelog entry for Ultrafast mode before teaching or adopting the new GPT-5.6 Sol latency tradeoff.
openai, ultrafast mode, gpt-5.6 sol, latency, release notes
Guide · OpenAI · Intermediate
You need the current OpenAI guidance for trading latency for lower cost on non-urgent workloads instead of pushing everything through the default realtime path.
openai, flex processing, cost optimization, latency tradeoffs, batch workloads
Guide · OpenAI · Intermediate
You are sending repeated long context and need the official OpenAI guidance for lowering cost and latency with cache-friendly prompt structure.
openai, prompt caching, latency, cost, long context
Guide · OpenAI · Intermediate
You are moving from experiments to production and need the official OpenAI guidance on latency, retries, rate limits, safety, monitoring, and operational rollout.
openai, production, reliability, latency, cost
Guide · OpenAI · Intermediate
You want OpenAI's official framework for balancing accuracy, latency, and cost instead of choosing a model family by brand familiarity alone.
openai, model selection, gpt-5.6, latency, cost
Guide · Anthropic · Intermediate
You need Anthropic's current guidance for reusing repeated long context efficiently instead of paying full price and latency on every Claude request.
anthropic, prompt caching, claude, cost optimization, latency
Guide · Google AI for Developers · Intermediate
You need Google's current guidance for caching repeated context to reduce cost and speed up long-context Gemini workflows.
gemini, context caching, prompt caching, latency, cost
Guide · Google AI for Developers · Intermediate
You want the official Google path for low-latency voice and vision agents before designing a realtime Gemini workflow.
gemini, live api, voice agents, realtime, multimodal
Guide · DeepSeek · Intermediate
You want the official DeepSeek KV-cache guidance before building repeated long-context workflows or comparing caching behavior with other providers.
deepseek, context caching, kv cache, cost optimization, latency
Guide · OpenRouter · Intermediate to advanced
You want the official OpenRouter guide for routing across the quality, price, and latency frontier instead of hard-coding one tradeoff for every workload.
openrouter, pareto router, routing, latency, cost
Cookbook guide · OpenAI · Intermediate
You want a practical OpenAI walkthrough for model selection tradeoffs, eval design, and rollout testing instead of treating model choice as a static table lookup.
openai, model selection, evals, latency, cost
Guide · Cohere · Intermediate
You want Cohere's official explanation of reasoning modes and thinking budgets before choosing whether a Command reasoning model is worth the extra latency or cost.
cohere, reasoning, tool use, agents, thinking budgets
Guide · xAI · Intermediate
You want xAI's June 15, 2026 explanation of the `service_tier: "priority"` tradeoff before recommending Grok for lower-latency coding or agent loops.
xai, priority processing, latency, service tier, agents
Evaluation guide · OpenRouter · Intermediate to advanced
You want to turn real project prompts and data into repeatable cross-provider agent evals that check answers, tool calls, completion, latency, and cost, then rerun them in CI when models change.
openrouter, evals, model selection, coding agents, ci
Guide · OpenRouter · Intermediate
You want the official explanation of sticky provider routing, cache-hit behavior, and cost tradeoffs before using OpenRouter as a long-context or agent backend.
openrouter, prompt caching, routing, cost optimization, latency
Guide · OpenRouter · Intermediate
You want the official OpenRouter request-level caching model before building repeated eval, agent, or research workflows that can benefit from cache hits above the provider layer.
openrouter, response caching, cost optimization, latency, agents