Resource finder

Learning path · Learn

Technical model evaluation before integration

Four readings + three exercises + two pre-seeded workflows. Walks the verified fields a developer needs (hosted creator vs host, modality channels, structured generation, the testing framework) and ends with a comparison URL, an evidence brief, and a written external test plan.

Open →

Learning path · Learn

Model selection for product use cases

Four readings + three exercises + one pre-seeded workflow. Walks use-case framing, pricing references, lifecycle gates, and benchmark limits so the team can align on a defensible review — ending with a use-case shortlist, a pricing-reference note, a lifecycle risk note, and the evidence brief.

Open →

Learning path · Learn

AI model governance and source review

Four readings + three exercises + three audit workflows. Walks lifecycle, status, benchmark limits, pricing, and source freshness so a reviewer can sign off with a defensible evidence trail — never a certification claim.

Open →

Learning path · Learn

Safe AI model use for automation workflows

Five readings + four exercises + three pre-seeded workflows. Built for people wiring AI models into automations: structured outputs, prompt cost projections, regression test plans, and a brief that ships with the automation runbook. Never an automation marketing pitch.

Open →

Exercise · Apply

Map a hosted provider relationship

Pick a hosted model in the catalogue, trace creator vs billing provider, and read the hosted pricing reference's source citation.

Open →

Exercise · Test

Plan an external model test

Use the brief and the testing lesson to plan your own prompt, latency, rate-limit, and cost validation work for the shortlist.

Open →

Lab playbook · Test

Structured output testing

How to validate JSON mode, structured output, and tool calls against your real schema before depending on the model in a pipeline.

Open →

Lab playbook · Test

Long-context testing

How to test long-prompt behaviour past the catalogue's verified context window — recall, instruction adherence, and cost growth — without trusting a marketing number.

Open →

Lab playbook · Test

Multimodal input testing

How to test image, audio, video, and PDF input channels against your real assets — never against marketing copy.

Open →

Lab playbook · Test

Automation workflow testing

How to test a model inside an automation loop — chained prompts, retries, downstream parsers, regression surface — before letting it run unattended.

Open →

Lab playbook · Test

Model regression testing

How to run a small, repeatable canary suite after every snapshot rotation so silent regressions surface before production traffic notices.

Open →

Evaluation prompt set · Test

Structured extraction

Evaluate whether a model extracts fields into a requested structure without inventing missing values or breaking schema constraints.

Open →

Evaluation prompt set · Test

Long-context recall

Evaluate whether a model preserves constraints, handles cross-references, and detects conflicts across multiple sections of input.

Open →

Evaluation prompt set · Test

Refusal boundary

Evaluate whether the model handles benign boundary-setting safely — without over-refusing, without giving definitive professional advice, and without complying with inappropriate requests.

Open →

Evaluation prompt set · Test

Automation robustness

Evaluate whether a model handles automation-style constraints (allowed categories, missing values, retry decisions, ambiguity flags) without silently breaking the contract.

Open →

Exercise · Package

Create a decision evidence brief

Use the decision brief builder to generate a paste-ready evidence pack from your shortlist, then export it in Markdown.

Open →

Workflow kit · Package

Developer model evaluation kit

Prepare a source-backed model evaluation plan before integration. Walks the developer learning path, the matching exercises, the prompt-testing + structured-output playbooks, the structured-extraction + instruction-following prompt sets, and the model evaluation plan + prompt test matrix templates.

Open →

Workflow kit · Package

Automation workflow testing kit

Prepare a safe testing workflow for AI-powered automation. Walks the automation-specialist learning path, the structured-output + pricing-references + testing lessons, three exercises, the automation workflow testing + regression playbooks, the automation-robustness + structured-extraction prompt sets, and the automation risk checklist + prompt test matrix templates.

Open →

Workflow kit · Package

Product model selection kit

Turn a product use case into a reviewable model selection artifact. Walks the product manager learning path, four lessons covering use-case framing through benchmark limits, three exercises that produce pricing + lifecycle notes + the brief, the prompt-testing + long-context playbooks, two prompt sets, and the model evaluation plan template.

Open →

Workflow kit · Package

Governance review kit

Prepare a source / freshness / lifecycle review package for internal governance discussions. Walks the governance learning path, four lessons (lifecycle, status, benchmark limits, pricing), three exercises that produce the freshness checklist + lifecycle note + test plan, the regression + prompt-testing playbooks, the refusal-boundary + instruction-following prompt sets, and the evaluation plan + automation risk checklist templates.

Open →