Anabasis
← AI LaboratoriesThe Academy
L02Course · Practitioner

Model Bake-off

Compare frontier and local models on a real task.

The Course

Compare frontier and local models on a real task, with a decision rule.

Outcomes
  • 01

    Design a defensible comparison.

  • 02

    Run it fairly.

  • 03

    Report the tradeoffs.

  • 04

    Choose a winner with a decision rule.

Prerequisites
  • — AI APIs.
Pacing

The Lab.

A Note from the Faculty

Never choose a model without a documented comparison.