The eval platform landscape. Braintrust (eval + logging, strong on dataset management and scoring, used by Notion and Vercel), Promptfoo (open-source CLI for prompt/model comparison, YAML-based test...

Build an eval pipeline from scratch. Define metrics for a specific use case, curate a test dataset (50+ examples with ground truth), implement scoring (programmatic for extractable metrics,...

"Walk me through how you'd design an eval framework for a new LLM application." Start with the use case requirements — what does "good" mean for this product? Decompose into 3-5 measurable...