Stories by iamwil

Aligning LLMs-as-a-Judge

Aligning LLMs-as-a-Judge

Leveling up from vibes-based engineering

Leveling up from vibes-based engineering

Doing vibe-based engineering right

Sun vs. Moon

Doing vibes-based engineering right

Iterate, iterate, iterate your prompts

Grading scales matter for eval consistency

Building an Autotuned Kazoo [video]

Leverage Code for System Evals

Where is the sandbox in your code base?

Defining good metrics for LLM system evaluation

Defining good metrics for LLM system evaluation

Defining good metrics for LLM system evaluation

eBook on building LLM system evals

Visual programming should start in the debugger

Where is the sandbox in your code base?

Go from zero to building LLM evals zine

1
2
3
4
5
6
7
8
9
10