Ethan Walker

404 bio not found

Joined on May 19, 2026

Ethan Walker

Jun 29

The stale eval fixture that passed a broken model

#testing #cicd #python #llmops

4 min read

Want to connect with Ethan Walker?

Create an account to connect with Ethan Walker. You can also sign in below to proceed if you already have an account.

Create Account

Already have an account? Sign in

Ethan Walker

Jun 27

My eval handed me a 0.62 and no idea why. The fix was not a better eval.

7 min read

Ethan Walker

Jun 23

91% pass rate. Gate green. Shipped. Worst regression we had all quarter.

#testing #ci #ai #llm

2 min read

Ethan Walker

Jun 17

We stopped writing eval cases by hand. Now every prod incident becomes one.

#ai #machinelearning #testing #llm

2 min read

Ethan Walker

Jun 10

Your eval criteria are code. Version them like code.

3 min read

Ethan Walker

Jun 8

Datadog dashboards for prompt regression: the panels we actually keep

#ai #llm #devops #cicd

8 min read

Ethan Walker

Jun 3

Switching our LLM-as-judge from 5-class to binary in CI: the patterns we kept

#ai #llm #ci #machinelearning

3 min read

Ethan Walker

May 26

Promptfoo is a CI gate, not an eval framework. Treating it like one cost us $4,200

#ai #machinelearning #llm #python

4 min read

DEV Community

Ethan Walker

Badges

2 Week Community Wellness Streak

1 Week Community Wellness Streak

Writing Debut

The stale eval fixture that passed a broken model

Want to connect with Ethan Walker?

My eval handed me a 0.62 and no idea why. The fix was not a better eval.

91% pass rate. Gate green. Shipped. Worst regression we had all quarter.

We stopped writing eval cases by hand. Now every prod incident becomes one.

Your eval criteria are code. Version them like code.

Datadog dashboards for prompt regression: the panels we actually keep

Switching our LLM-as-judge from 5-class to binary in CI: the patterns we kept

Promptfoo is a CI gate, not an eval framework. Treating it like one cost us $4,200