Evals

👋 Sign in for the ability to sort posts by relevant, latest, or top.

INTFRAME

Aug 15

Evals are the unit tests of prompts

#ai #evals

2 min read

Walker Miller

Aug 14

Predicting agent failure before you ship it

#failuremodes #testing #evals #reliability

6 min read

Walker Miller

Aug 13

Loop drift: how agents convince themselves they're making progress

#failuremodes #evals #postmortem #loops

7 min read

Dylan Merigaud

Aug 12

One pass of my eval bills $9.14 on the API and $0 through the CLI

#ai #evals #claude #tooling

2 min read

Walker Miller

Aug 12

Your LLM-as-judge is lying to you

#evals #llmasjudge #testing #bias

8 min read

Walker Miller

Aug 10

Evaluating your evals: how to know the LLM judge is right

#evals #llmasjudge #testing #metrics

5 min read

frontendfacile.it

Aug 7

AI per developer: cosa accelera davvero (e cosa ti fa perdere tempo)

#workflowaicoding #agentillm #evals #reliabilitytesting

4 min read

juan pablo hernández

Aug 3

I have been Vibecoding Evals (works better than I thought)

#ai #llm #python #evals

3 min read

matsumotory

Aug 4

Rewriting prose until the tests pass: everything passed, but the check that mattered never ran once

#testing #aiwriting #evals #promptengineering

6 min read

matsumotory

Aug 4

Rewriting research prose until the tests pass

#testing #research #aiwriting #evals

5 min read

Agnel Nieves for Promptway

Jul 29

The 12-Prompt Eval I Run Before I Trust Any Model Upgrade

#prompting #evals #modelmigration #claude

3 min read

Dhanush Reddy

Aug 8

How to Build AI Evals for Tool-Calling Agents

#ai #evals #aievals #agents

17 min read

Edward Li

Jul 8

Do not choose an AI model from a leaderboard alone

#ai #api #llm #evals

3 min read

Ethan Walker

Jul 5

# A 94% pass rate hid a PII leak in 6 test cases

#ai #llm #evals

5 min read

Nabbil Khan

Jul 19

Zero Is Not a Score

#advertising #aiagentoperations #developertooling #evals

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.