Evaluation

👋 Sign in for the ability to sort posts by relevant, latest, or top.

The Engineering Manager’s Desk

Aug 15

Writing the code is no longer the bottleneck

#engineeringculture #evaluation #ai #techdebt

3 min read

The AI Downside

Aug 15

Why AI Benchmarks Mean Less Than You Think

#benchmarks #llms #evaluation #hype

6 min read

Guatu

Aug 14

We Almost Deployed a Temporal Knowledge Graph. The Eval Said No.

#aiagents #knowledgegraph #evaluation #rag

7 min read

Sanjeev Kumar

Aug 12

Choosing the Right LLM-as-a-Judge: A Practical Guide with Model Recommendations

#ai #llm #evaluation

7 min read

Adha AK

Aug 4

How EvalPort's Grader System Works: 11 Types for LLM Evaluation

#llm #evaluation #testing #opensource

2 min read

Saurav Bhattacharya

Aug 12

Measure the Judge Before You Trust It: Self-Consistency Comes Before Human Agreement

#ai #evaluation #dotnet #testing

6 min read

Xinyang Wu

Aug 3

RAG Beyond the Demo: Pipeline, Citations, Evaluation, and When Not to Bother

#rag #llm #embeddings #evaluation

7 min read

Adha AK

Jul 30

OpenEval: Why LLM Evaluation Needs a Standard Format

#llm #evaluation #ai #testing

1 min read

Saurav Bhattacharya

Aug 12

Your Agent's Context Window Overflowed and It Answered Anyway

#ai #agents #observability #evaluation

4 min read

Sanjeev Kumar

Aug 12

Choosing the Right LLM-as-a-Judge: A Practical Guide with Model Recommendations

#ai #llm #evaluation

7 min read

Maya Andersson

Jul 21

Your eval dashboard has 30 metrics. When one "moves," that is usually arithmetic, not a regression.

#statistics #machinelearning #datascience #evaluation

6 min read

Saurav Bhattacharya

Aug 9

Your Golden Dataset Is Rotting: The Eval Oracle Nobody Re-Validates

#ai #agents #evaluation #observability

5 min read

Pneumetron

Jul 15

PoPE: Placebo-Controlled Evaluation Challenges Error-Conditioned Self-Repair in Small Code LLMs

#llms #codegeneration #selfrepair #evaluation

3 min read

Rickesh T N

Aug 7

Your reasoning model isn't dumb. Your parser is throwing away its best answers.

#machinelearning #llm #evaluation #ai

4 min read

shakti tiwari

Aug 5

I Built an Agent Evaluation Harness for Local AI — What Most People Get Wrong

#aiagents #evaluation #localai #testing

13 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.