DEV Community

← All Trends

Validating AI Agent Patches in Testing

32 posts in this trend in the last 7 days • Active 4 days ago
Which Check Would Have Caught It? A Fault-to-Test Attribution Matrix for Agent Patches
datacpp_8185 profile

Which Check Would Have Caught It? A Fault-to-Test Attribution Matrix for Agent Patches

#testing #ai #python #devtools
Comments
6 min read
A Gate Order for Agent Patches
gitpy_4124 profile

A Gate Order for Agent Patches

#testing #ai #python #ci
Comments
4 min read
Cheapest First: Sequencing Agent-Patch Checks by Cost, and a Freeze That Re-Arms Itself
datacpp_8185 profile

Cheapest First: Sequencing Agent-Patch Checks by Cost, and a Freeze That Re-Arms Itself

#testing #ai #python #devops
Comments
5 min read
Quarantine Flaky Evals Before They Mask a Regression
byteio_3726 profile

Quarantine Flaky Evals Before They Mask a Regression

#ai #testing #python #opensource
Comments
9 min read
The Patch Added a Sleep: Reviewing Timing and Retry Hunks Before Merge
datacpp_8185 profile

The Patch Added a Sleep: Reviewing Timing and Retry Hunks Before Merge

#testing #ai #python #cicd
Comments
6 min read
Case Study: A Record/Replay Cassette That Makes an AI Agent Test Deterministic
devrs_9381 profile

Case Study: A Record/Replay Cassette That Makes an AI Agent Test Deterministic

#python #testing #ai #devops
Comments
6 min read
Two Runs, One Verdict
gitpy_4124 profile

Two Runs, One Verdict

#testing #ai #python #devops
Comments
4 min read
A Test That Cannot Fail Is Decoration: Gating Model-Drafted Characterization Tests
hackrs_6393 profile

A Test That Cannot Fail Is Decoration: Gating Model-Drafted Characterization Tests

#testing #refactoring #python #ai
Comments
5 min read
Flaky Is Not Failed: A Repeat-k Triage Loop for AI-Written C++ Patches
devcpp_268 profile

Flaky Is Not Failed: A Repeat-k Triage Loop for AI-Written C++ Patches

#cpp #testing #ai #devops
Comments
5 min read
48-Hour Field Notes: I Put a Gate in Front of AI-Suggested Patches — Four Failures It Caught
codepy_1473 profile

48-Hour Field Notes: I Put a Gate in Front of AI-Suggested Patches — Four Failures It Caught

#testing #ai #python #devops
Comments
6 min read
The Mutant Run: Catching Weakened Tests in an OSS Patch With Three Git Worktrees
datars_7274 profile

The Mutant Run: Catching Weakened Tests in an OSS Patch With Three Git Worktrees

#opensource #git #testing #ai
Comments 1
7 min read
Record Once, Replay Forever: Cassette Tests for Flaky Agent Tool Calls
apprs_6334 profile

Record Once, Replay Forever: Cassette Tests for Flaky Agent Tool Calls

#ai #testing #observability #python
Comments
4 min read
Your CI is green. Your tests might be lying.
techdevfun profile

Your CI is green. Your tests might be lying.

#testing #python #javascript #ai
Comments
3 min read
The Patch Reads the Wall Clock: A Time-Source Audit for Agent Patches
datacpp_8185 profile

The Patch Reads the Wall Clock: A Time-Source Audit for Agent Patches

#testing #ai #devtools #javascript
Comments
6 min read