Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
benchmark
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
SDXL images per dollar on four GPUs: RTX A6000, L40S, RTX 5090 and H100, eager vs torch.compile
Runcrate
Runcrate
Runcrate
Follow
Oct 27
SDXL images per dollar on four GPUs: RTX A6000, L40S, RTX 5090 and H100, eager vs torch.compile
#
stablediffusion
#
gpu
#
pytorch
#
benchmark
Comments
Add Comment
6 min read
vLLM FP8 vs bf16 on an H100: 1.4x the throughput, and what it did to GSM8K accuracy
Runcrate
Runcrate
Runcrate
Follow
Oct 27
vLLM FP8 vs bf16 on an H100: 1.4x the throughput, and what it did to GSM8K accuracy
#
vllm
#
llm
#
gpu
#
benchmark
Comments
Add Comment
5 min read
DeepSeek v4.1 Flash Benchmark: Testing a 1M Context LLM Route
JIA
JIA
JIA
Follow
Oct 27
DeepSeek v4.1 Flash Benchmark: Testing a 1M Context LLM Route
#
api
#
llm
#
deepseek
#
benchmark
Comments
Add Comment
2 min read
GitHub Actions runners ranked by speed and cost per job (October 2026)
Joseph Vitko
Joseph Vitko
Joseph Vitko
Follow
Oct 27
GitHub Actions runners ranked by speed and cost per job (October 2026)
#
githubactions
#
ci
#
devops
#
benchmark
1
reaction
Comments
Add Comment
2 min read
Your Benchmark Has No Cost Axis: Score Free Endpoints by Quota per Accepted Patch
Casey Zhang
Casey Zhang
Casey Zhang
Follow
Oct 26
Your Benchmark Has No Cost Axis: Score Free Endpoints by Quota per Accepted Patch
#
benchmark
#
ai
#
testing
#
python
Comments
Add Comment
6 min read
Which of your LLM calls are really decisions? What we measured with a System One model
Devji
Devji
Devji
Follow
for
Dwayo AI
Oct 26
Which of your LLM calls are really decisions? What we measured with a System One model
#
ai
#
llm
#
benchmark
#
machinelearning
Comments
Add Comment
7 min read
Parakeet v3 vs Whisper vs Apple's on-device model in 25 languages, every transcript published
yapapp
yapapp
yapapp
Follow
Oct 26
Parakeet v3 vs Whisper vs Apple's on-device model in 25 languages, every transcript published
#
machinelearning
#
speechrecognition
#
whisper
#
benchmark
1
reaction
Comments
1
comment
3 min read
Reading a Hardware-Equivalence Claim Like an Evaluator: A Checklist Applied to an NPU vs GPU Pretraining Twin
Ward Ed
Ward Ed
Ward Ed
Follow
Oct 26
Reading a Hardware-Equivalence Claim Like an Evaluator: A Checklist Applied to an NPU vs GPU Pretraining Twin
#
ai
#
machinelearning
#
benchmark
#
llm
Comments
Add Comment
2 min read
vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100
Runcrate
Runcrate
Runcrate
Follow
Oct 26
vLLM on three GPUs: Qwen2.5-7B tokens per second and cost per 1M tokens on RTX A6000, L40S and H100
#
vllm
#
llm
#
gpu
#
benchmark
1
reaction
Comments
Add Comment
5 min read
Benchmark 2026: Probamos 50 Agentes de IA para Ecommerce con 10 Preguntas Difíciles (Arquitectura, Latencia y Conversión)
iTRAFIC
iTRAFIC
iTRAFIC
Follow
Oct 25
Benchmark 2026: Probamos 50 Agentes de IA para Ecommerce con 10 Preguntas Difíciles (Arquitectura, Latencia y Conversión)
#
ecommerce
#
ai
#
webdev
#
benchmark
Comments
Add Comment
3 min read
Six open models, one question: 1.3 s for the fastest answer, 16 s for the slowest, and hidden thinking made the difference
Runcrate
Runcrate
Runcrate
Follow
Oct 25
Six open models, one question: 1.3 s for the fastest answer, 16 s for the slowest, and hidden thinking made the difference
#
llm
#
benchmark
#
python
#
ai
Comments
Add Comment
5 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
RESK
RESK
RESK
Follow
Oct 24
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA RL Game Agents Benchmark
#
llm
#
evaluation
#
benchmark
#
reinforcementlearnin
Comments
Add Comment
4 min read
ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested
Ishank Choudhary
Ishank Choudhary
Ishank Choudhary
Follow
Oct 24
ScaleDown CDMs: Fast, Cheap Classify, Extract and Summarize Models Tested
#
ai
#
llm
#
machinelearning
#
benchmark
Comments
Add Comment
8 min read
What a Youden index of 77 actually means on the OWASP Benchmark
Ward Ed
Ward Ed
Ward Ed
Follow
Oct 23
What a Youden index of 77 actually means on the OWASP Benchmark
#
security
#
appsec
#
benchmark
#
testing
Comments
Add Comment
1 min read
AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축
Vidraft_lab
Vidraft_lab
Vidraft_lab
Follow
Oct 22
AI 신약 설계 챌린지 2만 3,886건의 점수표를 뜯어 보니: 만점에 닿은 축과 한 번도 닿지 못한 축
#
ai
#
python
#
datascience
#
benchmark
Comments
Add Comment
4 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account