Gpu - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

ZoomApps

Oct 27

Sizing VRAM for a Self-Hosted LLM: 7B to 70B on a Rented GPU Server

#llm #gpu #machinelearning #devops

7 min read

Runcrate

Oct 27

SDXL images per dollar on four GPUs: RTX A6000, L40S, RTX 5090 and H100, eager vs torch.compile

#stablediffusion #gpu #pytorch #benchmark

6 min read

Runcrate

Oct 27

vLLM FP8 vs bf16 on an H100: 1.4x the throughput, and what it did to GSM8K accuracy

#vllm #llm #gpu #benchmark

5 min read

Runcrate

Oct 27

vLLM prefix caching on vs off: 7.5x the throughput with a 4,000-token system prompt on one L40S

#vllm #llm #gpu #performance

6 min read

Nuvem Dev

Oct 27

Rodando LLM em GPU alugada por hora: checklist e comandos (RunPod)

#ai #gpu #llm #linux

2 min read

VoltageGPU

Oct 27

Check an 8-GPU Node Before a Multi-Day Training Run

#gpu #nvidia #machinelearning #linux

23 min read

InferenceKey for InferenceKey

Oct 27

Serving LFM2.5-24B-A2B on one 48 GB GPU: the flags, the traps and what to measure

#ai #llm #gpu #selfhosted

4 min read

AskGPU

Oct 27

H100 vs A100 vs L40S: what to check before renting a cloud GPU

#gpu #ai #cloud #machinelearning

2 min read

Oct 27

Know Rust? Learn CUDA by Solving GPU Challenges

#rust #cuda #gpu

4 min read

sam ros

Oct 26

SGLang's +75% sampler speedup skips Qwen3 chat requests

#ai #llm #python #gpu

9 min read

Viswaretas Kotra

Oct 26

Should you run an LLM locally or in the cloud?

#llm #ai #machinelearning #gpu

8 min read

Runcrate

Oct 26

4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

#pytorch #gpu #machinelearning #performance

4 min read

Runcrate

Oct 26

How long until a rented GPU runs CUDA? Launch to first matmul on six GPU types, timed

#gpu #cuda #pytorch #devops

5 min read

CloudGPU

Oct 26

Save Your Work Before You Destroy a Cloud GPU: Checkpoints, rsync and Hub Uploads (2026)

#gpu #machinelearning #linux #tutorial

4 min read

orca forge

Oct 26

Why gpu-unlock Speeds Up RTX 3090 Prefill but Barely Changes Decode

#gpu #llm #linux

7 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.