Skip to content

DEV Community

InferenceKey

Open models on your own GPUs: experiments, measurements and the exact commands behind them. Full write-ups at inferencekey.com

inferencekey.com Joined on Oct 14, 2026

Oct 27

Serving LFM2.5-24B-A2B on one 48 GB GPU: the flags, the traps and what to measure

#ai #llm #gpu #selfhosted

4 min read

Oct 26

Building a speech editing API on AuK-Flash: the knobs it ignores and the wording it doesn't

#ai #machinelearning #python #opensource

5 min read

Oct 25

Serving a 6 GB ternary 27B model: the settings that decide whether it works

#llm #ai #gpu #selfhosted

4 min read

Oct 24

Muse Spark Open vs DeepSeek V4.1 Flash in Claude Code: what to measure before you pick

#ai #llm #opensource #machinelearning

4 min read

Oct 23

Self-hosting AstaBrief-8B for cited reports: check every bracket before anyone reads it

#ai #llm #python #opensource

4 min read

Oct 22

Three settings that decide whether EmbeddingGemma 2 search works on your GPU

#ai #machinelearning #python #opensource

4 min read

Oct 21

Fifty API keys, one queue, ten GPU workers: the parts of a shared LLM that are not the model

#ai #llm #devops #selfhosted

4 min read

Oct 20

Fine-tuning Pocket TTS for Castilian Spanish: stop at step 600 and judge the accent by ear

#ai #machinelearning #python #opensource

4 min read

loading...