DEV Community

Multigrid profile picture

Multigrid

Building Multigrid — one API and one balance across every major model provider, with routing, failover and cost telemetry. I write about inference: what it costs, why it breaks, how to measure it.

Joined Joined on  Personal website https://multigrid.ai

Work

Building Multigrid (multigrid.ai)

Extracting Structured Data From a Zoning Compliance Letter

Extracting Structured Data From a Zoning Compliance Letter

Comments
5 min read

Want to connect with Multigrid?

Create an account to connect with Multigrid. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Zero-Shot Time Series Forecasting Without Training a Model

Zero-Shot Time Series Forecasting Without Training a Model

Comments
5 min read
Zero-Shot Object Detection With Open-Vocabulary Models

Zero-Shot Object Detection With Open-Vocabulary Models

Comments
6 min read
What "Zero Data Retention" Terms Mean and How They Differ

What "Zero Data Retention" Terms Mean and How They Differ

Comments
5 min read
Output Copyrightability: the Zarya of the Dawn and Thaler Decisions

Output Copyrightability: the Zarya of the Dawn and Thaler Decisions

Comments
5 min read
Yi Models’ Context Window and License Terms

Yi Models’ Context Window and License Terms

Comments
5 min read
Rewriting XML-Delimited Prompts for a Model That Does Not Favour XML

Rewriting XML-Delimited Prompts for a Model That Does Not Favour XML

Comments
5 min read
How Many Writing Systems Are in Active Use Today

How Many Writing Systems Are in Active Use Today

Comments
5 min read
Writing an Adapter Layer to Isolate Provider-Specific Code

Writing an Adapter Layer to Isolate Provider-Specific Code

Comments
6 min read
Writing Prompts Natively Instead of Translating Them

Writing Prompts Natively Instead of Translating Them

Comments
5 min read
Why the Retry Branch Stopped Firing After the Migration

Why the Retry Branch Stopped Firing After the Migration

Comments
6 min read
Extracting Claims Data From a Workers' Compensation First Report of Injury

Extracting Claims Data From a Workers' Compensation First Report of Injury

Comments
5 min read
What Workers AI Is Good For Inside a Cloudflare Stack

What Workers AI Is Good For Inside a Cloudflare Stack

Comments
5 min read
Running Text Generation on Cloudflare Workers AI

Running Text Generation on Cloudflare Workers AI

Comments
5 min read
Streaming Responses From Cloudflare Workers AI

Streaming Responses From Cloudflare Workers AI

Comments
6 min read
Rate Limits on Cloudflare Workers AI

Rate Limits on Cloudflare Workers AI

Comments
5 min read
Cloudflare Workers AI Pricing and Neuron Limits

Cloudflare Workers AI Pricing and Neuron Limits

Comments
5 min read
Generating Images on Cloudflare Workers AI

Generating Images on Cloudflare Workers AI

Comments
5 min read
Generating Embeddings With Cloudflare Workers AI

Generating Embeddings With Cloudflare Workers AI

Comments
5 min read
The Workday AI Hiring Lawsuit: Where the Case Stands

The Workday AI Hiring Lawsuit: Where the Case Stands

Comments
6 min read
Why Translating a Prompt Word for Word Produces Worse Output

Why Translating a Prompt Word for Word Produces Worse Output

Comments
5 min read
Stubbing an LLM API With WireMock in Java

Stubbing an LLM API With WireMock in Java

Comments
5 min read
Why the Same Prompt Costs a Different Amount on Two Providers

Why the Same Prompt Costs a Different Amount on Two Providers

Comments
5 min read
Why You Have to Re-Embed When You Change Embedding Models

Why You Have to Re-Embed When You Change Embedding Models

Comments
6 min read
Transcribing Audio Locally With whisper.cpp

Transcribing Audio Locally With whisper.cpp

Comments
5 min read
whisper.cpp Hallucinating Text on Silence

whisper.cpp Hallucinating Text on Silence

Comments
5 min read
whisper.cpp: “failed to load model”

whisper.cpp: “failed to load model”

Comments
5 min read
The Latency Budget for Real-Time Local Whisper Transcription

The Latency Budget for Real-Time Local Whisper Transcription

Comments
5 min read
Choosing a Whisper Model Size for Your VRAM Budget, Derived

Choosing a Whisper Model Size for Your VRAM Budget, Derived

Comments
5 min read
Whisper Accuracy by Model Size, Sourced

Whisper Accuracy by Model Size, Sourced

Comments
5 min read
What Local Whisper Doesn't Do: Speaker Diarization

What Local Whisper Doesn't Do: Speaker Diarization

Comments
5 min read
How Slow Whisper Is on CPU Only, Derived

How Slow Whisper Is on CPU Only, Derived

Comments
5 min read
When SageMaker Makes Sense Instead of a Hosted Model API

When SageMaker Makes Sense Instead of a Hosted Model API

Comments
6 min read
When to Stop Dual-Running and Cut Over Fully

When to Stop Dual-Running and Cut Over Fully

Comments
6 min read
Deciding Which Tests Need Determinism and Which Don't

Deciding Which Tests Need Determinism and Which Don't

Comments
5 min read
What “OpenAI-Compatible” Actually Means for an Endpoint

What “OpenAI-Compatible” Actually Means for an Endpoint

Comments
5 min read
What Code-Switching Is, and Why It Breaks Simple NLP Assumptions

What Code-Switching Is, and Why It Breaks Simple NLP Assumptions

Comments
5 min read
What a Model Family Is, and Why Prompts Do Not Transfer Across One

What a Model Family Is, and Why Prompts Do Not Transfer Across One

Comments
5 min read
Prompt Portability: What Breaks When You Move a Prompt to Another Model Family

Prompt Portability: What Breaks When You Move a Prompt to Another Model Family

Comments
5 min read
Pluralization Rules in Welsh and Why They Break Standard Libraries

Pluralization Rules in Welsh and Why They Break Standard Libraries

Comments
5 min read
Weight-Only Quantization Explained

Weight-Only Quantization Explained

Comments
5 min read
Why AI Calendars Default to the Wrong Start of Week

Why AI Calendars Default to the Wrong Start of Week

Comments
5 min read
Why AI Gets the Week Number Wrong Across Locales

Why AI Gets the Week Number Wrong Across Locales

Comments
5 min read
Stubbing an LLM API With WebMock in Ruby

Stubbing an LLM API With WebMock in Ruby

Comments
5 min read
WebLLM: Start to First Response in the Browser

WebLLM: Start to First Response in the Browser

Comments
5 min read
Mapping Webhook and Callback Payload Fields Between Providers

Mapping Webhook and Callback Payload Fields Between Providers

Comments
6 min read
Model Size Limits for WebGPU Inference in the Browser, Derived

Model Size Limits for WebGPU Inference in the Browser, Derived

Comments
5 min read
What Happens When a Browser Doesn't Support WebGPU

What Happens When a Browser Doesn't Support WebGPU

Comments
5 min read
Washington's My Health My Data Act and AI-Inferred Health Data

Washington's My Health My Data Act and AI-Inferred Health Data

Comments
6 min read
Extracting Structured Data From a Warranty Registration Card

Extracting Structured Data From a Warranty Registration Card

Comments
5 min read
Extracting Warranty Disclaimers From a Contract's Boilerplate Section

Extracting Warranty Disclaimers From a Contract's Boilerplate Section

Comments
5 min read
Extracting Structured Fields From a Warranty Claim Denial Letter

Extracting Structured Fields From a Warranty Claim Denial Letter

Comments
6 min read
Extracting Box Values From a W-2 Form

Extracting Box Values From a W-2 Form

Comments
6 min read
Picking a GPU by VRAM per Dollar for Local Inference

Picking a GPU by VRAM per Dollar for Local Inference

Comments
6 min read
Fixing a Timeout Calling a Model API From Inside a Locked-Down VPC

Fixing a Timeout Calling a Model API From Inside a Locked-Down VPC

Comments
6 min read
VPC Peering Between an Inference Service and a Vector Database

VPC Peering Between an Inference Service and a Vector Database

Comments
5 min read
Fixing DNS Resolution Failing for a Model Endpoint Inside a VPC

Fixing DNS Resolution Failing for a Model Endpoint Inside a VPC

Comments
6 min read
Voxel Grids and Point Clouds: Why the Representation You Pick Changes the Model

Voxel Grids and Point Clouds: Why the Representation You Pick Changes the Model

Comments
6 min read
Extracting Structured Fields From a Voter Registration Form

Extracting Structured Fields From a Voter Registration Form

Comments
6 min read
What Breaks in a Voice Assistant's Latency Budget After a Migration

What Breaks in a Voice Assistant's Latency Budget After a Migration

Comments
5 min read
loading...