DEV Community

zhongqiyue profile picture

zhongqiyue

404 bio not found

Location beijing,china Joined Joined on 
I slashed AI API costs by 80% with a cache that actually works

I slashed AI API costs by 80% with a cache that actually works

Comments
3 min read

Want to connect with zhongqiyue?

Create an account to connect with zhongqiyue. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
When AI APIs Let You Down: Building a Resilient Proxy Layer

When AI APIs Let You Down: Building a Resilient Proxy Layer

Comments
4 min read
Stop Copy-Pasting AI Output: How I Forced My LLM to Speak JSON

Stop Copy-Pasting AI Output: How I Forced My LLM to Speak JSON

1
Comments 1
6 min read
Why I Stopped Writing Regex for Web Scraping and Used an LLM

Why I Stopped Writing Regex for Web Scraping and Used an LLM

Comments
4 min read
From Regex Hell to AI: How I Finally Tamed Messy PDF Invoices

From Regex Hell to AI: How I Finally Tamed Messy PDF Invoices

1
Comments 1
5 min read
When Your API Keeps Changing: My Battle with Dynamic JSON Parsing

When Your API Keeps Changing: My Battle with Dynamic JSON Parsing

Comments
4 min read
When Your AI API Budget Blew Up: Multi-Provider Routing

When Your AI API Budget Blew Up: Multi-Provider Routing

Comments
5 min read
How I Used AI to Simulate Realistic Coding Interviews

How I Used AI to Simulate Realistic Coding Interviews

1
Comments
5 min read
How I built a simple AI router to avoid vendor lock-in and costs

How I built a simple AI router to avoid vendor lock-in and costs

Comments
4 min read
How I Stopped Fighting AI Hallucinations by Using Structured Prompts

How I Stopped Fighting AI Hallucinations by Using Structured Prompts

2
Comments
5 min read
Why my AI assistant couldn't remember a thing and how I fixed it

Why my AI assistant couldn't remember a thing and how I fixed it

Comments
5 min read
Why my AI app kept failing (and how I fixed rate limits & retries)

Why my AI app kept failing (and how I fixed rate limits & retries)

1
Comments
5 min read
Why I stopped scraping HTML and started using AI to extract data

Why I stopped scraping HTML and started using AI to extract data

Comments
4 min read
How I Got AI to Actually Write Useful Unit Tests (Without Hallucinating)

How I Got AI to Actually Write Useful Unit Tests (Without Hallucinating)

3
Comments 2
4 min read
My AI Integration Was a Disaster Until I Added These Three Layers

My AI Integration Was a Disaster Until I Added These Three Layers

1
Comments
4 min read
I Spent Hours Parsing Logs Until I Tried This AI Approach

I Spent Hours Parsing Logs Until I Tried This AI Approach

Comments
3 min read
Why I Stopped Writing Landing Page Copy by Hand (and How AI Helped Me Iterate Faster)

Why I Stopped Writing Landing Page Copy by Hand (and How AI Helped Me Iterate Faster)

Comments
5 min read
How I Automated API Documentation with AI – Lessons Learned

How I Automated API Documentation with AI – Lessons Learned

Comments
5 min read
Why My AI Chatbot Was Too Slow (and How I Fixed It)

Why My AI Chatbot Was Too Slow (and How I Fixed It)

2
Comments
5 min read
I Built a Git Commit Message Generator with AI (Here's What I Learned)

I Built a Git Commit Message Generator with AI (Here's What I Learned)

1
Comments
5 min read
Why Regex Failed Me for Data Extraction (and What I Use Now)

Why Regex Failed Me for Data Extraction (and What I Use Now)

Comments
4 min read
My messy adventures juggling multiple AI APIs (and how I tamed them)

My messy adventures juggling multiple AI APIs (and how I tamed them)

2
Comments
5 min read
How One Abstraction Tamed AI Integration Chaos

How One Abstraction Tamed AI Integration Chaos

1
Comments 1
5 min read
How I Stopped Fighting LLMs for Structured Output (and What I Learned)

How I Stopped Fighting LLMs for Structured Output (and What I Learned)

1
Comments
4 min read
I built an internal AI assistant: lessons on cost and control

I built an internal AI assistant: lessons on cost and control

5
Comments
4 min read
From Regex to LLMs: My Journey Extracting Unstructured Web Data

From Regex to LLMs: My Journey Extracting Unstructured Web Data

1
Comments
4 min read
Taming AI Latency: Streaming Responses with Server-Sent Events

Taming AI Latency: Streaming Responses with Server-Sent Events

6
Comments
5 min read
Why My Web Scrapers Keep Breaking and How I Finally Fixed Them

Why My Web Scrapers Keep Breaking and How I Finally Fixed Them

1
Comments
4 min read
How I Slashed LLM API Costs by 70% with Batching (No Magic)

How I Slashed LLM API Costs by 70% with Batching (No Magic)

3
Comments
6 min read
Why regex couldn't parse my invoices (and what did)

Why regex couldn't parse my invoices (and what did)

3
Comments
4 min read
My AI integration had terrible costs until I changed my approach

My AI integration had terrible costs until I changed my approach

4
Comments
4 min read
I built a code Q&A bot with RAG – what worked and what failed

I built a code Q&A bot with RAG – what worked and what failed

1
Comments
5 min read
Struggling with Slow AI Responses: Building a Streaming Chat UI with SSE

Struggling with Slow AI Responses: Building a Streaming Chat UI with SSE

2
Comments
4 min read
How I Finally Tamed My AI API Bills (Without Losing Sanity)

How I Finally Tamed My AI API Bills (Without Losing Sanity)

Comments
5 min read
I tried to add AI chat to my app and hit a wall with context tokens

I tried to add AI chat to my app and hit a wall with context tokens

1
Comments 2
4 min read
Why My AI API Calls Were Failing (And How I Fixed It)

Why My AI API Calls Were Failing (And How I Fixed It)

Comments
4 min read
How I Stopped Wrestling with LLM Outputs (and Started Using Structured Extraction)

How I Stopped Wrestling with LLM Outputs (and Started Using Structured Extraction)

Comments
5 min read
I Built a Streaming AI Chat Client Without Losing My Mind

I Built a Streaming AI Chat Client Without Losing My Mind

Comments
4 min read
How I Finally Got Reliable Data from Messy HTML Tables

How I Finally Got Reliable Data from Messy HTML Tables

Comments
4 min read
I almost gave up on AI integrations — here's what saved me

I almost gave up on AI integrations — here's what saved me

3
Comments
3 min read
Taming the Chaos: Parsing Messy HTML with LLMs

Taming the Chaos: Parsing Messy HTML with LLMs

1
Comments
4 min read
How I Stopped Regexing HTML Tables and Started Using AI for Data Extraction

How I Stopped Regexing HTML Tables and Started Using AI for Data Extraction

4
Comments 1
5 min read
How I Tamed AI API Latency with Streaming and Prompt Caching

How I Tamed AI API Latency with Streaming and Prompt Caching

Comments 1
4 min read
How I Stopped My AI Feature from Draining My Wallet

How I Stopped My AI Feature from Draining My Wallet

Comments
5 min read
How I stopped burning money on AI API calls (and got faster responses)

How I stopped burning money on AI API calls (and got faster responses)

Comments
4 min read
How I Tamed AI API Rate Limits with a Simple Queue

How I Tamed AI API Rate Limits with a Simple Queue

Comments
4 min read
Why my AI chatbot kept forgetting things (and how I fixed it)

Why my AI chatbot kept forgetting things (and how I fixed it)

2
Comments
4 min read
Why I Stopped Relying on a Single AI Provider (and Built a Fallback System)

Why I Stopped Relying on a Single AI Provider (and Built a Fallback System)

2
Comments
5 min read
I spent weeks scraping 50 websites—here's what finally worked

I spent weeks scraping 50 websites—here's what finally worked

1
Comments
4 min read
When Your AI API Goes Down: A Real-World Fallback Strategy

When Your AI API Goes Down: A Real-World Fallback Strategy

3
Comments 4
4 min read
How I Fixed My AI Chatbot's Timeout Nightmare

How I Fixed My AI Chatbot's Timeout Nightmare

1
Comments 1
5 min read
Why I ditched regex scrapers for an LLM parser (and when you shouldn't)

Why I ditched regex scrapers for an LLM parser (and when you shouldn't)

1
Comments
4 min read
When Regex Fails: My Journey to AI-Powered Data Extraction

When Regex Fails: My Journey to AI-Powered Data Extraction

1
Comments
4 min read
Extracting structured data from messy text: what worked for me

Extracting structured data from messy text: what worked for me

1
Comments
3 min read
I tried 5 ways to build a Q&A system over my docs — here's what worked

I tried 5 ways to build a Q&A system over my docs — here's what worked

1
Comments 1
5 min read
How I stopped fighting AI API chaos with a simple proxy

How I stopped fighting AI API chaos with a simple proxy

Comments 1
5 min read
How I automated markdown docs from UI screenshots using AI

How I automated markdown docs from UI screenshots using AI

Comments
5 min read
How I Built a Secure AI API Proxy Without Losing My Sanity

How I Built a Secure AI API Proxy Without Losing My Sanity

Comments
4 min read
Building a Serverless Proxy for AI APIs: Lessons Learned

Building a Serverless Proxy for AI APIs: Lessons Learned

1
Comments
4 min read
How I Fixed My AI Chatbot's Laggy Responses with Server-Sent Events

How I Fixed My AI Chatbot's Laggy Responses with Server-Sent Events

1
Comments
5 min read
loading...