DEV Community

Scraping

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Before you automate a browser, check the network tab

Before you automate a browser, check the network tab

Comments
4 min read
The Hidden Costs of Web Scraping: Evaluating Proxy Uptime and True Pricing Performance

The Hidden Costs of Web Scraping: Evaluating Proxy Uptime and True Pricing Performance

Comments
4 min read
Beyond Marketing Myths: Proxy Network Performance Benchmarks & Reliability Auditing in Production

Beyond Marketing Myths: Proxy Network Performance Benchmarks & Reliability Auditing in Production

Comments
3 min read
How to evaluate a search API for AI agents without confusing search with extraction

How to evaluate a search API for AI agents without confusing search with extraction

Comments
4 min read
How to automatically detect any company's tech stack and logo from just their domain name

How to automatically detect any company's tech stack and logo from just their domain name

Comments
1 min read
Booster Leboncoin: the Manifest V3 Chrome extension that bumps my ads and watches prospects for me

Booster Leboncoin: the Manifest V3 Chrome extension that bumps my ads and watches prospects for me

Comments
7 min read
How I Finally Got Reliable Data from Messy HTML Tables

How I Finally Got Reliable Data from Messy HTML Tables

Comments
4 min read
Stop scraping the page when the data is already in the network tab

Stop scraping the page when the data is already in the network tab

Comments
4 min read
I spent weeks scraping 50 websites—here's what finally worked

I spent weeks scraping 50 websites—here's what finally worked

1
Comments
4 min read
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors

I Built an API That Turns Any Website Into JSON Using Just CSS Selectors

Comments
2 min read
Why I ditched regex scrapers for an LLM parser (and when you shouldn't)

Why I ditched regex scrapers for an LLM parser (and when you shouldn't)

1
Comments
4 min read
How to Scrape Google Search Results with Python Without Getting Blocked (2026)

How to Scrape Google Search Results with Python Without Getting Blocked (2026)

Comments
10 min read
Proxy Rotation & Session Management for AI Web Agents

Proxy Rotation & Session Management for AI Web Agents

Comments
6 min read
I Built an API That Turns Any Website Into JSON Using Just CSS Selectors

I Built an API That Turns Any Website Into JSON Using Just CSS Selectors

Comments
2 min read
Rate Limits & Anti-Bots in Agentic Scraping

Rate Limits & Anti-Bots in Agentic Scraping

1
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.