DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
I pointed raw requests at 8 anti-bot-protected sites, then tested every proxy route — here's what actually worked

I pointed raw requests at 8 anti-bot-protected sites, then tested every proxy route — here's what actually worked

Comments
4 min read
How we built Bytewells: open-source foundations, our own stack, and a marketplace that does not force a fork

How we built Bytewells: open-source foundations, our own stack, and a marketplace that does not force a fork

Comments
9 min read
Getting eBay search results and prices as JSON with Python (no API key, no browser)

Getting eBay search results and prices as JSON with Python (no API key, no browser)

Comments
5 min read
Where salaries show up in Google Jobs: a 6-market snapshot (and why Singapore stands out)

Where salaries show up in Google Jobs: a 6-market snapshot (and why Singapore stands out)

Comments
4 min read
Scrapling in Practice: A Hands-On Look at a 97k-Star Python Scraping Project

Scrapling in Practice: A Hands-On Look at a 97k-Star Python Scraping Project

Comments
8 min read
677 of 785 Telegram Reaction Chips Counted Zero. The Custom Emoji and the Paid Stars Were Fine

677 of 785 Telegram Reaction Chips Counted Zero. The Custom Emoji and the Paid Stars Were Fine

Comments
7 min read
A year of Google searches for 7 AI chatbots: ChatGPT's share fell from 67% to 54%, and Claude's interest more than tripled

A year of Google searches for 7 AI chatbots: ChatGPT's share fell from 67% to 54%, and Claude's interest more than tripled

Comments
4 min read
Wireless earbuds on four Amazons: Japan rates about half a star lower, Mexico shows the biggest discounts

Wireless earbuds on four Amazons: Japan rates about half a star lower, Mexico shows the biggest discounts

Comments
4 min read
Scraping Capterra Reviews Without Logging In: Next.js Page Data, Cloudflare and the 375-Review Wall

Scraping Capterra Reviews Without Logging In: Next.js Page Data, Cloudflare and the 375-Review Wall

Comments
3 min read
¿Qué ofertas de empleo publican el salario? Cómo leer los rangos salariales de Greenhouse, Lever y Ashby

¿Qué ofertas de empleo publican el salario? Cómo leer los rangos salariales de Greenhouse, Lever y Ashby

Comments
7 min read
One Live Palantir Posting Is Dated December 2009. 535 of My 2,207 Lever Jobs Are Over a Year Old

One Live Palantir Posting Is Dated December 2009. 535 of My 2,207 Lever Jobs Are Over a Year Old

Comments
7 min read
An IT Jobs Filter Can Exclude a Bank's Engineers

An IT Jobs Filter Can Exclude a Bank's Engineers

Comments
6 min read
What We Learned Building a DIY Web Scraper published

What We Learned Building a DIY Web Scraper published

5
Comments
10 min read
How do you know a job posting closed? 30% of the closures we first recorded were wrong

How do you know a job posting closed? 30% of the closures we first recorded were wrong

Comments
5 min read
Web Scraping for RAG: Build a Reliable Pipeline with Zyte API, Qdrant and LangChain

Web Scraping for RAG: Build a Reliable Pipeline with Zyte API, Qdrant and LangChain

Comments
22 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.